Question 11
You have just executed a MapReduce job. Where is intermediate data written to after being emitted from the Mapper's map method?
- Intermediate data in streamed across the network from Mapper to the Reduce and is never written to disk.
- Into in-memory buffers on the TaskTracker node running the Mapper that spill over and are written into HDFS.
- Into in-memory buffers that spill over to the local file system of the TaskTracker node running the Mapper.
- Into in-memory buffers that spill over to the local file system (outside HDFS) of the TaskTracker node running the Reducer
- Into in-memory buffers on the TaskTracker node running the Reducer that spill over and are written into HDFS.