Question 1
Which of the following describes the Spark driver?
- The Spark driver is responsible for performing all execution in all execution modes – it is the entire Spark application.
- The Spare driver is fault tolerant – if it fails, it will recover the entire Spark application.
- The Spark driver is the coarsest level of the Spark execution hierarchy – it is synonymous with the Spark application.
- The Spark driver is the program space in which the Spark application’s main method runs coordinating the Spark entire application.
- The Spark driver is horizontally scaled to increase overall processing throughput of a Spark application.
Question 2
Which of the following describes the relationship between nodes and executors?
- Executors and nodes are not related.
- Anode is a processing engine running on an executor.
- An executor is a processing engine running on a node.
- There are always the same number of executors and nodes.
- There are always more nodes than executors.
Question 3
Which of the following will occur if there are more slots than there are tasks?
- The Spark job will likely not run as efficiently as possible.
- The Spark application will fail – there must be at least as many tasks as there are slots.
- Some executors will shut down and allocate all slots on larger executors first.
- More tasks will be automatically generated to ensure all slots are being used.
- The Spark job will use just one single slot to perform all tasks.
Question 4
Which of the following is the most granular level of the Spark execution hierarchy?
- Task
- Executor
- Node
- Job
- Slot
Question 5
Which of the following statements about Spark jobs is incorrect?
- Jobs are broken down into stages.
- There are multiple tasks within a single job when a DataFrame has more than one partition.
- Jobs are collections of tasks that are divided up based on when an action is called.
- There is no way to monitor the progress of a job.
- Jobs are collections of tasks that are divided based on when language variables are defined.