Databricks Certified Associate Developer for Apache Spark — Question 135
Which of the following will cause a Spark job to fail?
Answer options
- A. Never pulling any amount of data onto the driver node.
- B. Trying to cache data larger than an executor's memory.
- C. Data needing to spill from memory to disk.
- D. A failed worker node.
- E. A failed driver node.
Correct answer: E
Explanation
A failed driver node will cause the Spark job to fail because the driver is responsible for orchestrating the execution of tasks. The other options do not directly lead to job failure; for instance, an executor's memory issue may cause performance degradation but not necessarily a complete job failure.