Databricks Certified Associate Developer for Apache Spark — Question 75

Which of the following statements about the Spark driver is true?

Answer options

• A. Spark driver is horizontally scaled to increase overall processing throughput.
• B. Spark driver is the most coarse level of the Spark execution hierarchy.
• C. Spark driver is fault tolerant — if it fails, it will recover the entire Spark application.
• D. Spark driver is responsible for scheduling the execution of data by various worker nodes in cluster mode.
• E. Spark driver is only compatible with its included cluster manager.

Correct answer: D

Explanation

The correct answer is D because the Spark driver is indeed responsible for scheduling tasks across various worker nodes in a cluster. Option A is incorrect as the Spark driver does not scale horizontally; option B is misleading since there are multiple levels of the execution hierarchy; option C is wrong because if the driver fails, the application does not automatically recover; option E is false as the Spark driver can work with various cluster managers.