Databricks Certified Associate Developer for Apache Spark — Question 17

Which of the following statements about Spark jobs is incorrect?

Answer options

• A. Jobs are broken down into stages.
• B. There are multiple tasks within a single job when a DataFrame has more than one partition.
• C. Jobs are collections of tasks that are divided up based on when an action is called.
• D. There is no way to monitor the progress of a job.
• E. Jobs are collections of tasks that are divided based on when language variables are defined.

Correct answer: D

Explanation

The correct answer is D because it is indeed possible to monitor the progress of a Spark job using the Spark UI or other monitoring tools. Options A, B, and C are accurate statements about how Spark jobs function, while option E incorrectly describes job task division based on language variable definitions, which is not a criterion for task separation.