Databricks Certified Data Engineer Professional — Question 64

Spill occurs as a result of executing various wide transformations. However, diagnosing spill requires one to proactively look for key indicators.

Where in the Spark UI are two of the primary indicators that a partition is spilling to disk?

Answer options

• A. Query’s detail screen and Job’s detail screen
• B. Stage’s detail screen and Executor’s log files
• C. Driver’s and Executor’s log files
• D. Executor’s detail screen and Executor’s log files
• E. Stage’s detail screen and Query’s detail screen

Correct answer: B

Explanation

The correct answer is B because both the Stage’s detail screen and Executor’s log files provide essential information regarding partition spills. Options A, C, D, and E do not specifically indicate the primary sources for diagnosing spill indicators as effectively as option B does.