Databricks Certified Data Engineer Professional — Question 192

Spill occurs as a result of executing various wide transformations. However, diagnosing spill requires one to proactively look for key indicators.

Where in the Spark UI are two of the primary indicators that a partition is spilling to disk?

Answer options

• A. Stage’s detail screen and Query’s detail screen
• B. Stage’s detail screen and Executor’s log files
• C. Driver’s and Executor’s log files
• D. Executor’s detail screen and Executor’s log files

Correct answer: A

Explanation

The correct answer is A because the Stage’s detail screen and the Query’s detail screen provide critical metrics and information regarding partition spills. The other options, while they may contain useful information, do not specifically highlight the key indicators for spill diagnosis in Spark UI.