Databricks Certified Data Engineer Professional — Question 175

Where in the Spark UI can one diagnose a performance problem induced by not leveraging predicate push-down?

Answer options

• A. In the Executor’s log file, by grepping for "predicate push-down"
• B. In the Stage’s Detail screen, in the Completed Stages table, by noting the size of data read from the Input column
• C. In the Query Detail screen, by interpreting the Physical Plan
• D. In the Delta Lake transaction log. by noting the column statistics

Correct answer: C

Explanation

The correct answer is C because the Query Detail screen provides insights into the Physical Plan, which reveals whether predicate push-down has been utilized. Options A and B focus on logs and stage details that do not directly indicate the use of predicate push-down, while option D pertains to transaction logs and column statistics, which are not designed for diagnosing performance issues related to query optimization.