Databricks Certified Data Engineer Professional — Question 82

Incorporating unit tests into a PySpark application requires upfront attention to the design of your jobs, or a potentially significant refactoring of existing code.
Which statement describes a main benefit that offset this additional effort?

Answer options

• A. Improves the quality of your data
• B. Validates a complete use case of your application
• C. Troubleshooting is easier since all steps are isolated and tested individually
• D. Yields faster deployment and execution times
• E. Ensures that all steps interact correctly to achieve the desired end result

Correct answer: C

Explanation

The correct answer is C because unit tests allow each individual component of the application to be tested separately, making it easier to identify and fix issues. Options A, B, D, and E may have benefits, but they do not directly address the simplification of troubleshooting that comes with isolated testing.