Databricks Certified Data Engineer Associate — Question 20

A data analyst has a series of queries in a SQL program. The data analyst wants this program to run every day. They only want the final query in the program to run on Sundays. They ask for help from the data engineering team to complete this task.
Which of the following approaches could be used by the data engineering team to complete this task?

Answer options

• A. They could submit a feature request with Databricks to add this functionality.
• B. They could wrap the queries using PySpark and use Python’s control flow system to determine when to run the final query.
• C. They could only run the entire program on Sundays.
• D. They could automatically restrict access to the source table in the final query so that it is only accessible on Sundays.
• E. They could redesign the data model to separate the data used in the final query into a new table.

Correct answer: B

Explanation

The correct answer is B because using PySpark and Python's control flow allows for precise execution control over when the final query runs. Answer A is incorrect as feature requests do not provide immediate solutions. C is wrong because it does not meet the requirement to run daily. D does not solve the execution timing issue, and E unnecessarily complicates the data structure.