Databricks Certified Data Engineer Associate — Question 84
A Delta Live Table pipeline includes two datasets defined using STREAMING LIVE TABLE. Three datasets are defined against Delta Lake table sources using LIVE TABLE.
The table is configured to run in Production mode using the Continuous Pipeline Mode.
What is the expected outcome after clicking Start to update the pipeline assuming previously unprocessed data exists and all definitions are valid?
Answer options
- A. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will persist to allow for additional testing.
- B. All datasets will be updated once and the pipeline will shut down. The compute resources will persist to allow for additional testing.
- C. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will be deployed for the update and terminated when the pipeline is stopped.
- D. All datasets will be updated once and the pipeline will shut down. The compute resources will be terminated.
Correct answer: C
Explanation
The correct answer is C because when using Continuous Pipeline Mode in Delta Live Tables, the system is designed to update streaming datasets at regular intervals until the pipeline is stopped. The compute resources are allocated for ongoing updates and will be terminated when the pipeline is halted. The other options incorrectly describe the persistence and update frequency of datasets.