Databricks Certified Data Engineer Associate — Question 31

A Delta Live Table pipeline includes two datasets defined using STREAMING LIVE TABLE. Three datasets are defined against Delta Lake table sources using LIVE TABLE.

The table is configured to run in Development mode using the Continuous Pipeline Mode.

Assuming previously unprocessed data exists and all definitions are valid, what is the expected outcome after clicking Start to update the pipeline?

Answer options

• A. All datasets will be updated once and the pipeline will shut down. The compute resources will be terminated.
• B. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will persist until the pipeline is shut down.
• C. All datasets will be updated once and the pipeline will persist without any processing. The compute resources will persist but go unused.
• D. All datasets will be updated once and the pipeline will shut down. The compute resources will persist to allow for additional testing.
• E. All datasets will be updated at set intervals until the pipeline is shut down. The compute resources will persist to allow for additional testing.

Correct answer: E

Explanation

The correct answer is E because in Continuous Pipeline Mode, the pipeline will continuously update the datasets at defined intervals until it is manually stopped. Options A, C, and D incorrectly suggest that the pipeline will shut down after a single update, which is not the case in this mode. Option B is partially correct but does not mention the testing aspect, which is included in E.