Databricks Certified Data Engineer Associate — Question 124

A data engineer needs to ingest from both streaming and batch sources for a firm that relies on highly accurate data. Occasionally, some of the data picked up by the sensors that provide a streaming input are outside the expected parameters. If this occurs, the data must be dropped, but the stream should not fail.

Which feature of Delta Live Tables meets this requirement?

Answer options

• A. Change Data Capture
• B. Error Handling
• C. Monitoring
• D. Expectations

Correct answer: D

Explanation

The correct answer is D, Expectations, as it allows the data engineer to define conditions that data must meet before being accepted, enabling the dropping of outlier data while maintaining the stream's integrity. Options A, B, and C do not specifically address the requirement of filtering out erroneous data without disrupting the streaming process.