Databricks Certified Data Engineer Associate — Question 130

A data engineer is writing a script that is meant to ingest new data from cloud storage. In the event of the Schema change, the ingestion should fail. It should fail until the changes downstream source can be found and verified as intended changes.

Which command will meet the requirements?

Answer options

• A. failOnNewColumns
• B. none
• C. rescue
• D. addNewColumns

Correct answer: A

Explanation

The correct answer, 'failOnNewColumns', ensures that the ingestion process is halted if there are any new columns detected in the Schema, thus meeting the requirement of failing until the changes are verified. The other options do not provide the necessary functionality to handle Schema changes in the specified manner.