Databricks Certified Data Engineer Professional — Question 9

When scheduling Structured Streaming jobs for production, which configuration automatically recovers from query failures and keeps costs low?

Answer options

• A. Cluster: New Job Cluster; Retries: Unlimited; Maximum Concurrent Runs: Unlimited
• B. Cluster: New Job Cluster; Retries: None; Maximum Concurrent Runs: 1
• C. Cluster: Existing All-Purpose Cluster; Retries: Unlimited; Maximum Concurrent Runs: 1
• D. Cluster: New Job Cluster; Retries: Unlimited; Maximum Concurrent Runs: 1
• E. Cluster: Existing All-Purpose Cluster; Retries: None; Maximum Concurrent Runs: 1

Correct answer: D

Explanation

Option D is correct because it allows unlimited retries for query failures while using a new job cluster, ensuring smooth recovery and cost management. Options A and C may incur higher costs due to their configurations, while B and E do not provide the necessary retries needed for recovery.