Databricks Certified Data Engineer Professional — Question 180
When scheduling Structured Streaming jobs for production, which configuration automatically recovers from query failures and keeps costs low?
Answer options
- A. Cluster: New Job Cluster; Retries: Unlimited; Maximum Concurrent Runs: 1
- B. Cluster: New Job Cluster; Retries: Unlimited; Maximum Concurrent Runs: Unlimited
- C. Cluster: Existing All-Purpose Cluster; Retries: Unlimited; Maximum Concurrent Runs: 1
- D. Cluster: New Job Cluster; Retries: None; Maximum Concurrent Runs: 1
Correct answer: A
Explanation
Option A is correct because it uses a New Job Cluster with unlimited retries and restricts concurrent runs to 1, ensuring low costs and automatic recovery from query failures. Options B and C allow for higher concurrency, which could increase costs, while option D does not provide any retries, making it less reliable in the event of failures.