Databricks Certified Data Engineer Associate — Question 159

Which compute option should be chosen in a scenario where small-scale ad-hoc Python scripts need to be run at high frequency and should wind down quickly after these queries have finished running?

Answer options

• A. All-purpose Cluster
• B. Job Cluster
• C. Serverless Compute
• D. SQL Warehouse

Correct answer: B

Explanation

The correct choice is B, Job Cluster, as it is specifically designed for batch processing jobs like running scripts that need to execute quickly and then shut down. Options A and D are not suitable because they are intended for ongoing workloads rather than ad-hoc tasks. Option C, Serverless Compute, while flexible, may not provide the same optimized execution and termination for job-specific tasks as a Job Cluster does.