Databricks Certified Data Engineer Professional — Question 101

Each configuration below is identical to the extent that each cluster has 400 GB total of RAM 160 total cores and only one Executor per VM.

Given an extremely long-running job for which completion must be guaranteed, which cluster configuration will be able to guarantee completion of the job in light of one or more VM failures?

Answer options

• A. • Total VMs: 8 • 50 GB per Executor • 20 Cores / Executor
• B. • Total VMs: 16 • 25 GB per Executor • 10 Cores / Executor
• C. • Total VMs: 1 • 400 GB per Executor • 160 Cores/Executor
• D. • Total VMs: 4 • 100 GB per Executor • 40 Cores / Executor
• E. • Total VMs: 2 • 200 GB per Executor • 80 Cores / Executor

Correct answer: B

Explanation

Option B is the correct choice because it has the highest number of VMs, which allows for redundancy; if one VM fails, others can continue processing the job. Options A, C, D, and E do not provide enough VMs to guarantee job completion in case of failures, with option C being particularly ineffective as it has only one VM, making it vulnerable to any failure.