Databricks Certified Data Engineer Professional — Question 159

Each configuration below is identical to the extent that each cluster has 400 GB total of RAM, 160 total cores and only one Executor per VM.

Given an extremely long-running job for which completion must be guaranteed, which cluster configuration will be able to guarantee completion of the job in light of one or more VM failures?

Answer options

• A. • Total VMs: 8 • 50 GB per Executor • 20 Cores / Executor
• B. • Total VMs: 16 • 25 GB per Executor • 10 Cores / Executor
• C. • Total VMs: 1 • 400 GB per Executor • 160 Cores/Executor
• D. • Total VMs: 4 • 100 GB per Executor • 40 Cores / Executor

Correct answer: B

Explanation

Option B is correct because having 16 VMs with 25 GB per Executor allows for redundancy and better handling of VM failures, ensuring that the job can continue running. In contrast, Option A has fewer VMs which increases the risk of failure impacting job completion, Option C has only one VM which is a single point of failure, and Option D, while having multiple VMs, does not provide as much redundancy as Option B.