Databricks Certified Data Engineer Associate — Question 155

A data engineer is developing a small proof of concept in a notebook. When running the entire notebook, the Cluster usage spikes. The data engineer wants to keep the development requirements and get real-time results.

Which Cluster meets these requirements?

Answer options

• A. All Purpose Cluster with autoscaling
• B. Job Cluster with Photon enabled and autoscaling
• C. Job Cluster with autoscaling enabled
• D. All-Purpose Cluster with a large fixed memory size

Correct answer: A

Explanation

The All Purpose Cluster with autoscaling is ideal for development work, as it allows for flexible resource allocation based on the workload, which is necessary for real-time results. The Job Cluster options are more suited for batch processing and may not provide the immediate responsiveness needed during development. The large fixed memory size option doesn't allow for scalability, which is a drawback for maintaining development efficiency.