Databricks Certified Associate Developer for Apache Spark — Question 208
A data engineer needs to control the size of micro-batches when running with the option of Available-now micro-batch.
Which trigger should the engineer use?
Answer options
- A. maxExecutorsPerTrigger
- B. maxCoresPerTrigger
- C. maxBytesPerTrigger
- D. maxFilesPerTrigger
Correct answer: C
Explanation
The correct answer is C, maxBytesPerTrigger, as it directly controls the amount of data processed in each micro-batch. Options A and B, maxExecutorsPerTrigger and maxCoresPerTrigger, relate to resource allocation rather than data size. Option D, maxFilesPerTrigger, limits the number of files processed but does not address the size of the data in bytes.