Databricks Certified Associate Developer for Apache Spark — Question 45
Which of the following DataFrame operations is classified as a wide transformation?
Answer options
- A. DataFrame.filter()
- B. DataFrame.join()
- C. DataFrame.select()
- D. DataFrame.drop()
- E. DataFrame.union()
Correct answer: B
Explanation
The correct answer is B, DataFrame.join(), as it requires data from multiple partitions and thus qualifies as a wide transformation. In contrast, the other options are classified as narrow transformations since they do not involve shuffling data across partitions.