Databricks Certified Data Engineer Professional — Question 176
A data engineer needs to capture pipeline settings from an existing setting in the workspace, and use them to create and version a JSON file to create a new pipeline.
Which command should the data engineer enter in a web terminal configured with the Databricks CLI?
Answer options
- A. Use list pipelines to get the specs for all pipelines; get the pipeline spec from the returned results; parse and use this to create a pipeline
- B. Stop the existing pipeline; use the returned settings in a reset command
- C. Use the get command to capture the settings for the existing pipeline; remove the pipeline_id and rename the pipeline; use this in a create command
- D. Use the clone command to create a copy of an existing pipeline; use the get JSON command to get the pipeline definition; save this to git
Correct answer: C
Explanation
The correct answer is C because it outlines the process of using the get command to capture the current pipeline's settings, which can then be modified and used to create a new pipeline. Option A is incorrect as it focuses on listing all pipelines instead of directly obtaining the necessary settings. Option B is wrong because stopping the pipeline does not help in capturing its settings for creating a new one. Option D suggests cloning the pipeline instead of directly obtaining the settings, which is not the most efficient approach for creating a new pipeline.