SnowPro Advanced: Architect — Question 184

An Architect is designing multiple data pipelines to ingest, transform, and consume data in Snowflake in support of a newly-developed application. While the development team has significant SQL expertise, most members lack experience with Python.

Which architecture design will meet these requirements using the LEAST amount of operational overhead?

Answer options

• A. Prioritize the use of external tables in the architecture to minimize the time required to ingest the data into Snowflake.
• B. Use streams, tasks, and stored procedures to set up the pipelines, and use templated patterns for the application of the MERGE logic.
• C. Use dynamic tables to build the Directed Acyclic Graphs (DAGs) using the CREATE DYNAMIC TABLE command for each node, and fine-tune the tables using custom DML.
• D. Use dynamic tables for the ingestion pipelines and use the TARGET LAG = DOWNSTREAM parameter for all but the final table in the Directed Acyclic Graphs (DAGs).

Correct answer: D

Explanation

Option D is the correct choice as it utilizes dynamic tables that simplify the ingestion process while managing operational overhead effectively. The TARGET LAG = DOWNSTREAM parameter allows for efficient data flow management without additional complexities. Options A, B, and C introduce either higher operational overhead or complexities that are not necessary given the team's SQL expertise.