Databricks Certified Generative AI Engineer Associate — Question 38

A small and cost-conscious startup in the cancer research field wants to build a RAG application using Foundation Model APIs.
Which strategy would allow the startup to build a good-quality RAG application while being cost-conscious and able to cater to customer needs?

Answer options

• A. Limit the number of relevant documents available for the RAG application to retrieve from
• B. Pick a smaller LLM that is domain-specific
• C. Limit the number of queries a customer can send per day
• D. Use the largest LLM possible because that gives the best performance for any general queries

Correct answer: B

Explanation

Choosing a smaller domain-specific LLM (option B) allows the startup to focus on relevant information, which can lead to better performance in their specific area of cancer research while keeping costs lower. In contrast, limiting the number of documents (option A) may hinder the application’s capabilities, while restricting queries (option C) could frustrate customers. Using the largest LLM (option D) may not be cost-effective or necessary for their specific needs.