Databricks Certified Generative AI Engineer Associate — Question 33

A Generative Al Engineer is tasked with developing an application that is based on an open source large language model (LLM). They need a foundation LLM with a large context window.
Which model fits this need?

Answer options

• A. DistilBERT
• B. MPT-30B
• C. Llama2-70B
• D. DBRX

Correct answer: D

Explanation

DBRX is designed to handle large context windows, making it suitable for applications that require extensive input processing. In contrast, DistilBERT and MPT-30B have limitations in context size, and Llama2-70B, while powerful, may not be open source or specifically optimized for large context windows as needed.