Databricks Certified Generative AI Engineer Associate — Question 83
An AI developer team wants to fine tune an open-weight model to have exceptional performance on a code generation use case. They are trying to choose the best model to start with. They want to minimize model hosting costs, and are using Huggingface model cards and spaces to explore models.
Which TWO model attributes and metrics should the team focus on to make their selection? (Choose two.)
Answer options
- A. Big Code Models Leaderboard
- B. Number of model parameters
- C. MTEB Leaderboard
- D. Chatbot Arena Leaderboard
- E. Number of model downloads last month
Correct answer: A, B
Explanation
The correct answers are A and B because the Big Code Models Leaderboard provides insight into model performance specifically for code generation, while the Number of model parameters helps assess the model's complexity and potential hosting costs. The other options, while informative, do not directly relate to optimizing for code generation or cost efficiency.