AWS Certified Machine Learning Engineer – Associate (MLA-C01) — Question 32

A company has a conversational AI assistant that sends requests through Amazon Bedrock to an Anthropic Claude large language model (LLM). Users report that when they ask similar questions multiple times, they sometimes receive different answers. An ML engineer needs to improve the responses to be more consistent and less random.
Which solution will meet these requirements?

Answer options

• A. Increase the temperature parameter and the top_k parameter.
• B. Increase the temperature parameter. Decrease the top_k parameter.
• C. Decrease the temperature parameter. Increase the top_k parameter.
• D. Decrease the temperature parameter and the top_k parameter.

Correct answer: D

Explanation

Decreasing the temperature parameter reduces randomness in the model's output, leading to more consistent responses, while lowering the top_k parameter limits the number of potential responses, further enhancing stability. The other options either increase randomness or do not effectively reduce it, resulting in less consistent answers.