AWS Certified AI Practitioner (AIF-C01) — Question 48

A company wants to use a large language model (LLM) on Amazon Bedrock for sentiment analysis. The company needs the LLM to produce more consistent responses to the same input prompt.
Which adjustment to an inference parameter should the company make to meet these requirements?

Answer options

• A. Decrease the temperature value.
• B. Increase the temperature value.
• C. Decrease the length of output tokens.
• D. Increase the maximum generation length.

Correct answer: A

Explanation

Lowering the temperature value will make the model's responses more deterministic and consistent, which is ideal for sentiment analysis. In contrast, increasing the temperature value would introduce more randomness, leading to varied outputs. Adjusting the length of output tokens or the maximum generation length does not directly influence the consistency of the responses to the same prompt.