AWS Certified AI Practitioner (AIF-C01) — Question 23

A company wants to build a generative AI application by using Amazon Bedrock and needs to choose a foundation model (FM). The company wants to know how much information can fit into one prompt.
Which consideration will inform the company's decision?

Answer options

• A. Temperature
• B. Context window
• C. Batch size
• D. Model size

Correct answer: B

Explanation

The context window is the key factor that determines the amount of information that can be processed in one prompt, as it defines the length of the input that the model can handle. Temperature affects the randomness of responses, batch size pertains to the number of prompts processed simultaneously, and model size refers to the complexity and capacity of the model, but none of these directly relate to prompt length.