AWS Certified AI Practitioner (AIF-C01) — Question 75

A company wants to assess the costs that are associated with using a large language model (LLM) to generate inferences. The company wants to use Amazon Bedrock to build generative AI applications.
Which factor will drive the inference costs?

Answer options

• A. Number of tokens consumed
• B. Temperature value
• C. Amount of data used to train the LLM
• D. Total training time

Correct answer: A

Explanation

The correct answer is A, as the inference costs are primarily driven by the number of tokens consumed during the process. Options B, C, and D are not directly related to inference costs; temperature affects response randomness, data used for training impacts model performance, and training time pertains to the model's development rather than inference.