AWS Certified AI Practitioner (AIF-C01) — Question 109

A company wants to implement a large language model (LLM) based chatbot to provide customer service agents with real-time contextual responses to customers' inquiries. The company will use the company's policies as the knowledge base.

Which solution will meet these requirements MOST cost-effectively?

Answer options

• A. Retrain the LLM on the company policy data.
• B. Fine-tune the LLM on the company policy data.
• C. Implement Retrieval Augmented Generation (RAG) for in-context responses.
• D. Use pre-training and data augmentation on the company policy data.

Correct answer: C

Explanation

Implementing Retrieval Augmented Generation (RAG) allows the chatbot to provide responses based on real-time access to the knowledge base without the high costs associated with retraining or fine-tuning the LLM. Options A and B involve significant resource investments to modify the model, while D suggests an approach that may not be as efficient in real-time customer interactions.