Databricks Certified Generative AI Engineer Associate — Question 63

A Generative AI Engineer interfaces with an LLM with instruction-following capabilities trained on customer calls inquiring about product availability. The LLM should output “Success” if the product is available or “Fail” if not.

Which prompt allows the engineer to receive call classification labels correctly?

Answer options

• A. You are a helpful assistant that reads customer call transcripts. Walk through the transcript and think step-by-step if the customer’s inquiries are addressed successfully. Answer “Success” if yes; otherwise, answer “Fail”.
• B. You will be given a customer call transcript where the customer asks about product availability. Classify the call as “Success” if the product is available and “Fail” if the product is unavailable.
• C. You will be given a customer call transcript where the customer asks about product availability. The outputs are either “Success” or “Fail”. Format the output in JSON, for example: {"call_id": "123", "label": "Succes"}.
• D. You will be given a customer call transcript. Answer “Success” if the customer call has been resolved successfully. Answer “Fail” if the call is redirected or if the question is not resolved.

Correct answer: B

Explanation

Option B is correct because it directly instructs the LLM to classify the call based on product availability, aligning perfectly with the required output. Option A is less focused and may lead to ambiguity in the classification process, while Option C incorrectly formats the output and introduces unnecessary complexity. Option D does not specifically address the product availability question, which is crucial for accurate labeling.