Exam CCAR-F Topic 1 Question 53 Discussion
Actual exam question for Anthropic's CCAR-F exam
Question #: 53
Topic #: 1
Question #: 53
Topic #: 1
You are building a customer support resolution agent using the Claude Agent SDK. The agent handles high- ambiguity requests like returns, billing disputes, and account issues. It has access to your backend systems through custom Model Context Protocol (MCP) tools ( get_customer , lookup_order , process_refund , escalate_to_human ). Your target is 80%+ first-contact resolution while knowing when to escalate.
During testing, you find that when a customer says "I need a refund for my recent purchase," the agent calls process_refund immediately-but populates the required order_id parameter with a plausible-looking but fabricated value instead of first calling lookup_order to retrieve the actual order ID. The refund call fails because the fabricated ID doesn't exist.
Which change directly addresses the root cause of the agent fabricating the order_id value?
During testing, you find that when a customer says "I need a refund for my recent purchase," the agent calls process_refund immediately-but populates the required order_id parameter with a plausible-looking but fabricated value instead of first calling lookup_order to retrieve the actual order ID. The refund call fails because the fabricated ID doesn't exist.
Which change directly addresses the root cause of the agent fabricating the order_id value?
Suggested Answer: A Vote an answer
The root cause is an incomplete tool contract. Claude sees that process_refund requires an order_id , but the tool description does not explain the parameter's trusted source or the prerequisite lookup sequence. Option A makes the dependency explicit and prohibits fabricated values.
Anthropic states that tool descriptions should explain what a tool does, when it should be used, how it behaves, and any important limitations. Its prompting guidance also states that dependent tool calls must be executed sequentially and that Claude must never use placeholders or guess missing tool parameters. (
https://platform.claude.com/docs/en/agents-and-tools/tool-use/define-tools ) Option B merely forces some tool use; it does not force the correct tool or prevent a fabricated identifier.
Option C is an essential defense-in-depth control, but it detects the invalid ID after the model has already made the faulty call. It does not correct the selection logic that caused the fabrication. Option D works only when the customer actually provides an identifier and introduces an unnecessary preprocessing dependency.
The process_refund schema should describe order_id as a verified identifier returned by lookup_order , and the tool description should state that the tool is unavailable until the corresponding order has been retrieved and eligibility established.
Official references/topics: Tool descriptions, prerequisite tool calls, parameter provenance, sequential tool orchestration.
Anthropic states that tool descriptions should explain what a tool does, when it should be used, how it behaves, and any important limitations. Its prompting guidance also states that dependent tool calls must be executed sequentially and that Claude must never use placeholders or guess missing tool parameters. (
https://platform.claude.com/docs/en/agents-and-tools/tool-use/define-tools ) Option B merely forces some tool use; it does not force the correct tool or prevent a fabricated identifier.
Option C is an essential defense-in-depth control, but it detects the invalid ID after the model has already made the faulty call. It does not correct the selection logic that caused the fabrication. Option D works only when the customer actually provides an identifier and introduces an unnecessary preprocessing dependency.
The process_refund schema should describe order_id as a verified identifier returned by lookup_order , and the tool description should state that the tool is unavailable until the corresponding order has been retrieved and eligibility established.
Official references/topics: Tool descriptions, prerequisite tool calls, parameter provenance, sequential tool orchestration.
by Gene at Jul 29, 2026, 04:42 AM
0
0
0
10
Comments
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Report Comment
Commenting
You can sign-up / login (it's free).