Exam CCAR-F Topic 1 Question 116 Discussion

Actual exam question for Anthropic's CCAR-F exam
Question #: 116
Topic #: 1
You are building a structured data extraction system using Claude. The system extracts information from unstructured documents, validates the output using JSON schemas, and maintains high accuracy. It must handle edge cases gracefully and integrate with downstream systems.
Your invoice extraction uses tool use with strict JSON schemas. JSON syntax errors never occur, but 12% of extractions fail semantic validation-for example, line-item amounts do not sum to the extracted total, or vendor IDs do not match valid formats. These failures currently route to manual review.
What is the most effective approach to reduce manual-review volume while maintaining accuracy?

Suggested Answer: B Vote an answer

Option B creates a targeted correction loop using information the first extraction did not have: the validator's precise failure report. Anthropic's prompting guidance describes prompt chaining as appropriate when an application must inspect intermediate output or enforce a specific pipeline, with self-correction following the pattern generate, review against criteria, and refine. Here, deterministic validators identify arithmetic mismatches and invalid vendor-ID formats. Returning the source document, original extraction, and explicit errors lets Claude revise only the defective fields while preserving valid data. The corrected record must then be validated again before acceptance, with a bounded retry count and human-review fallback. Option A is unsafe because automatically recalculating a total may overwrite the amount actually printed on the invoice; a mismatch can originate in an OCR or line-item extraction error. Option C repeats the same extraction without explaining what failed, wasting calls and relying on chance. Option D may prevent some format violations, but JSON Schema cannot express every cross-field arithmetic relationship or external vendor-registry rule. A validator-guided second pass therefore reduces manual review without silently changing source facts, while keeping deterministic code-not the model-as the final acceptance authority.

by Armand at Sep 12, 2026, 12:00 AM

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

0
0
0
10