Exam CCAR-F Topic 1 Question 151 Discussion

Actual exam question for Anthropic's CCAR-F exam
Question #: 151
Topic #: 1
Your automated code review is missing genuine bugs in pull requests. Investigation reveals that the review prompt includes this instruction: "Only flag critical issues that would definitely cause production failures.
Ignore minor concerns and anything you are uncertain about." Developers confirm that some missed findings are genuine logic errors that the model investigated but chose not to report. The team requires the review output to remain structured, with every finding tagged with metadata, and actionable. Which prompt change both removes the cause of the suppressed findings and preserves structured, tagged output for downstream filtering?

Suggested Answer: B Vote an answer

The prompt explicitly instructs Claude to suppress uncertain and lower-severity findings. Increasing reasoning depth cannot override that reporting policy: Claude may identify a real defect during analysis and still omit it from the final response. Option B separates comprehensive detection from acceptance filtering, removing the source of the false negatives while retaining metadata needed for automated decisions.
Anthropic's current code-review prompting guidance recommends reporting every issue, including uncertain or lower-severity candidates, and attaching confidence and estimated severity so a separate verification or filtering stage can rank them. A structured schema can additionally require fields such as file path, line number, category, confidence, severity, evidence, and recommended action.
Option A may improve investigation quality but leaves the suppression instruction intact. Option C removes the problematic threshold but also discards the explicit structured classification needed by downstream processing. Option D repeats the same review policy, so the second pass can suppress the same findings as the first. Option B preserves recall and machine-readable output while allowing deterministic, adjustable downstream thresholds. This is more reliable than embedding an overly restrictive acceptance decision inside the model's initial detection task.

by Joseph at Aug 03, 2026, 10:57 PM

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

0
0
0
10