Exam CCAR-F Topic 1 Question 106 Discussion
Actual exam question for Anthropic's CCAR-F exam
Question #: 106
Topic #: 1
Question #: 106
Topic #: 1
You are integrating Claude Code into your Continuous Integration/Continuous Deployment (CI/CD) pipeline.
The system runs automated code reviews, generates test cases, and provides feedback on pull requests. You need to design prompts that provide actionable feedback and minimize false positives.
Your automated code review is missing genuine bugs in pull requests. Investigation reveals that your review prompt includes the instruction: "Only flag critical issues that would definitely cause production failures.
Ignore minor concerns and anything you are uncertain about." Developers confirm that some missed bugs are genuine logic errors that the model investigated but chose not to report. The team requires the review output to remain structured, with each finding tagged with metadata, and actionable.
Which prompt change both removes the cause of the suppressed findings and preserves structured, tagged output for downstream filtering?
The system runs automated code reviews, generates test cases, and provides feedback on pull requests. You need to design prompts that provide actionable feedback and minimize false positives.
Your automated code review is missing genuine bugs in pull requests. Investigation reveals that your review prompt includes the instruction: "Only flag critical issues that would definitely cause production failures.
Ignore minor concerns and anything you are uncertain about." Developers confirm that some missed bugs are genuine logic errors that the model investigated but chose not to report. The team requires the review output to remain structured, with each finding tagged with metadata, and actionable.
Which prompt change both removes the cause of the suppressed findings and preserves structured, tagged output for downstream filtering?
Suggested Answer: B Vote an answer
Option B removes the prompt-level suppression responsible for the false negatives while preserving machine- readable metadata. Anthropic's current code-review prompting guidance warns that instructions such as "only report high-severity issues" or "be conservative" may be followed literally: Claude can identify genuine defects during analysis but omit them from its output. Anthropic recommends requesting all findings and applying filtering separately.
Confidence and severity fields allow downstream code to apply adjustable thresholds without forcing the model to discard evidence during generation. A schema can require fields such as file, line, description, severity, confidence, evidence, and recommended action; Anthropic's Structured Outputs documentation supports enforcing such a response contract. Option A repeats the same suppressive instruction and is likely to reproduce the same omissions. Option C removes the explicit reporting structure and leaves filtering behavior undefined. Option D may improve analysis depth, but extended reasoning does not override a direct instruction to suppress uncertain findings. Separating detection from deterministic filtering preserves recall, structure, and operational control.
Confidence and severity fields allow downstream code to apply adjustable thresholds without forcing the model to discard evidence during generation. A schema can require fields such as file, line, description, severity, confidence, evidence, and recommended action; Anthropic's Structured Outputs documentation supports enforcing such a response contract. Option A repeats the same suppressive instruction and is likely to reproduce the same omissions. Option C removes the explicit reporting structure and leaves filtering behavior undefined. Option D may improve analysis depth, but extended reasoning does not override a direct instruction to suppress uncertain findings. Separating detection from deterministic filtering preserves recall, structure, and operational control.
by Jason at Aug 11, 2026, 09:10 AM
0
0
0
10
Comments
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Report Comment
Commenting
You can sign-up / login (it's free).