Exam CCAO-F Topic 1 Question 24 Discussion

Actual exam question for Anthropic's CCAO-F exam
Question #: 24
Topic #: 1
A knowledge worker has noticed that the same prompt for a recurring weekly task produces inconsistent outputs across runs. Some weeks the output uses the right sections but the wrong tone; other weeks the tone is right but a section is missing. The source inputs change each week but follow the same structure.
Which cause is most worth investigating first?

Suggested Answer: A Vote an answer

Answer A is correct. The pattern shows inconsistent compliance with requirements that should have been stated explicitly: the audience, tone, output structure, and mandatory sections. If those requirements are vague or implied, Claude may emphasize different aspects of the request across runs, especially as the weekly source content changes. The first troubleshooting step should therefore be to inspect the prompt and convert each expectation into a clear, testable instruction.
Option B is incomplete. Model outputs can vary, but non-determinism should not be used to excuse recurring failures to satisfy defined requirements. Strong prompts and evaluation criteria can substantially reduce unacceptable variation. Option C is less likely because the weekly inputs follow the same structure; changing facts alone should not cause required sections or tone instructions to disappear. Option D adds unnecessary workflow complexity. Claude can follow tone and structural requirements within one prompt when those requirements are clearly separated and explicitly defined.
The prompt should identify the intended audience, prescribe the tone, list every required section, specify the output format, and state that no section may be omitted. Anthropic recommends clear, direct instructions and precise output constraints, particularly when order or completeness matters. Anthropic prompting best practices

by Blake at Oct 14, 2026, 04:04 AM

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

0
0
0
10