Exam NCP-AAI Topic 1 Question 69 Discussion

Actual exam question for NVIDIA's NCP-AAI exam
Question #: 69
Topic #: 1
You are tasked with comparing two agentic AI systems - System A and System B - both designed to generate marketing copy.
You've run identical prompts and have recorded the generated outputs.
To objectively assess which system is performing better, what is the most appropriate approach?

Suggested Answer: C Vote an answer

The rejected options are weaker because averages, anecdotal reviews, and final-answer-only scoring miss coordination errors, hidden retries, stale tools, and user-visible quality regressions. A benchmark pipeline gives consistent scoring criteria across the two systems. CTR is downstream marketing noise; single-user preference is not objective. Option C fits the operating model because the problem describes an agent that must remain adaptive under changing inputs and infrastructure conditions. The selected option specifically C states "Implement a benchmark pipeline that automatically compares the generated outputs using metrics like relevance, creativity, and grammatical correctness.", which matches the operational requirement rather than a superficial wording match. This lines up with NVIDIA guidance because proper maintenance compares agent versions with stable inputs and preserved traces so teams can detect regressions before rollout. The durable control mechanism is observability that captures decision paths, failed calls, queueing delay, and quality regressions under realistic load. For certification purposes, read the question as asking for controlled autonomy, not raw LLM creativity.

by Simon at May 07, 2026, 09:48 AM

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.

0
0
0
10