Exam AI-103 Topic 1 Question 100 Discussion
Actual exam question for Microsoft's AI-103 exam
Question #: 100
Topic #: 1
Question #: 100
Topic #: 1
You have a Microsoft Foundry project that uses Azure AI Search to ground an agent in internal documentation.
After a recent content update, users report that the agent's answers have become less accurate.
You need to identify whether the retrieved content is negatively influencing the model's generated responses.
Which observability signal should you review?
After a recent content update, users report that the agent's answers have become less accurate.
You need to identify whether the retrieved content is negatively influencing the model's generated responses.
Which observability signal should you review?
Suggested Answer: D Vote an answer
The most interesting observability signal in this scenario is Retrieval Score vs. Response Quality (Groundedness Evaluation), specifically analyzing the Context Relevance metric alongside Retrieval Confidence Scores.
Because your LLM agent uses a Retrieval-Augmented Generation (RAG) pattern via Azure AI Search, a sudden drop in accuracy after a content update usually implies that the search index is either surface-matching bad keywords, or the ranking algorithm is pulling technically relevant but contextually wrong documents.
Reference:
https://blog.gopenai.com/how-to-prevent-context-loss-in-azure-ai-search-rag-pipelines-497c346c7077
Because your LLM agent uses a Retrieval-Augmented Generation (RAG) pattern via Azure AI Search, a sudden drop in accuracy after a content update usually implies that the search index is either surface-matching bad keywords, or the ranking algorithm is pulling technically relevant but contextually wrong documents.
Reference:
https://blog.gopenai.com/how-to-prevent-context-loss-in-azure-ai-search-rag-pipelines-497c346c7077
by Matthew at Jul 25, 2026, 08:50 AM
0
0
0
10
Comments
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Report Comment
Commenting
You can sign-up / login (it's free).