Exam AB-100 Topic 2 Question 75 Discussion
Actual exam question for Microsoft's AB-100 exam
Question #: 75
Topic #: 2
Question #: 75
Topic #: 2
A company uses a Microsoft Copilot Studio agent to automate tasks in a web app.
During testing, you discover that the automation sometimes fails because of frequent changes to the app's user interface.
You need to recommend a solution to ensure that the agent successfully automates the tasks.
The solution must minimize changes to the agent.
What should you include in the recommendation?
During testing, you discover that the automation sometimes fails because of frequent changes to the app's user interface.
You need to recommend a solution to ensure that the agent successfully automates the tasks.
The solution must minimize changes to the agent.
What should you include in the recommendation?
Suggested Answer: A Vote an answer
The Computer Use tool in Microsoft Copilot Studio is specifically designed to remedy automation failures caused by UI changes with minimal manual intervention.
Unlike traditional Robotic Process Automation (RPA), which relies on rigid selectors or fixed coordinates that break when a layout shifts, Computer Use is powered by Computer-Using Agents (CUA). This AI model combines computer vision with advanced reasoning to "see" the screen like a human, allowing it to adapt to interface changes in real-time.
Why Computer Use Fixes UI Fragility
Visual Reasoning: Instead of looking for a specific HTML tag that might change, the agent looks for the visual concept of a button (e.g., "Submit" or a "plus icon").
Real-Time Adaptation: If a button moves from the left side of the screen to the right, the agent simply scans the screen and finds its new location without requiring you to update any code or scripts.
Natural Language Instructions: You describe the task in plain English (e.g., "Log into the portal and download the latest invoice"). If the portal changes its navigation menu, the AI reasons through the new layout to find the invoice link.
Self-Healing Properties: Because the agent makes decisions at each step based on the current visual state, it effectively "self-heals" during execution, overcoming obstacles that would typically crash a legacy bot.
Reference:
https://www.microsoft.com/en-us/microsoft-copilot/blog/copilot-studio/announcing-computer-use-microsoft-copilot-studio-ui-automation
Unlike traditional Robotic Process Automation (RPA), which relies on rigid selectors or fixed coordinates that break when a layout shifts, Computer Use is powered by Computer-Using Agents (CUA). This AI model combines computer vision with advanced reasoning to "see" the screen like a human, allowing it to adapt to interface changes in real-time.
Why Computer Use Fixes UI Fragility
Visual Reasoning: Instead of looking for a specific HTML tag that might change, the agent looks for the visual concept of a button (e.g., "Submit" or a "plus icon").
Real-Time Adaptation: If a button moves from the left side of the screen to the right, the agent simply scans the screen and finds its new location without requiring you to update any code or scripts.
Natural Language Instructions: You describe the task in plain English (e.g., "Log into the portal and download the latest invoice"). If the portal changes its navigation menu, the AI reasons through the new layout to find the invoice link.
Self-Healing Properties: Because the agent makes decisions at each step based on the current visual state, it effectively "self-heals" during execution, overcoming obstacles that would typically crash a legacy bot.
Reference:
https://www.microsoft.com/en-us/microsoft-copilot/blog/copilot-studio/announcing-computer-use-microsoft-copilot-studio-ui-automation
by Reuben at Aug 01, 2026, 11:39 PM
0
0
0
10
Comments
Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
Report Comment
Commenting
You can sign-up / login (it's free).