Exam 1z0-1122-23 Topic 1 Question 21 Discussion

Actual exam question for Oracle's 1z0-1122-23 exam
Question #: 21
Topic #: 1
What is the purpose of Attention Mechanism in Transformer architecture?

Suggested Answer: D Vote an answer

The attention mechanism in the Transformer architecture is a technique that allows the model to focus on the most relevant parts of the input and output sequences. It computes a weighted sum of the input or output embeddings, where the weights indicate how much each word contributes to the representation of the current word. The attention mechanism helps the model capture the long-range dependencies and the semantic relationships between words in a sequence12. Reference: The Transformer Attention Mechanism - MachineLearningMastery.com, Attention Mechanism in the Transformers Model - Baeldung

by Winfred at Dec 31, 2023, 12:17 AM

Limited Time Offer

15%

Off

Get Premium 1z0-1122-23 Questions as Interactive Self Test Engine or PDF

Comments

Chosen Answer:
This is a voting comment (?) , you can switch to a simple comment.
Switch to a voting comment New
Nick name: Submit Cancel
A voting comment increases the vote count for the chosen answer by one.

Upvoting a comment with a selected answer will also increase the vote count towards that answer by one. So if you see a comment that you already agree with, you can upvote it instead of posting a new comment.
0
0
0
10