Computer scienceData scienceNLPLanguage representationTransformers

Attention Mechanisms in Transformers

Theory

Query, Key, and Value

Report a typo

Match attention mechanism components to their explanations.

Match the items from left and right columns
Query (Q)
Key (K)
Value (V)
contains the actual data that will be considered by the model in the end.
searches for information.
indicates what information is important.
___

Create a free account to access the full topic