NVIDIA Certified Associate – Generative AI and LLMs — Question 2

In the transformer architecture, what is the purpose of positional encoding?

Answer options

• A. To remove redundant information from the input sequence.
• B. To encode the semantic meaning of each token in the input sequence.
• C. To add information about the order of each token in the input sequence.
• D. To encode the importance of each token in the input sequence.

Correct answer: C

Explanation

The correct answer is C because positional encoding is specifically designed to provide information about the relative positions of tokens within the sequence, which is crucial for the transformer model's ability to understand sequence order. Options A, B, and D do not accurately describe the function of positional encoding, as they focus on other aspects of the input rather than the positional context.