AWS Certified AI Practitioner (AIF-C01) — Question 159

Which option is a characteristic of transformer-based language models?

Answer options

• A. Transformer-based language models use convolutional layers to apply filters across an input to capture local patterns through filtered views.
• B. Transformer-based language models can process only text data.
• C. Transformer-based language models use self-attention mechanisms to capture contextual relationships.
• D. Transformer-based language models process data sequences one element at a time in cyclic iterations.

Correct answer: C

Explanation

The correct answer is C because transformer-based models indeed utilize self-attention mechanisms, allowing them to capture complex contextual relationships in data. Option A is incorrect as these models do not rely on convolutional layers, while option B is misleading, as they can handle various types of data, not just text. Option D is also wrong because transformers process data in parallel, rather than one element at a time.