The answer
The maximum number of tokens the model can process in a single forward pass.
How the Transformer Architecture Changed AI Forever
What is the context window in Transformers?
More FAQs in How the Transformer Architecture Changed AI Forever
LSTMs must process words sequentially, one by one. Transformers process all words at once in parallel, leveraging GPU architectures.
A mechanism that scores how relevant other words in the input are to a target word, helping resolve pronoun references (e.g., what 'it' refers to).
GPT is a decoder-only model, optimized for generating text token by token.
Still have questions?
Browse all our FAQs or reach out to our support team
Want to upskill yourself?
Your learning library
Small steps. Big possibilities.
Find your next course. Build something great.