Do parameters change when a prompt is longer?
The prompt changes the model's temporary activations and context. In ordinary inference, it does not change the learned parameter values stored in the model.
Explore This Question
Search for additional explanations using these tools:
More FAQs in What are parameters in a large language model?
No. Tokens are units of input or generated content. Parameters are learned numerical values that the model uses to process tokens and compute predictions.
No. A smaller model with better data, training, or task adaptation can outperform a larger model on a particular workload or evaluation.
Still have questions?
Browse all our FAQs or reach out to our support team