Can punctuation be the next predicted token?
Yes. The output vocabulary can contain punctuation, whitespace-related pieces, word fragments, and special markers in addition to complete words, so any permitted item may be selected.
Explore This Question
Search for additional explanations using these tools:
More FAQs in How does a neural network help an LLM predict the next token?
A standard autoregressive language model produces next-token scores repeatedly. Some decoding methods explore alternatives, but the basic prediction is conditioned on the sequence available at each step.
No. It is a probability for a continuation under the model and decoding setup. That quantity is different from a calibrated assessment of factual correctness.
Still have questions?
Browse all our FAQs or reach out to our support team