Reward hacking occurs when a model earns a favorable training signal through a shortcut or evaluator weakness instead of accomplishing the intended task correctly.
What role does reinforcement learning play in developing AI reasoning abilities?
What is reward hacking in reasoning training?
The answer
More FAQs in What role does reinforcement learning play in developing AI reasoning abilities?
No. Models can develop useful problem-solving behavior through several routes, including pre-training, supervised examples, and external tools. Reinforcement learning is one possible contribution.
Some problems in these domains have answers that can be checked automatically. Those checks provide useful feedback, although incomplete tests and flawed verifiers remain possible.
Still have questions?
Browse all our FAQs or reach out to our support team
Want to upskill yourself?
Your learning library
Small steps. Big possibilities.
Find your next course. Build something great.