Join me on my ML Journey from novice to expert! with some nomadic meanderings along the way.

Machine Learning

Improving mathematical reasoning with process supervision

Improving mathematical reasoning with process supervision

We’ve trained a model to achieve a new state-of-the-art in mathematical problem solving by rewarding each correct step of reasoning (“process supervision”) instead of simply rewarding the correct final answer (“outcome supervision”). In addition to boosting performance relative to outcome supervision, process supervision also has an important alignment benefit: it directly trains the model to produce a chain-of-thought that is endorsed by humans.

Go to Source
Author:
https://openai.com/research/improving-mathematical-reasoning-with-process-supervision