Math Shepherd Mistral 7b Rl

🚀 Mistral-7b-MetaMATH

このプロジェクトは、Math-Shepherdにおいて段階的なPPO（Proximal Policy Optimization）を用いたMistral-7b-MetaMATHを提供します。

🚀 クイックスタート

ベースモデル

• mistral-7b-sft

PRM

• math-shepherd-mistral-7b-prm

PPO学習セット

MetaMATH [1] の質問を使用しています。

Pass@1

• GSM8K: 84.1
• MATH: 33.0

入力形式

数学の問題のみを入力し、システムプロンプトは不要です。例えば：

Janet\u2019s ducks lay 16 eggs per day. She eats three for breakfast every morning and bakes muffins for her friends every day with four. She sells the remainder at the farmers' market daily for $2 per fresh duck egg. How much in dollars does she make every day at the farmers' market?

出力形式

特別なステップタグ ки を付けた段階的な解決策を出力します。例えば：

Step 1: Janet's ducks lay 16 eggs per day. ки\nStep 2: She eats three for breakfast every morning, so she has 16 - 3 = 13 eggs left. ки\nStep 3: She bakes muffins for her friends every day with four eggs, so she has 13 - 4 = 9 eggs left. ки\nStep 4: She sells the remainder at the farmers' market daily for $2 per fresh duck egg, so she makes 9 * $2 = $18 every day at the farmers' market. The answer is: 18 ки

引用文献

[1] MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models.