đ WestSeverus - 7B - DPO - v2
WestSeverus-7B-DPO-v2 is a high - performance model based on the WestLake Family, trained on multiple DPO datasets, capable of excelling in basic math problems and applicable in various fields such as mathematics, chemistry, physics, and coding.
đ Quick Start
This README provides a comprehensive introduction to WestSeverus-7B-DPO-v2, including its model description, benchmark results, prompt format, quantized models, and gratitude. You can quickly navigate to the information you need through the table of contents below.
đ Table of Contents
- Nous Benchmark Results
- AGIEval
- GPT4All
- TruthfulQA Scores
- BigBench
- Open LLM Leaderboard
- ARC
- HellaSwag
- MMLU
- TruthfulQA
- Winogrande
- GSM8K
- EvalPlus Leaderboard
- HumanEval
- HumanEval_Plus
- MBPP
- MBPP_Plus
- Prompt Format
- Quantized Models
- Gratitude
⨠Features
âī¸ Model Description
WestSeverus-7B-DPO-v2 is a WestLake Family model trained over WestSeverus-7B. The model was trained on several dpo datasets and it can perform well on basic math problem. WestSeverus-7B-DPO-v2 can be used in mathematics, chemical, physics and even coding for further research and reference.

đ Documentation
đĒ Nous Benchmark Results
WestSeverus-7B-DPO-v2 is currently on the top of the YALL - Yet Another LLM Leaderboard created by CultriX and it outperforms on TruthfulQA Scores and BigBench.
đ Open LLM Leaderboard
WestSeverus-7B-DPO-v2 is one of the top 7B model in Open LLM Leaderboard and it outperforms on TruthfulQA and GSM8K.
Metric |
Value |
Avg. |
75.29 |
AI2 Reasoning Challenge (25-Shot) |
71.42 |
HellaSwag (10-Shot) |
88.27 |
MMLU (5-Shot) |
64.79 |
TruthfulQA (0-shot) |
72.37 |
Winogrande (5-shot) |
83.27 |
GSM8k (5-shot) |
71.65 |
Detailed results can be found here
⥠EvalPlus Leaderboard
Model |
HumanEval |
HumanEval_Plus |
MBPP |
MBPP_Plus |
phi-2-2.7B |
48.2 |
43.3 |
61.9 |
51.4 |
WestSeverus-7B-DPO-v2 |
43.3 |
34.1 |
TBD |
TBD |
SOLAR-10.7B-Instruct-v1.0 |
42.1 |
34.3 |
42.9 |
34.6 |
CodeLlama-7B |
37.8 |
34.1 |
57.6 |
45.4 |

âī¸ Prompt Format
WestSeverus-7B-DPO-v2 was trained using the ChatML prompt templates with system prompts. An example follows below:
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
đ ī¸ Quantized Models
Another version of WestSeverus Model:
- PetroGPT/WestSeverus-7B-DPO
- GGUF: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-GGUF
- GGUF: https://huggingface.co/s3nh/WestSeverus-7B-DPO-GGUF
- GPTQ: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-GPTQ
- AWQ: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-AWQ
MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF
- GGUF: https://huggingface.co/MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF
đ Gratitude
- Thanks to @senseable for senseable/WestLake-7B-v2.
- Thanks to @jondurbin for jondurbin/truthy-dpo-v0.1 dataset.
- Thanks to @Charles Goddard for MergeKit.
- Thanks to @TheBloke, @s3nh, @MaziyarPanahi for Quantized Models.
- Thanks to @mlabonne, @CultriX for YALL - Yet Another LLM Leaderboard.
- Thank you to all the other people in the Open Source AI community who utilized this model for further research and improvement.
đ License
This project is licensed under the Apache-2.0 license.