Westseverus 7B DPO V2

🚀 WestSeverus - 7B - DPO - v2

WestSeverus-7B-DPO-v2 is a high - performance model based on the WestLake Family, trained on multiple DPO datasets, capable of excelling in basic math problems and applicable in various fields such as mathematics, chemistry, physics, and coding.

🚀 Quick Start

This README provides a comprehensive introduction to WestSeverus-7B-DPO-v2, including its model description, benchmark results, prompt format, quantized models, and gratitude. You can quickly navigate to the information you need through the table of contents below.

📖 Table of Contents

1. Nous Benchmark Results
   • AGIEval
   • GPT4All
   • TruthfulQA Scores
   • BigBench
2. Open LLM Leaderboard
   • ARC
   • HellaSwag
   • MMLU
   • TruthfulQA
   • Winogrande
   • GSM8K
3. EvalPlus Leaderboard
   • HumanEval
   • HumanEval_Plus
   • MBPP
   • MBPP_Plus
4. Prompt Format
5. Quantized Models
6. Gratitude

✨ Features

☘️ Model Description

WestSeverus-7B-DPO-v2 is a WestLake Family model trained over WestSeverus-7B. The model was trained on several dpo datasets and it can perform well on basic math problem. WestSeverus-7B-DPO-v2 can be used in mathematics, chemical, physics and even coding for further research and reference.

📚 Documentation

🪄 Nous Benchmark Results

WestSeverus-7B-DPO-v2 is currently on the top of the YALL - Yet Another LLM Leaderboard created by CultriX and it outperforms on TruthfulQA Scores and BigBench.

🏆 Open LLM Leaderboard

WestSeverus-7B-DPO-v2 is one of the top 7B model in Open LLM Leaderboard and it outperforms on TruthfulQA and GSM8K.

Detailed results can be found here

⚡ EvalPlus Leaderboard

⚗️ Prompt Format

WestSeverus-7B-DPO-v2 was trained using the ChatML prompt templates with system prompts. An example follows below:

<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

🛠️ Quantized Models

Another version of WestSeverus Model:

• PetroGPT/WestSeverus-7B-DPO
• GGUF: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-GGUF
• GGUF: https://huggingface.co/s3nh/WestSeverus-7B-DPO-GGUF
• GPTQ: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-GPTQ
• AWQ: https://huggingface.co/TheBloke/WestSeverus-7B-DPO-AWQ

MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF

• GGUF: https://huggingface.co/MaziyarPanahi/WestSeverus-7B-DPO-v2-GGUF

🙏 Gratitude

• Thanks to @senseable for senseable/WestLake-7B-v2.
• Thanks to @jondurbin for jondurbin/truthy-dpo-v0.1 dataset.
• Thanks to @Charles Goddard for MergeKit.
• Thanks to @TheBloke, @s3nh, @MaziyarPanahi for Quantized Models.
• Thanks to @mlabonne, @CultriX for YALL - Yet Another LLM Leaderboard.
• Thank you to all the other people in the Open Source AI community who utilized this model for further research and improvement.

📄 License

This project is licensed under the Apache-2.0 license.