OrionStar-Yi-34B-Chat-Llama Open-source Dialogue Model - Trained on a Massive Corpus for Exceptional Interaction Experience

Orionstar Yi 34B Chat Llama

Developed by OrionStarAI

An open-source dialogue model fine-tuned based on the Yi-34B model, trained on 15 million high-quality corpus entries, delivering exceptional interactive experiences.

Large Language Model

Transformers

Open Source License:Apache-2.0 #High-precision Chinese dialogue #Multi-domain knowledge Q&A #Academic research optimization

Downloads 95

Release Time : 11/21/2023

Model Overview

Developed by OrionStar AI, OrionStar-Yi-34B-Chat is a dialogue model fine-tuned from the Yi-34B model, aiming to be an excellent open-source alternative in the ChatGPT domain.

Model Features

High-quality fine-tuning

Precisely fine-tuned on over 15 million high-quality corpus entries to enhance dialogue experiences.

Open-source alternative

Aims to be an excellent open-source alternative in the ChatGPT domain, fully open for academic research use.

Multilingual support

Excels in both Chinese and English, suitable for multilingual interaction scenarios.

Model Capabilities

Text generation

Multi-turn dialogue

Chinese comprehension

English comprehension

Use Cases

Dialogue systems

Intelligent customer service

Used to build intelligent customer service systems, providing natural and smooth dialogue experiences.

Personal assistant

Can serve as a personal assistant, helping users with daily Q&A and tasks.

Academic research

Natural language processing research

Suitable for research and experiments in the field of natural language processing.

🚀 OrionStar-Yi-34B-Chat-Llama

This model aims to provide an excellent interactive experience for users in the large model community by fine - tuning on a high - quality corpus.

🚀 Quick Start

You can access the model at OrionStarAI/OrionStar-Yi-34B-Chat-Llama.

✨ Features

OrionStar-Yi-34B-Chat from OrionStarAI is based on the open - source Yi-34B model, fine - tuned on a high - quality corpus of over 15 million sentences. It aims to offer an outstanding interactive experience for users in the large model community.
The Yi series models, open - sourced by the 01 - ai team, have shown remarkable performance on various benchmarks in Chinese, English, and general domains. OrionStar-Yi-34B-Chat further explores the potential of Yi-34B. Through extensive fine - tuning on a large and high - quality corpus, it performs exceptionally well on evaluation data, striving to be an excellent open - source alternative in the ChatGPT domain.
The fine - tuned model is completely open for academic research, but please comply with the agreement and the Yi License.

📚 Documentation

Model Evaluation Results

We use opencompass to perform 5 - shot testing on the following general domain datasets. The evaluation results of other models are taken from opencompass leaderboard.

Property	Details
Model Type	OrionStar-Yi-34B-Chat-Llama, identical to OrionStarAI/OrionStar-Yi-34B with tensors renamed to follow the LLaMA format for automatic evaluation on the HF leaderboard
Evaluation Datasets	C - Eval, MMLU, CMMLU

	C - Eval	MMLU	CMMLU
GPT - 4	69.9	83	71
ChatGPT	52.5	69.1	53.9
Claude - 1	52	65.7	-
TigerBot - 70B - Chat - V2	57.7	65.9	59.9
WeMix - LLaMA2 - 70B	55.2	71.3	56
LLaMA - 2 - 70B - Chat	44.3	63.8	43.3
Qwen - 14B - Chat	71.7	66.4	70
Baichuan2 - 13B - Chat	56.7	57	58.4
OrionStar - Yi - 34B - Chat	77.71	78.32	73.52

📄 License

The model is under the Apache - 2.0 license. And for academic research, please adhere to the agreement and the Yi License.

💡 Usage Tip

You can join our Discord community via this link: https://discord.gg/zumjDWgdAs to discuss and get more information about the model.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご