%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
EN
Yi 34B Chat
Yi-34B-Chat is a bilingual-optimized large language model developed by 01.AI, excelling in language understanding, commonsense reasoning, and reading comprehension, supporting both Chinese and English interactions.
Downloads 5,784
Release Time : 11/22/2023
Model Overview
Yi-34B-Chat is a powerful bilingual dialogue model, trained on over 3T multilingual corpora, specifically designed for natural language interaction tasks.
Model Features
Bilingual Optimization
Specially optimized for Chinese and English, excelling in both languages.
Strong Performance
Ranked second on the AlpacaEval leaderboard, just behind GPT-4 Turbo.
Long Context Support
Supports a long context window of 200K tokens.
Model Capabilities
Natural Language Understanding
Text Generation
Dialogue Interaction
Commonsense Reasoning
Reading Comprehension
Use Cases
Intelligent Assistants
Customer Service Bot
Handles customer inquiries and problem-solving.
Provides accurate and fluent conversational experiences.
Content Creation
Story Generation
Generates coherent storylines based on prompts.
Produces creative and logically structured text content.
đ Yi - Building the Next Generation of Open - Source and Bilingual LLMs
The Yi series of models is a next - generation open - source large language model developed from scratch. It offers high - performance in both English and Chinese across various benchmarks, and comes in different sizes to meet diverse user needs.
đ Quick Start
Choose your path
You can start using Yi models through different methods, such as pip, docker, llama.cpp, conda - lock, or the web demo.
Quick start - pip
(Details about pip installation should be provided here if available in the original content)
Quick start - docker
(Details about docker installation should be provided here if available in the original content)
Quick start - llama.cpp
(Details about llama.cpp usage should be provided here if available in the original content)
Quick start - conda - lock
(Details about conda - lock usage should be provided here if available in the original content)
Web demo
You can try some of the models interactively at:
⨠Features
Introduction
- đ¤ The Yi series models are the next generation of open - source large language models trained from scratch by 01.AI.
- đ Targeted as a bilingual language model and trained on 3T multilingual corpus, the Yi series models become one of the strongest LLM worldwide, showing promise in language understanding, commonsense reasoning, reading comprehension, and more. For example:
- The Yi - 34B - Chat model landed in second place (following GPT - 4 Turbo), outperforming other LLMs (such as GPT - 4, Mixtral, Claude) on the AlpacaEval Leaderboard (based on data available up to January 2024).
- The Yi - 34B model ranked first among all existing open - source models (such as Falcon - 180B, Llama - 70B, Claude) in both English and Chinese on various benchmarks, including Hugging Face Open LLM Leaderboard (pre - trained) and C - Eval (based on data available up to November 2023).
- đ (Credits to Llama) Thanks to the Transformer and Llama open - source communities, as they reduce the efforts required to build from scratch and enable the utilization of the same tools within the AI ecosystem.
If you're interested in Yi's adoption of Llama architecture and license usage policy, see Yi's relation with Llama. âŦī¸
- Both Yi and Llama are based on the Transformer structure, which has been the standard architecture for large language models since 2018.
- Grounded in the Transformer architecture, Llama has become a new cornerstone for the majority of state - of - the - art open - source models due to its excellent stability, reliable convergence, and robust compatibility. This positions Llama as the recognized foundational framework for models including Yi.
- Thanks to the Transformer and Llama architectures, other models can leverage their power, reducing the effort required to build from scratch and enabling the utilization of the same tools within their ecosystems.
- However, the Yi series models are NOT derivatives of Llama, as they do not use Llama's weights.
- As Llama's structure is employed by the majority of open - source models, the key factors of determining model performance are training datasets, training pipelines, and training infrastructure.
- Developing in a unique and proprietary way, Yi has independently created its own high - quality training datasets, efficient training pipelines, and robust training infrastructure entirely from the ground up. This effort has led to excellent performance with Yi series models ranking just behind GPT4 and surpassing Llama on the [Alpaca Leaderboard in Dec 2023](https://tatsu - lab.github.io/alpaca_eval/).
đĄ TL;DR
The Yi series models adopt the same model architecture as Llama but are NOT derivatives of Llama.
News
đĨ 2024 - 07 - 29: The Yi Cookbook 1.0 is released, featuring tutorials and examples in both Chinese and English.
đ¯ 2024 - 05 - 13: The Yi - 1.5 series models are open - sourced, further improving coding, math, reasoning, and instruction - following abilities.
đ¯ 2024 - 03 - 16: The Yi - 9B - 200K is open - sourced and available to the public.
đ¯ 2024 - 03 - 08: Yi Tech Report is published!
đ 2024 - 03 - 07: The long text capability of the Yi - 34B - 200K has been enhanced.
In the "Needle - in - a - Haystack" test, the Yi - 34B - 200K's performance is improved by 10.5%, rising from 89.3% to an impressive 99.8%. We continue to pre - train the model on 5B tokens long - context data mixture and demonstrate a near - all - green performance.
đ¯ 2024 - 03 - 06: The Yi - 9B is open - sourced and available to the public.
Yi - 9B stands out as the top performer among a range of similar - sized open - source models (including Mistral - 7B, SOLAR - 10.7B, Gemma - 7B, DeepSeek - Coder - 7B - Base - v1.5 and more), particularly excelling in code, math, common - sense reasoning, and reading comprehension.
đ¯ 2024 - 01 - 23: The Yi - VL models, Yi - VL - 34B and Yi - VL - 6B, are open - sourced and available to the public.
Yi - VL - 34B has ranked first among all existing open - source models in the latest benchmarks, including MMMU and CMMMU (based on data available up to January 2024).
đ¯ 2023 - 11 - 23: Chat models are open - sourced and available to the public.
This release contains two chat models based on previously released base models, two 8 - bit models quantized by GPTQ, and two 4 - bit models quantized by AWQ.
Yi - 34B - ChatYi - 34B - Chat - 4bitsYi - 34B - Chat - 8bitsYi - 6B - ChatYi - 6B - Chat - 4bitsYi - 6B - Chat - 8bits
You can try some of them interactively at:
đ 2023 - 11 - 23: The Yi Series Models Community License Agreement is updated to v2.1.
đ¯ 2023 - 11 - 05: The base models, Yi - 6B - 200K and Yi - 34B - 200K, are open - sourced and available to the public.
This release contains two base models with the same parameter sizes as the previous release, except that the context window is extended to 200K.
đ¯ 2023 - 11 - 02: The base models, Yi - 6B and Yi - 34B, are open - sourced and available to the public.
The first public release contains two bilingual (English/Chinese) base models with the parameter sizes of 6B and 34B. Both of them are trained with 4K sequence length and can be extended to 32K during inference time.
Models
Yi models come in multiple sizes and cater to different use cases. You can also fine - tune Yi models to meet your specific requirements.
If you want to deploy Yi models, make sure you meet the software and hardware requirements.
Chat models
| Model | Download |
|---|---|
| Yi - 34B - Chat | âĸ đ¤ Hugging Face âĸ đ¤ ModelScope âĸ đŖ wisemodel |
| Yi - 34B - Chat - 4bits | âĸ đ¤ Hugging Face âĸ đ¤ ModelScope âĸ đŖ wisemodel |
| Yi - 34B - Chat - 8bits | âĸ đ¤ Hugging Face âĸ đ¤ ModelScope âĸ đŖ wisemodel |
| Yi - 6B - Chat | âĸ đ¤ Hugging Face âĸ đ¤ ModelScope âĸ đŖ wisemodel |
| Yi - 6B - Chat - 4bits | âĸ đ¤ Hugging Face âĸ đ¤ ModelScope âĸ đŖ wisemodel |
| Yi - 6B - Chat - 8bits | âĸ đ¤ Hugging Face âĸ đ¤ ModelScope âĸ đŖ wisemodel |
đ Documentation
How to use Yi?
- Fine - tuning: (Details about fine - tuning should be provided here if available in the original content)
- Quantization: (Details about quantization should be provided here if available in the original content)
- Deployment: (Details about deployment should be provided here if available in the original content)
- FAQ: (Details about frequently asked questions should be provided here if available in the original content)
- Learning hub: (Details about the learning hub should be provided here if available in the original content)
Why Yi?
Ecosystem
Upstream
(Details about the upstream ecosystem should be provided here if available in the original content)
Downstream
- Serving: (Details about serving should be provided here if available in the original content)
- Quantization: (Details about quantization in the downstream ecosystem should be provided here if available in the original content)
- Fine - tuning: (Details about fine - tuning in the downstream ecosystem should be provided here if available in the original content)
- API: (Details about the API should be provided here if available in the original content)
Benchmarks
- Base model performance: (Details about the base model performance should be provided here if available in the original content)
- Chat model performance: (Details about the chat model performance should be provided here if available in the original content)
Tech report
- Citation: (Details about the citation of the tech report should be provided here if available in the original content)
Who can use Yi?
(Details about who can use Yi should be provided here if available in the original content)
đ License
The license for the Yi models is Apache - 2.0.
Phi 2 GGUF
Other
Phi-2 is a small yet powerful language model developed by Microsoft, featuring 2.7 billion parameters, focusing on efficient inference and high-quality text generation.
Large Language Model Supports Multiple Languages
P
TheBloke
41.5M
205
Roberta Large
MIT
A large English language model pre-trained with masked language modeling objectives, using improved BERT training methods
Large Language Model English
R
FacebookAI
19.4M
212
Distilbert Base Uncased
Apache-2.0
DistilBERT is a distilled version of the BERT base model, maintaining similar performance while being more lightweight and efficient, suitable for natural language processing tasks such as sequence classification and token classification.
Large Language Model English
D
distilbert
11.1M
669
Llama 3.1 8B Instruct GGUF
Meta Llama 3.1 8B Instruct is a multilingual large language model optimized for multilingual dialogue use cases, excelling in common industry benchmarks.
Large Language Model English
L
modularai
9.7M
4
Xlm Roberta Base
MIT
XLM-RoBERTa is a multilingual model pretrained on 2.5TB of filtered CommonCrawl data across 100 languages, using masked language modeling as the training objective.
Large Language Model Supports Multiple Languages
X
FacebookAI
9.6M
664
Roberta Base
MIT
An English pre-trained model based on Transformer architecture, trained on massive text through masked language modeling objectives, supporting text feature extraction and downstream task fine-tuning
Large Language Model English
R
FacebookAI
9.3M
488
Opt 125m
Other
OPT is an open pre-trained Transformer language model suite released by Meta AI, with parameter sizes ranging from 125 million to 175 billion, designed to match the performance of the GPT-3 series while promoting open research in large-scale language models.
Large Language Model English
O
facebook
6.3M
198
1
A pretrained model based on the transformers library, suitable for various NLP tasks
Large Language Model
Transformers
Transformers1
unslothai
6.2M
1
Llama 3.1 8B Instruct
Llama 3.1 is Meta's multilingual large language model series, featuring 8B, 70B, and 405B parameter scales, supporting 8 languages and code generation, with optimized multilingual dialogue scenarios.
Large Language Model Transformers Supports Multiple Languages
Transformers Supports Multiple LanguagesL
meta-llama
5.7M
3,898
T5 Base
Apache-2.0
The T5 Base Version is a text-to-text Transformer model developed by Google with 220 million parameters, supporting multilingual NLP tasks.
Large Language Model Supports Multiple Languages
T
google-t5
5.4M
702
Featured Recommended AI Models
Š 2025AIbase