T

Telechat 7B

Developed by Tele-AI
TeleChat is a large language model developed and trained by China Telecom AI Technology Co., Ltd. The 7B model base is trained on 1.5 trillion tokens of high-quality Chinese and English corpus, while the 12B model base is trained on 3 trillion tokens of high-quality Chinese and English corpus.
Downloads 238
Release Time : 1/8/2024

Model Overview

TeleChat is a high-performance large language model that supports various tasks such as multi-turn dialogue, long-text generation, and code generation. It excels in general Q&A, knowledge-based, code-based, and mathematics-based benchmarks.

Model Features

High-Performance Architecture
Utilizes advanced technologies such as rotary position encoding, SwiGLU activation function, and RMSNorm layer normalization to enhance model training speed and effectiveness.
Multi-Turn Dialogue Support
Incorporates mask loss training for multi-turn dialogue datasets to better focus on multi-turn answers.
Long-Text Generation Capability
Excels in long-text writing tasks such as work summaries, work plans, and PPT outlines.
Extrapolation Capability
Employs NTK-aware extrapolation and attention scaling methods, enabling extrapolation up to 96K.

Model Capabilities

Text generation
Multi-turn dialogue
Q&A systems
Code generation
Mathematical reasoning
Long-text writing

Use Cases

Office Automation
Work Summary Generation
Automatically generates detailed work summary reports.
Produces well-structured and comprehensive work summaries.
PPT Outline Generation
Automatically generates PPT content outlines based on topics.
Creates logical and well-structured PPT outlines.
Education
Mathematical Problem Solving
Solves various mathematical problems and proofs.
Performs excellently in GSM8K and MATH evaluations.
Programming Assistance
Code Generation
Generates code based on natural language descriptions.
Performs well in HumanEval evaluations.
Featured Recommended AI Models
AIbase
Empowering the Future, Your AI Solution Knowledge Base
© 2025AIbase