Linkbricks-Horizon-AI-Japanese-Superb-V4-70B Open-source Language Model - A Practical Assistant for Multilingual Processing and Logical Reasoning

Linkbricks Horizon AI Japanese Superb V4 70B

Developed by Saxo

A Japanese - enhanced language model developed by Linkbricks Horizon - AI, based on a 70B parameter scale, supporting multi - language processing of Japanese, Korean, Chinese, and English, and excelling in logical reasoning and cross - language tasks.

Large Language Model

Transformers

Supports Multiple LanguagesOpen Source License:Apache-2.0 #Japanese language enhancement #Cross - language processing #128k context

Downloads 912

Release Time : 12/23/2024

Model Overview

This is a large multi - language model based on 70B parameters, specifically optimized for Japanese, while also supporting Korean, Chinese, and English. The model is trained with cross - language learning data and mathematical logic data, and has powerful text generation, translation, and logical reasoning capabilities.

Model Features

Multi - language support

Supports cross - enhanced processing of Japanese, Korean, Chinese, and English, enabling high - quality multi - language text generation and translation

Large context window

Supports a context window of 128k tokens, suitable for processing long documents and complex tasks

Function call support

Supports Function Call and Tool Calling functions, facilitating integration into various application scenarios

Logical reasoning ability

Trained with mathematical and logical judgment data, it has excellent logical reasoning and problem - solving abilities

Model Capabilities

Multi - language text generation

Cross - language translation

Customer review analysis

Social media post analysis

Code generation

Mathematical problem solving

Logical reasoning

Long document processing

Use Cases

Business applications

Customer review analysis

Analyze customer reviews on e - commerce platforms and social media, and extract sentiment and key information

High - dimensional sentiment analysis and topic extraction

Cross - language customer service

Provide customer service support in Japanese, Korean, Chinese, and English

Accurate cross - language communication and problem solving

Educational research

Mathematical problem solving

Solve various mathematical problems and logical reasoning questions

Accurate problem - solving processes and answers

Academic paper assistance

Assist researchers in multi - language literature reading and writing

High - quality academic text generation

🚀 Model Card for Model ID

This model card presents a Japanese enhanced language model, fine - tuned by Mr. Yunsung Ji (Saxo), a data scientist and CEO at Linkbricks Horiozn - AI, a company specializing in AI and big data analytics. It is based on the Saxo/Linkbricks - Horizon - AI - Japanese - Superb - V3 - 70B base model and trained through 8 H100 - 80Gs, with a process of Japanese SFT -> DPO.

✨ Features

Cross - language Training: Trained with a variety of cross - learning data in Japanese, Korean, Chinese, and English for different tasks, as well as mathematical and logical judgment data. It uses 30 million Japanese news and Wikipedia corpora as a reference, enabling cross - reinforcement processing among Japanese, Chinese, Korean, and English languages and handling complex logical problems.
Tokenizer: The tokenizer uses the base model without word expansion.
Enhanced Capabilities: It excels in high - dimensional analysis of customer reviews and social posts, along with coding, writing, math, and logical judgment.
Context Window: It supports a 128k - Context Window.
Function Call: It supports Function Call and Tool Calling.
Training Mode: It uses Deepspeed Stage = 3, rslora, and BAdam Layer Mode.
Transformers Version: The transformers_version is 4.46.3.

📦 Installation

No installation steps are provided in the original document, so this section is skipped.

📚 Documentation

Model Ranking: It ranks 1st on the [Open Japanese LLM Leaderboard](https://huggingface.co/spaces/llm - jp/open - japanese - llm - leaderboard) from 2025/01/12 onwards.
Related Links:
- [www.horizonai.ai](https://hf - mirror.com/Saxo/Linkbricks - Horizon - AI - Japanese - Superb - V4 - 70B/resolve/main/www.horizonai.ai)
- [www.linkbricks.com](https://hf - mirror.com/Saxo/Linkbricks - Horizon - AI - Japanese - Superb - V4 - 70B/resolve/main/www.linkbricks.com)
- [www.linkbricks.vc](https://hf - mirror.com/Saxo/Linkbricks - Horizon - AI - Japanese - Superb - V4 - 70B/resolve/main/www.linkbricks.vc)

📄 License

The model is licensed under the apache - 2.0 license.

📦 Dataset Information

Property	Details
Model Type	Fine - tuned Japanese enhanced language model
Training Data
	- `Saxo/ko_cn_translation_tech_social_science_linkbricks_single_dataset`
	- `Saxo/ko_jp_translation_tech_social_science_linkbricks_single_dataset`
	- `Saxo/en_ko_translation_tech_science_linkbricks_single_dataset_with_prompt_text_huggingface`
	- `Saxo/en_ko_translation_social_science_linkbricks_single_dataset_with_prompt_text_huggingface`
	- `Saxo/ko_aspect_sentiment_sns_mall_sentiment_linkbricks_single_dataset_with_prompt_text_huggingface`
	- `Saxo/ko_summarization_linkbricks_single_dataset_with_prompt_text_huggingface`
	- `Saxo/OpenOrca_cleaned_kor_linkbricks_single_dataset_with_prompt_text_huggingface`
	- `Saxo/ko_government_qa_total_linkbricks_single_dataset_with_prompt_text_huggingface_sampled`
	- `Saxo/ko - news - corpus - 1`
	- `Saxo/ko - news - corpus - 2`
	- `Saxo/ko - news - corpus - 3`
	- `Saxo/ko - news - corpus - 4`
	- `Saxo/ko - news - corpus - 5`
	- `Saxo/ko - news - corpus - 6`
	- `Saxo/ko - news - corpus - 7`
	- `Saxo/ko - news - corpus - 8`
	- `Saxo/ko - news - corpus - 9`
	- `maywell/ko_Ultrafeedback_binarized`
	- `youjunhyeok/ko - orca - pair - and - ultrafeedback - dpo`
	- `lilacai/glaive - function - calling - v2 - sharegpt`
	- `kuotient/gsm8k - ko`
Supported Languages	Korean (`ko`), English (`en`), Japanese (`jp`), Chinese (`cn`)
Pipeline Tag	text - generation

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご