Llama-3.1-MIG-Tulu-3-8B-SFT Open Source Model - Realizing Diverse Applications through Fine-tuning Based on Datasets

Llama 3.1 MIG Tulu 3 8B SFT

Developed by xsample

Llama-3.1-8B model fine-tuned using the automatically filtered 50,000-entry Tulu-3-MIG dataset

Open Source License:Apache-2.0 #Instruction Fine-tuning Optimization #Automatic Data Filtering #Multi-task Generalization

Downloads 26

Release Time : 4/17/2025

Model Overview

This model is a large language model based on the Llama-3.1-8B architecture, fine-tuned with the Tulu-3-MIG dataset, focusing on text generation tasks.

Model Features

Efficient Data Filtering

Uses the MIG method to automatically filter high-quality training data, improving model performance

Performance Optimization

Excellent performance across multiple benchmarks, especially on tasks like ARC, BBH, and GSM

Open-source License

Adopts the Apache-2.0 license, facilitating commercial and research use

Model Capabilities

Text generation

Instruction understanding and execution

Multi-turn dialogue

Use Cases

Education

Intelligent Tutoring

Helps students answer questions and provides learning guidance

Customer Service

Automated Customer Service

Handles customer inquiries and FAQ responses

Property	Details
License	Apache-2.0
Base Model	meta-llama/Llama-3.1-8B
Pipeline Tag	text-generation
Library Name	transformers

Method	Data Size	ARC	BBH	GSM	HE	MMLU	IFEval	Avg_obj	AE	MT	Wild	Avg_sub	Avg
Pool	939K	69.15	63.88	83.40	63.41	65.77	67.10	68.79	8.94	6.86	-24.66	38.40	53.59
Random	50K	74.24	64.80	70.36	51.22	63.86	61.00	64.25	8.57	7.06	-22.15	39.36	51.81
ZIP	50K	77.63	63.00	52.54	35.98	65.00	61.00	59.19	6.71	6.64	-32.10	35.69	47.44
IFD	50K	75.93	63.56	61.03	49.39	64.39	53.60	61.32	12.30	7.03	-20.20	40.83	51.08
#InsTag	50K	72.54	64.80	69.83	48.17	63.50	65.99	64.14	6.58	6.84	-20.70	38.21	51.17
DEITA	50K	78.98	66.11	74.07	49.39	64.00	64.33	66.15	10.19	6.83	-19.95	39.50	52.83
CaR	50K	78.98	69.04	71.42	52.44	65.15	56.75	65.63	12.55	6.95	-20.67	40.57	53.10
QDIT	50K	79.66	65.42	70.74	53.05	65.06	57.30	65.21	15.78	6.76	-20.56	41.03	53.12
MIG	50K	80.00	66.39	72.02	57.93	64.44	65.06	67.64	14.66	7.32	-17.77	42.99	55.32

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご

Llama 3.1 MIG Tulu 3 8B SFT

Model Overview

Model Features

Model Capabilities

Use Cases

🚀 Llama-3.1-MIG-Tulu-3-8B-SFT

✨ Features

Model Information

📊 Performance

📄 Citation