MT1-Gen11-gemma-2-9B Open-Source Pretrained Language Model - Free Fusion of Multiple Variants for Diverse Communication

MT1 Gen11 Gemma 2 9B

Developed by zelk12

This is a pre-trained language model merged using mergekit and the DARE TIES method, based on multiple Gemma-2-9B variant models.

Large Language Model

Transformers

#Multi-model Fusion #High-performance Text Generation #DARE TIES Merging

Downloads 29

Release Time : 4/9/2025

Model Overview

By merging multiple Gemma-2-9B variant models, this model aims to combine the strengths of each to enhance text generation capabilities.

Model Features

Multi-model Fusion

Combines the strengths of 6 different Gemma-2-9B variant models

DARE TIES Merging Method

Utilizes advanced DARE TIES merging technology to optimize model parameter fusion

High-density Parameter Retention

Retains 50% of sparse parameters during merging to balance performance and efficiency

Model Capabilities

Text Generation

Dialogue Systems

Instruction Following

Use Cases

Dialogue Systems

Intelligent Chatbot

Can be used to build fluent dialogue systems

Content Generation

Creative Writing Assistance

Helps generate creative text content

🚀 Model Merge Project

This project is a merge of pre - trained language models, aiming to combine the strengths of multiple models to achieve better text - generation performance.

🚀 Quick Start

This is a merge of pre - trained language models created using mergekit.

✨ Features

Multi - model Merge: Combines the capabilities of multiple Gemma - based pre - trained models.
Advanced Merge Method: Utilizes the DARE TIES merge method for effective model integration.

📚 Documentation

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using [zelk12/MT - Merge6 - gemma - 2 - 9B](https://huggingface.co/zelk12/MT - Merge6 - gemma - 2 - 9B) as a base.

Models Merged

The following models were included in the merge:

[TheDrummer/Tiger - Gemma - 9B - v3](https://huggingface.co/TheDrummer/Tiger - Gemma - 9B - v3)
[zelk12/MT - Gen6fix - gemma - 2 - 9B](https://huggingface.co/zelk12/MT - Gen6fix - gemma - 2 - 9B)
[Sorawiz/Gemma - 9B - Chat](https://huggingface.co/Sorawiz/Gemma - 9B - Chat)
[zelk12/MT1 - Gen7 - gemma - 2 - 9B](https://huggingface.co/zelk12/MT1 - Gen7 - gemma - 2 - 9B)
[IlyaGusev/gemma - 2 - 9b - it - abliterated](https://huggingface.co/IlyaGusev/gemma - 2 - 9b - it - abliterated)

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: zelk12/MT-Merge6-gemma-2-9B
    #no parameters necessary for base model
  - model: zelk12/MT1-Gen7-gemma-2-9B
    parameters:
      density: 0.5
      weight: 0.5
  - model: IlyaGusev/gemma-2-9b-it-abliterated
    parameters:
      density: 0.5
      weight: 0.54
  - model: Sorawiz/Gemma-9B-Chat
    parameters:
      density: 0.5
      weight: 0.57
  - model: TheDrummer/Tiger-Gemma-9B-v3
    parameters:
      density: 0.5
      weight: 0.62
  - model: zelk12/MT-Gen6fix-gemma-2-9B
    parameters:
      density: 0.5
      weight: 0.8

merge_method: dare_ties
base_model: zelk12/MT-Merge6-gemma-2-9B
parameters:
  normalize: true
dtype: bfloat16

📄 License

The license for this project is gemma.

📦 Information Table

Property	Details
Base Models	TheDrummer/Tiger - Gemma - 9B - v3, zelk12/MT - Gen6fix - gemma - 2 - 9B, Sorawiz/Gemma - 9B - Chat, zelk12/MT1 - Gen7 - gemma - 2 - 9B, IlyaGusev/gemma - 2 - 9b - it - abliterated, zelk12/MT - Merge6 - gemma - 2 - 9B
Library Name	transformers
Tags	mergekit, merge
License	gemma
Pipeline Tag	text - generation

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご