Midnight-Miqu-103B-v1.5 Open-Source Model - Supports 32K Context, Free for Personal Use

Home

Midnight Miqu 103B V1.5

Developed by FluffyKaeloky

A 103B hybrid model based on Miqu, supporting 32K context length, for personal use only

Large Language Model

Transformers

#32K long text processing #Leaked weight derivatives #Personal use only

Downloads 63

Release Time : 3/18/2024

Model Overview

This is a 103B hybrid model of sophosympatheia/Midnight-Miqu-70B-v1.5 with itself, based on Miqu, supporting 32K context length

Model Features

Long context support

Supports 32K-length context window

Hybrid model

A 103B parameter model generated through passthrough hybrid method

Quantized versions

Provides multiple quantized versions, including GGUF and EXL2 formats

Model Capabilities

Long text generation

Multi-turn dialogue

Text comprehension

Use Cases

Personal use

Long document processing

Processing long documents or book contents

Capable of understanding and generating long text content

Complex conversations

Engaging in multi-turn complex dialogues

Maintains long context consistency

🚀 Midnight-Miqu-103B-v1.5

This is a 103B frankenmerge model, based on Miqu and capable of 32K context.

🚀 Quick Start

This is a 103B frankenmerge of sophosympatheia/Midnight-Miqu-70B-v1.5 with itself. Please refer to that model card for detailed information and usage instructions.

✨ Features

High Capacity: Based on Miqu, it can handle a 32K context.

📚 Documentation

Quantizations

GGUF
- GGUF-mradermacher
- GGUF-i1-mradermacher
EXL2

Licence and usage restrictions

⚠️ Important Note

152334H/miqu-1-70b-sf was based on a leaked version of one of Mistral's models. All miqu-derived models, including this merge, are only suitable for personal use. Mistral has been cool about it so far, but you should be aware that by downloading this merge you are assuming whatever legal risk is inherent in acquiring and using a model based on leaked weights. This merge comes with no warranties or guarantees of any kind. I am not a lawyer and I do not profess to know what we have gotten ourselves into here. You should consult with a lawyer before using any Hugging Face model beyond private use... but definitely don't use this one for that!

🔧 Technical Details

Merge Details

Merge Method

This model was merged using the passthrough merge method.

Models Merged

The following model was included in the merge:

sophosympatheia/Midnight-Miqu-70B-v1.5

Configuration

The following YAML configuration was used to produce this model:

slices:
  - sources:
      - model: sophosympatheiaMidnight-Miqu-70B-v1.5
        layer_range: [0, 40] # 40
  - sources:
      - model: sophosympatheiaMidnight-Miqu-70B-v1.5
        layer_range: [20, 60] # 40
  - sources:
      - model: sophosympatheiaMidnight-Miqu-70B-v1.5
        layer_range: [40, 80] # 40
merge_method: passthrough
dtype: float16

📄 License

Please note the license and usage restrictions mentioned above. This model has specific legal implications due to its origin from a potentially leaked model.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご