Locutusquexfelladrin TinyMistral248M Instruct

🚀 LocutusqueXFelladrin-TinyMistral248M-Instruct

This model is a text generation solution that combines the strengths of two models. It effectively solves the problem of balancing coding capabilities, reasoning skills, and low hallucination in a compact model, offering high - performance text generation for various tasks.

🚀 Quick Start

The model can be used for text generation tasks. You can set parameters in the inference section, such as temperature, top_p, etc., to control the generation process.

inference:
  parameters:
    temperature: 0.5
    do_sample: true
    top_p: 0.5
    top_k: 30
    max_new_tokens: 250
    repetition_penalty: 1.15

✨ Features

• Combined Strengths: Merges the coding and reasoning capabilities of Locutusque/TinyMistral - 248M - Instruct with the low - hallucination and instruction - following capabilities of Felladrin/TinyMistral - 248M - SFT - v4.
• High Performance: Despite its relatively small size, it demonstrates excellent performance.

📦 Installation

No specific installation steps are provided in the original document.

💻 Usage Examples

Basic Usage

The widget section provides some basic usage examples:

- text: >-
    <|USER|> Design a Neo4j database and Cypher function snippet to Display
    Extreme Dental hygiene: Using Mouthwash for Analysis for Beginners.
    Implement if/else or switch/case statements to handle different conditions
    related to the Consent. Provide detailed comments explaining your control
    flow and the reasoning behind each decision. <|ASSISTANT|> 
- text: '<|USER|> Write me a story about a magical place. <|ASSISTANT|> '
- text: >-
    <|USER|> Write me an essay about the life of George Washington
    <|ASSISTANT|> 
- text: '<|USER|> Solve the following equation 2x + 10 = 20 <|ASSISTANT|> '
- text: >-
    <|USER|> Craft me a list of some nice places to visit around the world.
    <|ASSISTANT|> 
- text: >-
    <|USER|> How to manage a lazy employee: Address the employee verbally. Don't
    allow an employee's laziness or lack of enthusiasm to become a recurring
    issue. Tell the employee you're hoping to speak with them about workplace
    expectations and performance, and schedule a time to sit down together.
    Question: To manage a lazy employee, it is suggested to talk to the
    employee. True, False, or Neither? <|ASSISTANT|> 

📚 Documentation

Model Merging

This model was created by merging Locutusque/TinyMistral - 248M - Instruct and Felladrin/TinyMistral - 248M - SFT - v4 using mergekit. After the merge, the resulting model was further trained on ~20,000 examples on the Locutusque/inst_mix_v2_top_100k at a low learning rate to further normalize weights. The following is the YAML config used to merge:

models:
  - model: Felladrin/TinyMistral-248M-SFT-v4
    parameters:
      weight: 0.5
  - model: Locutusque/TinyMistral-248M-Instruct
    parameters:
      weight: 1.0
merge_method: linear
dtype: float16

🔧 Technical Details

The model combines two different TinyMistral - based models. By assigning different weights to each model during the merging process and then fine - tuning on a specific dataset, it normalizes the weights and combines the advantages of both models.

📄 License

This model is released under the Apache - 2.0 license.