Matter 0.1 7B Boost GGUF

🚀 Matter 7B - 0.1 Boost (Mistral 7B Finetune)

This is a model that offers text generation capabilities. It's a full - finetune on the Matter dataset, which is curated from over 35 datasets analyzing more than 6 billion tokens. The boost version is further finetuned on some additional data. This is the GGUF version of the model, specifically designed for the llama.cpp inference engine.

✨ Features

• Full - finetuned on a large - scale curated dataset.
• Supports function calling.
• Uses the ChatML prompt format.

📦 Installation

No installation steps are provided in the original document, so this section is skipped.

💻 Usage Examples

Basic Usage

This model uses the ChatML prompt format. Here is how you can structure your prompt:

<|im_start|>system
You are a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Advanced Usage - Function Calling

The model also supports function calling. There are specific tokens for function calling:

Model function call tokens:

• <|begin_func|> - Function call start token
• <|end_func|> - Function call end token

Function call response tokens:

• <|begin_func_response|> - Function response start token
• <|end_func_response|> - Function response end token

Here is an example of using function calling with this model:

<|im_start|>system
  You are a helpful assistant with access to the following functions. Use them if required -
  { "name": "get_news_headlines",
    "description": "Get the latest news headlines",
    "parameters":
      { "type": "object",
        "properties":
        { "country":
          { "type": "string",
            "description": "The country for which to fetch news"
          }
        },
      "required": [ "country" ]
    }
  }
<|im_end|>
<|im_start|>user
   Can you tell me the latest news headlines for the United States?<|im_end|>
<|im_start|>assistant
  <|begin_func|>{"name": "get_news_headlines", "arguments": '{"country": "United States"}'}<|end_func|><|im_end|>
<|im_start|>user
  <|begin_func_response|>{
    "headlines":
      [
        "Biden announces new vaccine mandates",
        "Hurricane Ida devastates Louisiana",
        "Apple unveils new iPhone",
        "NASA's Perseverance rover collects first Mars rock sample"
      ]
  }<|end_func_response|>
<|im_end|>
<|im_start|>assistant
  Here are the latest news headlines for the United States:
  1. Biden announces new vaccine mandates
  2. Hurricane Ida devastates Louisiana
  3. Apple unveils new iPhone
  4. NASA's Perseverance rover collects first Mars rock sample
<|im_end|>

📚 Documentation

Training

The model is fully finetuned on the Matter dataset, and the boost version has additional finetuning on extra data.

Prompt Format

As mentioned in the usage examples, this model uses the ChatML prompt format.

Function Calling

The model supports function calling with specific tokens for starting and ending function calls and function responses.

📄 License

This model is licensed under the Apache 2.0 license.