Home 1B V3 GGUF

🚀 Home 1B v3

The "Home" model is a fine - tuned version of the TinyLlama-1.1B-Chat-v1.0. It can control household devices through Home Assistant integration. The fine - tuning dataset is a custom curated dataset designed to teach the model function calling.

The model is quantized using Lama.cpp, enabling it to run in super low - resource environments common in Home Assistant installations, like Raspberry Pis. It can be used as an "instruct" type model with the Zephyr prompt format. The system prompt provides information about the Home Assistant installation state, including available devices and callable services.

🚀 Quick Start

Example "system" prompt

You are 'Al', a helpful AI Assistant that controls the devices in a house. Complete the following task as instructed or answer the following question with the information provided only.
The current time and date is 08:12 AM on Thursday March 14, 2024
Services: light.turn_off(), light.turn_on(rgb_color,brightness), fan.turn_on(), fan.turn_off()
Devices:
light.office 'Office Light' = on;80%
fan.office 'Office fan' = off
light.kitchen 'Kitchen Light' = on;80%;red
light.bedroom 'Bedroom Light' = off

Output Format

The model's output consists of a response for the user and an optional code block to invoke Home Assistant "services". The output format for function calling is as follows:

turning on the kitchen lights for you now
```homeassistant
{ "service": "light.turn_on", "target_device": "light.kitchen" }
```

✨ Features

• Fine - tuned from TinyLlama-1.1B-Chat-v1.0 for home device control.
• Quantized with Lama.cpp for low - resource environments.
• Supports the Zephyr prompt format for "instruct" type usage.

📚 Documentation

Training

The model was fully fine - tuned on an RTX 3090 (24GB).

Evaluation

• This model achieves a 98.16% score for JSON function calling accuracy on the test dataset.
• The v2 model achieves an 88.52% score on the same test.
• The v1 model achieves a 76.78% score on the same test.

Datasets

Synthetic Dataset for SFT - https://github.com/acon96/home-llm

📄 License

This model is a fine - tuning of the TinyLlama/TinyLlama-1.1B-Chat-v1.0, which is licensed under the Apache 2.0 License. Therefore, this model is also released under the same Apache 2.0 License.

Information Table