🚀 ChengsenWang/ChatTime-1-7B-Chat - GGUF
This repository provides GGUF format model files for ChengsenWang/ChatTime-1-7B-Chat. These files are quantized using machines from TensorBlock, and they are compatible with llama.cpp as of commit b5165.
✨ Features
- Model Tags: This model is tagged with time-series, pretrained-model, foundation-model, multimodality, multimodal-time-series-foundation-model, TensorBlock, and GGUF.
- Pipeline Tag: It is designed for time-series forecasting.
📦 Installation
Command line
- Install Huggingface Client:
pip install -U "huggingface_hub[cli]"
- Download the individual model file to a local directory:
huggingface-cli download tensorblock/ChengsenWang_ChatTime-1-7B-Chat-GGUF --include "ChatTime-1-7B-Chat-Q2_K.gguf" --local-dir MY_LOCAL_DIR
- If you want to download multiple model files with a pattern (e.g.,
*Q4_K*gguf
), you can try:
huggingface-cli download tensorblock/ChengsenWang_ChatTime-1-7B-Chat-GGUF --local-dir MY_LOCAL_DIR --local-dir-use-symlinks False --include='*Q4_K*gguf'
📚 Documentation
Our projects
Project |
Description |
Link |
Awesome MCP Servers |
A comprehensive collection of Model Context Protocol (MCP) servers. |
GitHub |
TensorBlock Studio |
A lightweight, open, and extensible multi-LLM interaction studio. |
GitHub |
Prompt template
Model file specification
Filename |
Quant type |
File Size |
Description |
ChatTime-1-7B-Chat-Q2_K.gguf |
Q2_K |
2.580 GB |
smallest, significant quality loss - not recommended for most purposes |
ChatTime-1-7B-Chat-Q3_K_S.gguf |
Q3_K_S |
3.000 GB |
very small, high quality loss |
ChatTime-1-7B-Chat-Q3_K_M.gguf |
Q3_K_M |
3.349 GB |
very small, high quality loss |
ChatTime-1-7B-Chat-Q3_K_L.gguf |
Q3_K_L |
3.649 GB |
small, substantial quality loss |
ChatTime-1-7B-Chat-Q4_0.gguf |
Q4_0 |
3.883 GB |
legacy; small, very high quality loss - prefer using Q3_K_M |
ChatTime-1-7B-Chat-Q4_K_S.gguf |
Q4_K_S |
3.914 GB |
small, greater quality loss |
ChatTime-1-7B-Chat-Q4_K_M.gguf |
Q4_K_M |
4.138 GB |
medium, balanced quality - recommended |
ChatTime-1-7B-Chat-Q5_0.gguf |
Q5_0 |
4.714 GB |
legacy; medium, balanced quality - prefer using Q4_K_M |
ChatTime-1-7B-Chat-Q5_K_S.gguf |
Q5_K_S |
4.714 GB |
large, low quality loss - recommended |
ChatTime-1-7B-Chat-Q5_K_M.gguf |
Q5_K_M |
4.845 GB |
large, very low quality loss - recommended |
ChatTime-1-7B-Chat-Q6_K.gguf |
Q6_K |
5.597 GB |
very large, extremely low quality loss |
ChatTime-1-7B-Chat-Q8_0.gguf |
Q8_0 |
7.248 GB |
very large, extremely low quality loss - not recommended |
📄 License
This project is licensed under the Apache-2.0 license.