đ Pandora-v1-13B Model
This is a model file designed solely for evaluation. It offers a unique approach by leveraging the passthrough merge method from top 7B models on the OpenLLM Leaderboard.
Jan - Discord
đ Quick Start
This model can be run using Jan on Mac, Windows, or Linux. When using it on Jan, please use the Pandora-v1-13B-GGUF.
⨠Features
- Confidentiality: đģ 100% offline on your machine, ensuring your conversations remain private.
- Open File Format: đī¸ Conversations and model settings are stored locally and can be exported or deleted at will.
- OpenAI Compatibility: đ Local server on port
1337 with OpenAI compatible endpoints.
- Open Source & Free: đ Built in public; check out our Github
đĻ Installation
No specific installation steps are provided in the original document.
đģ Usage Examples
Basic Usage
You can use the following prompt template (ChatML) when interacting with the model:
<|im_start|>system
{system_message}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
đ Documentation
Model Description
This model uses the passthrough merge method from the best 7B models on the OpenLLM Leaderboard:
- viethq188/LeoScorpius-7B-Chat-DPO
- GreenNode/GreenNodeLM-7B-v1olet
The yaml config file for this model is as follows:
slices:
- sources:
- model: "viethq188/LeoScorpius-7B-Chat-DPO"
layer_range: [0, 24]
- sources:
- model: "GreenNode/GreenNodeLM-7B-v1olet"
layer_range: [8, 32]
merge_method: passthrough
dtype: bfloat16
About Jan
Jan believes in the need for an open - source AI ecosystem and is building the infrastructure and tools to enable open - source AIs to compete fairly with proprietary ones. Its long - term vision is to build a cognitive framework for future robots, which can serve as practical and useful assistants for humans and businesses in daily life.
Jan Model Merger
This is a test project for merging models.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here.
| Metric |
Value |
| Avg. |
? |
| ARC (25 - shot) |
? |
| HellaSwag (10 - shot) |
? |
| MMLU (5 - shot) |
? |
| TruthfulQA (0 - shot) |
? |
| Winogrande (5 - shot) |
? |
| GSM8K (5 - shot) |
? |
đ§ Technical Details
No technical details are provided in the original document.
đ License
This project is licensed under the Apache-2.0 license.
Acknowlegement
â ī¸ Important Note
This is a model file only for evaluation.
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
