Mistral Sk 7b

🚀 Model Card for mistral-sk-7b

mistral-sk-7b is a Slovak-language variant of the Mistral-7B-v0.1 large language model, boasting 7 billion parameters. It offers a foundation for Slovak-language tasks, enabling further customization for specific applications.

📚 Documentation

Model Details

mistral-sk-7b is a Slovak language model. It's derived from the Mistral-7B-v0.1 large language model through full parameter fine-tuning, using data from the Araneum Slovacum VII Maximum web corpus.

The model was developed through a collaboration involving the Department of Cybernetics and Artificial Intelligence at the Faculty of Electrical Engineering and Informatics of the Technical University of Košice, the Centre of Social and Psychological Sciences of the Slovak Academy of Sciences, the Ľ. Štúr Institute of Linguistics of the Slovak Academy of Sciences, and ČZ, o.z.

This is a base pre-trained model suitable for further fine-tuning for downstream tasks in the Slovak language. Note that this model does not incorporate any moderation mechanisms.

Supported by

Part of the research results was obtained using the high-performance computing resources operated by CINECA and awarded within the National Leonardo access call 2023 by the Centre of Operations, Slovak Academy of Sciences, and the Slovak National Supercomputing centre.

📄 License

This model is released under the Apache license 2.0.