Kanana 1.5 8b Base

🚀 Kanana 1.5 - 8B Base

Kanana 1.5 is a new version of the Kanana model family, offering significant improvements in coding, mathematics, and function calling capabilities. It can handle up to 32K tokens natively and up to 128K tokens with YaRN, and provides more natural and accurate conversations through refined post - training.

🚀 Quick Start

This section provides an overview of the Kanana 1.5 model and its features. For more detailed information, please refer to the corresponding sections below.

✨ Features

• Enhanced Capabilities: Kanana 1.5 shows substantial improvements in coding, mathematics, and function calling capabilities compared to the previous version.
• Long - Sequence Handling: It can natively handle up to 32K tokens and up to 128K tokens using YaRN, maintaining coherence in long - document processing and extended conversations.
• Refined Conversations: Through a refined post - training process, it delivers more natural and accurate conversations.

📚 Documentation

News

• 2025/05/23: Published a blog post about Kanana 1.5 models and released HF model weights.
• 2025/02/27: Released Technical Report and HF model weights.
• 2025/01/10: Published a blog post about the development of Kanana Nano model.
• 2024/11/14: Published blog posts (pre - training, post - training) about the development of Kanana models.
• 2024/11/06: Published a presentation video about the development of the Kanana models.

Table of Contents

• Kanana 1.5
  • Performance
    • Base Model Evaluation
    • Instruct Model Evaluation
  • Processing 32K+ Length
• Contributors
• Citation
• Contact

Kanana 1.5

Kanana 1.5, a newly introduced version of the Kanana model family, presents substantial enhancements in coding, mathematics, and function calling capabilities over the previous version, enabling broader application to more complex real - world problems. This new version now can handle up to 32K tokens length natively and up to 128K tokens using YaRN, allowing the model to maintain coherence when handling extensive documents or engaging in extended conversations. Furthermore, Kanana 1.5 delivers more natural and accurate conversations through a refined post - training process.

⚠️ Important Note

Neither the pre - training nor the post - training data includes Kakao user data.

Performance

Base Model Evaluation

Instruct Model Evaluation

⚠️ Important Note

* Models released under Apache 2.0 are trained on the latest versions compared to other models.

Processing 32K+ Length

Currently, the config.json uploaded to HuggingFace is configured for token lengths of 32,768 or less. To process tokens beyond this length, YaRN must be applied. By updating the config.json with the following parameters, you can apply YaRN to handle token sequences up to 128K in length:

"rope_scaling": {
    "factor": 4.4,
    "original_max_position_embeddings": 32768,
    "type": "yarn",
    "beta_fast": 64,
    "beta_slow": 2
},

Contributors

• Language Model Training: Yunju Bak, Doohae Jung, Boseop Kim, Nayeon Kim, Hojin Lee, Jaesun Park, Minho Ryu
• Language Model Alignment: Jiyeon Ham, Seungjae Jung, Hyunho Kim, Hyunwoong Ko, Changmin Lee, Daniel Wontae Nam
• AI Engineering: Youmin Kim, Hyeongju Kim

Citation

@misc{kananallmteam2025kananacomputeefficientbilinguallanguage,
      title={Kanana: Compute - efficient Bilingual Language Models}, 
      author={Kanana LLM Team and Yunju Bak and Hojin Lee and Minho Ryu and Jiyeon Ham and Seungjae Jung and Daniel Wontae Nam and Taegyeong Eo and Donghun Lee and Doohae Jung and Boseop Kim and Nayeon Kim and Jaesun Park and Hyunho Kim and Hyunwoong Ko and Changmin Lee and Kyoung - Woon On and Seulye Baeg and Junrae Cho and Sunghee Jung and Jieun Kang and EungGyun Kim and Eunhwa Kim and Byeongil Ko and Daniel Lee and Minchul Lee and Miok Lee and Shinbok Lee and Gaeun Seo},
      year={2025},
      eprint={2502.18934},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2502.18934}, 
}

Contact

• Kanana LLM Team Technical Support: kanana - llm@kakaocorp.com
• Business & Partnership Contact: alpha.k@kakaocorp.com

📄 License

This project is licensed under the Apache 2.0 license.