Llama Primus Reasoning

🚀 Primus: A Pioneering Collection of Open-Source Datasets for Cybersecurity LLM Training

Primus offers a set of open - source datasets for training cybersecurity large language models, aiming to fill the gap in the field of cybersecurity LLM pre - training.

🚀 Quick Start

Primus is a significant project in the field of cybersecurity. It provides a series of datasets for different stages of LLM training in cybersecurity, including pre - training, instruction fine - tuning, and reasoning data for distillation. Based on these datasets, relevant models like Llama - Primus - Reasoning have been developed.

✨ Features

• First cybersecurity reasoning model: Llama - Primus - Reasoning is a reasoning model with a 15.8% improvement in security certification (CISSP).
• Diverse datasets: Covers multiple stages of cybersecurity LLM training, including Primus - Seed, Primus - FineWeb, Primus - Instruct, and Primus - Reasoning.
• Industry - leading foundation: Developed based on advanced research and technology, sharing the foundation of the enterprise - class Trend Cybertron solution.

📦 Installation

No installation steps are provided in the original document, so this section is skipped.

📚 Documentation

Introduction

Large Language Models (LLMs) have shown great potential in various specialized domains. However, there is a lack of open - source datasets for LLM pre - training in the cybersecurity field. Primus fills this gap by providing datasets for different training stages. Based on these datasets and Llama - 3.1 - 8B - Instruct, models like Llama - Primus - Base, Llama - Primus - Merged, and Llama - Primus - Reasoning are developed.

⚠️ Important Note

No TrendMicro customer information is included.

Cybersecurity Benchmark Results

The effect of Primus - Reasoning fine - tuning is evaluated on CISSP. ↑ indicates the percentage improvement over Llama without CoT and in the 5 - shot setting. The best improvement is highlighted in bold.

About Primus

Primus is Trend Micro's pioneering family of lightweight, state - of - the - art open cybersecurity language models and datasets. It shares the innovative foundation of the enterprise - class Trend Cybertron solution. Trend Micro, as an industry leader in cybersecurity, contributes these resources to the community while maintaining high - quality security standards.

📄 License

This model is based on the MIT license, but you must also comply with the Llama 3.1 Community License Agreement.