Med-LLaMA3-8B Open-Source Medical Language Model: Empowering Medical Applications with Massive Medical Data Training

Med LLaMA3 8B

Developed by YBXL

A medical domain language model based on the LLaMA3-8B architecture, continuously pre-trained with large-scale open-source medical data

Large Language Model

Transformers

#Medical domain specific #8 billion parameter scale #Medical knowledge enhanced

Downloads 1,029

Release Time : 6/24/2024

Model Overview

Med-LLaMA3-8B is a language model focused on the medical field, primarily used for medical text comprehension and generation tasks

Model Features

Medical domain specialization

Continuous pre-training with professional data such as medical textbooks, literature, and clinical guidelines

Large-scale parameters

Based on the 8-billion-parameter LLaMA3 architecture, with powerful language comprehension and generation capabilities

Multi-source medical data training

Integrates various medical data sources, including medical textbooks, literature, and clinical guidelines

Model Capabilities

Medical text comprehension

Medical text generation

Medical Q&A

Clinical guideline analysis

Use Cases

Medical education

Medical knowledge Q&A

Answering professional questions from medical students and practitioners

Clinical assistance

Clinical guideline analysis

Assisting doctors in understanding and applying clinical guidelines

Medical research

Literature abstract generation

Automatically generating abstracts for medical literature

🚀 Model Card for Med-LLaMA3-8B

Med-LLaMA3-8B is an 8-billion parameter medical language model, offering specialized capabilities in the medical field through continual pre-training.

🚀 Quick Start

This section provides a brief introduction to the Med-LLaMA3-8B model. For more detailed usage, please refer to the official documentation.

✨ Features

Specialized in Medicine: Trained on large-scale medical data, it has strong capabilities in medical language processing.
Based on LLaMA3-8B: Built on the LLaMA3-8B architecture, leveraging its pre - trained foundation.

📦 Installation

No installation steps were provided in the original document, so this section is skipped.

💻 Usage Examples

No code examples were provided in the original document, so this section is skipped.

📚 Documentation

Model Details

Model Description

Med-LLaMA3-8B is an 8-billion parameter medical language model that has undergone continual pre-training on LLaMA3-8B architecture using large-scale open-sourced medical data.

Training Details

Med-LLaMA3-8B is trained on a large-scale dataset comprising: medical books, medical literature, clinical guidelines and a small portion of general domain data. It is a study extension based on our previous Me-LLaMA paper: Me LLaMA: Foundation Large Language Models for Medical Applications

If you use the model, please cite the following papers:

@misc{xie2024llama,
      title={Me LLaMA: Foundation Large Language Models for Medical Applications}, 
      author={Qianqian Xie and Qingyu Chen and Aokun Chen and Cheng Peng and Yan Hu and Fongci Lin and Xueqing Peng and Jimin Huang and Jeffrey Zhang and Vipina Keloth and Huan He and Lucila Ohno-Machido and Yonghui Wu and Hua Xu and Jiang Bian},
      year={2024},
      eprint={2402.12749},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}

🔧 Technical Details

No specific technical details exceeding 50 words were provided in the original document, so this section is skipped.

📄 License

No license information was provided in the original document, so this section is skipped.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご