Llama-2-GGML Medical Chatbot - Open source and free to answer medical questions and generate medical texts

Llama 2 GGML Medical Chatbot

Developed by ThisIs-Developer

A medical domain chatbot based on the Llama-2-7B-Chat-GGML model, specializing in answering medical-related questions and providing medical text generation capabilities

Large Language Model

Transformers

EnglishOpen Source License:MIT #Medical Q&A #Low-resource Operation #Encyclopedia Knowledge Base

Downloads 71

Release Time : 12/19/2023

Model Overview

This is a dialogue model tailored for the medical field, fine-tuned with data from 'Gale Medical Encyclopedia,' offering medical information queries and text generation services for patients and healthcare professionals

Model Features

Medical Domain Specialization

Fine-tuned based on authoritative medical encyclopedias, equipped with professional medical knowledge answering capabilities

Low-resource Operation

Quantized version can run in CPU environments, requiring as little as 8GB RAM

Multi-framework Support

Built with Langchain and Chainlit, offering flexible deployment options

Model Capabilities

Medical Q&A

Medical Text Summarization

Medical Content Generation

Medical Terminology Explanation

Use Cases

Patient Education

Disease Information Query

Patients can inquire about disease symptoms, treatment methods, and preventive measures

Provides accurate information based on authoritative medical resources

Medical Assistance

Medical Literature Summarization

Quickly generates summaries of medical literature for healthcare professionals

Saves time on literature review and improves work efficiency

🚀 🐍 Llama-2-GGML-Medical-Chatbot 🤖

The Llama-2-7B-Chat-GGML-Medical-Chatbot is a medical chatbot repository. It utilizes the Llama-2-7B-Chat-GGML model and the pdf The Gale Encyclopedia of Medicine. Although still in development, it has the potential to be a valuable tool for patients, healthcare professionals, and researchers. The chatbot can answer medical questions, summarize medical articles, and generate medical text. However, it's crucial to note that it can't replace medical advice from qualified healthcare professionals.

chat_use_case-eb8a4883931d726e9f23628a0d22e315

✨ Features

Model Utilization: It employs the fine - tuned Llama-2-7B-Chat-GGML model, a large language model (LLM).

Property	Details
Name	llama-2-7b-chat.ggmlv3.q2_K.bin
Quant method	q2_K
Bits	2
Size	2.87 GB
Max RAM required	5.37 GB
Use case	New k - quant method. Uses GGML_TYPE_Q4_K for the attention.vw and feed_forward.w2 tensors, GGML_TYPE_Q2_K for the other tensors.
Model	Know more about model Llama-2-7B-Chat-GGML

Training Data: It is trained on the pdf The Gale Encyclopedia of Medicine, Volume 1, 2nd Edition, 637 - page PDF, a comprehensive medical reference covering a wide range of medical topics. This enables the chatbot to answer various medical questions.
Technical Stack and Requirements: This sophisticated medical chatbot is developed using Llama - 2 7B and Sentence Transformers, powered by Langchain and Chainlit. It runs on a powerful CPU computer with the following minimum requirements:
- Operating system: Linux, macOS, or Windows
- CPU: Intel® Core™ i3
- RAM: 8 GB
- Disk space: 7 GB
- GPU: None (CPU only)
Development Status: It is still under development but holds great potential as a valuable tool for patients, healthcare professionals, and researchers.

🚀 Quick Start

Open Git Bash.
Change the current working directory to the location where you want the cloned directory.
Type git clone, and then paste the URL you copied earlier.

git clone https://github.com/ThisIs-Developer/Llama-2-GGML-Medical-Chatbot.git

Press Enter to create your local clone. 4. Install the pip packages in requirements.txt

pip install -r requirements.txt

Now run it!

chainlit run model.py -w

📚 Documentation

⛓️ Chainlit ver. on #v1.0.1.dev20230913

ChatBot Conversession img-1

⚡ Streamlit ver. on #v2.0.1.dev20231230

ChatBot Conversession img-4.png

DEMO: 📽️ Conversession.vid.mp4 -> Link

ChatBot Conversession img-2

ChatBot Conversession img-3

📄 License

This project is licensed under the MIT license.

Featured Recommended AI Models

Empowering the Future, Your AI Solution Knowledge Base

English 简体中文繁體中文にほんご