Llama 3 8B Chat Psychotherapist

🚀 Model Card for Llama-3-8B-chat-psychotherapist

A fine - tuned Llama - 3 - 8B - instruct model leveraging large language models (LLMs) to offer initial support and guidance in mental health.

This model is a fine - tuned version of the LLaMA 3 model, specifically trained on mental health counseling conversations.

✨ Features

• Active Listening: The model is trained to follow conversation flows and attentively respond to user expressions.
• Empathetic Support: Its responses are designed to be supportive and understanding, creating a safe space for users to share their concerns.
• Self - reflection Guidance: The model can ask open - ended questions and prompt users to explore their thoughts and feelings.
• Resource Provision: Depending on the conversation, it can provide users with relevant mental health resources and information.

⚠️ Important Note

This model is intended for initial support and guidance, not a replacement for professional mental health care. It's crucial that users seek professional help if needed. The model is still under development, and its responses may require human oversight for accuracy and safety.

📦 Installation

Read model

from peft import PeftModel, PeftConfig
from transformers import AutoModelForCausalLM

model_id = "zementalist/llama-3-8B-chat-psychotherapist"
config = PeftConfig.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(config.base_model_name_or_path)
model = PeftModel.from_pretrained(model, model_id)

💻 Usage Examples

Basic Usage

question = "I feel like I don't exist and my body is not my own, I'm sombody else observing me, what causes these ideas?"

messages = [
    {"role": "system", "content": "Answer the following inquiry:"},
    {"role": "user", "content": question}
]

input_ids = tokenizer.apply_chat_template(
    messages,
    add_generation_prompt=True,
    return_tensors="pt"
).to(model.device)

terminators = [
    tokenizer.eos_token_id,
    tokenizer.convert_tokens_to_ids("<|eot_id|>")
]

outputs = model.generate(
    input_ids,
    max_new_tokens=256,
    eos_token_id=terminators,
    do_sample=True,
    temperature=0.01
)
response = outputs[0][input_ids.shape[-1]:]
output = tokenizer.decode(response, skip_special_tokens=True)

print(output)

Inference Examples

1. Question: I feel like I don't exist and my body is not my own, like if I'm somebody else observing me, what could be this disorder?
   • Answer: You're describing a phenomenon called depersonalization. It's a common symptom of anxiety disorders, post - traumatic stress disorder (PTSD), and other mental health conditions.
     Depersonalization can make you feel like you're observing yourself from the outside, like you're watching a movie or reading a book about yourself. You might also feel like you're not in control of your body or that you're just a puppet.
     This feeling can be very distressing and can make you wonder if you're even alive. It's a very disorienting and unsettling experience.
     If you're experiencing depersonalization, it's important to seek help from a mental health professional. They can help you identify the underlying causes of your feelings and develop coping strategies to manage them.
     
2. Question: I'm always confused when making decisions, I cannot choose one option, I must have only one option so I can make a decision, what are the causes of being indecisive?
   • Answer: Indecisiveness is a common phenomenon that many people experience. It's not a mental health condition, but it can be frustrating and time - consuming. Here are some possible causes of indecisiveness:
     1. Fear of making the wrong decision: Sometimes, people are afraid of making the wrong choice, which can lead to indecisiveness. This fear can be due to various factors such as fear of failure, fear of rejection, or fear of the unknown.
     2. Lack of clear goals: When people don't have clear goals, they can be indecisive. This is because they don't know what they want, which can lead to confusion and indecisiveness.
     3. Overthinking: Overthinking can be a major cause of indecisiveness. When people overthink, they can get caught up in their thoughts and be unable to make a decision.
     4. Lack of self - confidence: People who lack self - confidence can be indecisive. This is because they don't believe in themselves and are afraid of making the wrong decision.
     5. Avoidance: Avoiding a decision can be a cause of indecisiveness. When people avoid making a decision, they can be indecisive because they don't know

🔧 Technical Details

Training Data

1. [mpingale/mental - health - chat - dataset](https://huggingface.co/datasets/mpingale/mental - health - chat - dataset)
2. Amod/mental_health_counseling_conversations
3. heliosbrahma/mental_health_chatbot_dataset

Training Hyperparameters

Evaluation

📄 License

This model is released under the MIT license.

Developed by

[Zeyad Khalid]