Elearon/deepseek-medical-lora

Model Card for Model ID

Model Details

Model Description

This model is based on DeepSeek-llm-7B-chat, fine-tuned using LoRA (Low-Rank Adaptation).
The training data consists of multi-turn psychotherapy conversations between therapists and patients, aiming to enhance the model’s dialogue capability in mental health consultation scenarios.

• Developed by: [Elearon]

• Funded by [optional]: [More Information Needed]

• Shared by [optional]: [Your Hugging Face ID]

• Model type: Causal Language Model (Chat-oriented)

• Language(s): Chinese

• License: [To Be Specified, e.g. Apache-2.0 or DeepSeek license compliance]

• Finetuned from model: deepseek-ai/deepseek-llm-7b-chat

• Developed by: [More Information Needed]

• Funded by [optional]: [More Information Needed]

• Shared by [optional]: [More Information Needed]

• Model type: [More Information Needed]

• Language(s) (NLP): [More Information Needed]

• License: [More Information Needed]

• Finetuned from model [optional]: [More Information Needed]

Model Sources [optional]

• Repository: [More Information Needed]
• Paper [optional]: [More Information Needed]
• Demo [optional]: [More Information Needed]

Uses

This model can be used for generating multi-turn psychotherapy-style dialogues, simulating interactions between therapists and patients.

Direct Use

[More Information Needed]

Downstream Use [optional]

• Virtual assistants for mental health support
• Research on psychotherapy dialogue modeling
• Emotion-support chatbots

[More Information Needed]

Out-of-Scope Use

⚠️ This model is not a medical device and must not replace licensed psychologists or psychiatrists. It must not be used for:

• Emergency mental health interventions (e.g., suicide prevention)
• Prescribing medication or treatment
• High-risk or clinical decision-making contexts

[More Information Needed]

Bias, Risks, and Limitations

• The dataset is limited and may not cover all psychological conditions.
• The model may generate biased or potentially harmful advice.
• The model should not be used as a substitute for professional therapy.

[More Information Needed]

Recommendations

Users should be aware of the biases, limitations, and risks of this model. It is intended for research and educational purposes only, not for clinical deployment.

Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.

How to Get Started with the Model

from transformers import AutoModelForCausalLM, AutoTokenizer, pipeline

model_id = Elearon/deepseek-medical-lora"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)

chatbot = pipeline("text-generation", model=model, tokenizer=tokenizer)

query = "I’ve been feeling anxious and having trouble sleeping. What should I do?"
response = chatbot(query, max_length=512, do_sample=True, top_p=0.9, temperature=0.7)
print(response[0]["generated_text"])

Use the code below to get started with the model.

[More Information Needed]

Training Details

Training Data

[More Information Needed]

Training Procedure

Preprocessing [optional]

[More Information Needed]

Training Hyperparameters

• Training regime: [More Information Needed]

Speeds, Sizes, Times [optional]

[More Information Needed]

Evaluation

Testing Data, Factors & Metrics

Testing Data

[More Information Needed]

Factors

[More Information Needed]

Metrics

[More Information Needed]

Results

[More Information Needed]

Summary

Model Examination [optional]

[More Information Needed]

Environmental Impact

Carbon emissions can be estimated using the Machine Learning Impact calculator presented in Lacoste et al. (2019).

• Hardware Type: [More Information Needed]
• Hours used: [More Information Needed]
• Cloud Provider: [More Information Needed]
• Compute Region: [More Information Needed]
• Carbon Emitted: [More Information Needed]

Technical Specifications [optional]

Model Architecture and Objective

[More Information Needed]

Compute Infrastructure

[More Information Needed]

Hardware

[More Information Needed]

Software

[More Information Needed]

Citation [optional]

BibTeX:

[More Information Needed]

APA:

[More Information Needed]

Glossary [optional]

[More Information Needed]

More Information [optional]

[More Information Needed]

Model Card Authors [optional]

[More Information Needed]

Model Card Contact

[More Information Needed]

Framework versions

• PEFT 0.17.0