Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# Model Card: Fine-tuned Phi3-mini for Mental Health FAQs
|
2 |
+
|
3 |
+
## Model Details
|
4 |
+
|
5 |
+
- **Model Name**: Phi3-mini-MentalHealth
|
6 |
+
- **Base Model**: Phi3-mini
|
7 |
+
- **Model Type**: Language Model
|
8 |
+
- **Framework**: MLX
|
9 |
+
- **Fine-tuning Dataset**: Mental Health FAQ data from Kaggle
|
10 |
+
- **Format**: GGUF (GPT Quantized)
|
11 |
+
|
12 |
+
## Intended Use
|
13 |
+
|
14 |
+
This model is designed to provide empathetic and informative responses to frequently asked questions about mental health. It can be used in applications such as:
|
15 |
+
|
16 |
+
- Mental health chatbots
|
17 |
+
- Educational resources about mental health
|
18 |
+
- Preliminary mental health screening tools (with appropriate disclaimers)
|
19 |
+
|
20 |
+
## Training Data
|
21 |
+
|
22 |
+
The model was fine-tuned on a dataset of Mental Health FAQs from Kaggle. This dataset likely includes:
|
23 |
+
|
24 |
+
- Common questions about mental health conditions
|
25 |
+
- Basic information about symptoms and treatments
|
26 |
+
- General mental health and wellness advice
|
27 |
+
|
28 |
+
Note: The exact contents and size of the dataset should be verified and added here.
|
29 |
+
|
30 |
+
## Fine-tuning Process
|
31 |
+
|
32 |
+
The Phi3-mini model was fine-tuned using the MLX framework. Specific details about the fine-tuning process, such as number of epochs, learning rate, and other hyperparameters, should be added here.
|
33 |
+
|
34 |
+
## Performance and Limitations
|
35 |
+
|
36 |
+
- **Improved Empathy**: The fine-tuned model demonstrates increased empathy in its responses compared to the base model.
|
37 |
+
- **Domain Specificity**: The model's knowledge is focused on mental health topics covered in the FAQ dataset.
|
38 |
+
- **Limitations**:
|
39 |
+
- The model's knowledge is limited to the scope of the training data.
|
40 |
+
- It should not be used as a substitute for professional mental health advice or diagnosis.
|
41 |
+
- The model may not be up-to-date with the latest mental health research or treatments.
|
42 |
+
|
43 |
+
## Ethical Considerations
|
44 |
+
|
45 |
+
- **Privacy**: The model should be used in ways that protect user privacy, especially given the sensitive nature of mental health discussions.
|
46 |
+
- **Bias**: While efforts have been made to improve empathy, the model may still exhibit biases present in the training data.
|
47 |
+
- **Misuse Potential**: Care should be taken to prevent the model from being used to provide medical advice it's not qualified to give.
|
48 |
+
|
49 |
+
## Additional Information
|
50 |
+
|
51 |
+
- **License**: Apache 2.0
|
52 |
+
- **Developer**: Dattaraj Rao - Persistent
|
53 |
+
- **Date Created**: 16-Jul-2024
|
54 |
+
- **Version**: 1.0
|
55 |
+
|
56 |
+
For more information or to report issues, please contact: https://www.linkedin.com/in/dattarajrao/
|