stardust-coder
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -1,6 +1,23 @@
|
|
1 |
---
|
2 |
library_name: peft
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
## Training procedure
|
5 |
|
6 |
|
@@ -15,7 +32,19 @@ The following `bitsandbytes` quantization config was used during training:
|
|
15 |
- bnb_4bit_quant_type: nf4
|
16 |
- bnb_4bit_use_double_quant: True
|
17 |
- bnb_4bit_compute_dtype: bfloat16
|
|
|
18 |
### Framework versions
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
19 |
|
20 |
|
21 |
-
- PEFT 0.4.0
|
|
|
1 |
---
|
2 |
library_name: peft
|
3 |
+
license: llama2
|
4 |
+
tags:
|
5 |
+
- medical
|
6 |
---
|
7 |
+
⚠️⚠️⚠️ Only for research purpose. Do not use it for medical purpose. ⚠️⚠️⚠️
|
8 |
+
|
9 |
+
# MedSwallow-70B🏥
|
10 |
+
|
11 |
+
[東工大Swallow](tokyotech-llm/Swallow-70b-instruct-hf)をベースモデルとし, 医療Q&AデータセットでInstruction Tuningを施した医療ドメインの日本語LLMです.
|
12 |
+
|
13 |
+
チューニングには独自で用意した米国医師国家試験(USMLE)を和訳したQ&Aデータセットを用いました.
|
14 |
+
|
15 |
+
|
16 |
+
MedSwallow is a Japanese medical LLM for medical question-answering.
|
17 |
+
|
18 |
+
MedSwallow is based on [Swallow-70B]((tokyotech-llm/Swallow-70b-instruct-hf)) and has passed instruction tuning with USMLE dataset translated in Japanese by our own.
|
19 |
+
|
20 |
+
|
21 |
## Training procedure
|
22 |
|
23 |
|
|
|
32 |
- bnb_4bit_quant_type: nf4
|
33 |
- bnb_4bit_use_double_quant: True
|
34 |
- bnb_4bit_compute_dtype: bfloat16
|
35 |
+
|
36 |
### Framework versions
|
37 |
+
- PEFT 0.4.0
|
38 |
+
|
39 |
+
|
40 |
+
## License
|
41 |
+
|
42 |
+
ライセンスはLlama 2やSwallowと同じく, LLAMA 2 Community Licenseです.
|
43 |
+
|
44 |
+
|
45 |
+
## How to cite
|
46 |
+
```
|
47 |
+
coming soon...
|
48 |
+
```
|
49 |
|
50 |
|
|