add Preferred-MedLLM-Qwen-72B

Notice.txt

@@ -0,0 +1 @@
+Preferred-MedLLM-Qwen-72B is trained on Qwen2.5-72B as the base model. Qwen is licensed under the Qwen LICENSE AGREEMENT, Copyright (c) Alibaba Cloud. All Rights Reserved.

README.md

@@ -0,0 +1,52 @@
+---
+base_model: Qwen/Qwen2.5-72B
+language:
+  - en
+  - ja
+library_name: transformers
+pipeline_tag: text-generation
+license_name: qwen
+---
+
+# Preferred-MedLLM-Qwen-72B
+
+## Model Description
+
+Preferred-MedLLM-Qwen-72B is a finetuned model based on [Qwen/Qwen2.5-72B](https://huggingface.co/Qwen/Qwen2.5-72B), which has undergone continued pretraining on an original corpus of medical-related text.
+
+The model is released under the [Qwen LICENSE](https://huggingface.co/Qwen/Qwen2.5-72B/blob/main/LICENSE).
+
+## Model Performance
+
+The table below shows the performance on the Japanese medical licensing examination from 2018 to 2022 ([IgakuQA](https://github.com/jungokasai/IgakuQA)).
+| Model ID                                                                                                            |   Average |   2018 |   2019 |   2020 |   2021 |   2022 |
+|:--------------------------------------------------------------------------------------------------------------------|-------------------:|-------:|-------:|-------:|-------:|-------:|
+| **Preferred-MedLLM-Qwen-72B**          |              **431.2** |    **434** |    420 |    **439** |    **430** |    433 |
+| GPT-4o                                                                                                 |              430.4 |    427 |    **431** |    433 |    427 |    **434** |
+| [Qwen2.5-72B](https://huggingface.co/Qwen/Qwen2.5-72B)                                                                         |              398.4 |    412 |    394 |    394 |    393 |    399 |
+| [Llama3-Preferred-MedSwallow-70B](https://huggingface.co/pfnet/Llama3-Preferred-MedSwallow-70B)          |              395.2 |    407 |    390 |    391 |    393 |    395 |
+| GPT-4                                                                                                                |              388.8 |    382 |    385 |    387 |    **398** |    392 |
+| [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407)                 |              376   |    370 |    371 |    390 |    373 |    376 |
+| [Llama-3.1-Swallow-70B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3.1-Swallow-70B-v0.1)               |              368.4 |    379 |    378 |    379 |    351 |    355 |
+| [Meta-Llama-3-70B](https://huggingface.co/meta-llama/Meta-Llama-3-70B)                                                                                 |              334.6 |    353 |    340 |    348 |    314 |    318 |
+| GPT-3.5                                                                                                             |              273.2 |    266 |    250 |    266 |    297 |    287 |
+
+## Limitations
+
+The model was developed for research purposes and is not intended for clinical diagnosis.
+It is the users' responsibility to ensure compliance with applicable rules and regulations.
+
+## Contributors
+
+Preferred Networks, Inc.
+- Junichiro Iwasawa
+- Wataru Kawakami
+- Keita Suzuki
+
+## Publications
+
+We are currently preparing a related blog post and research paper, which will be made available soon to provide further insights and detailed information about the development and capabilities of this model.
+
+## License
+
+[Qwen LICENSE](https://huggingface.co/Qwen/Qwen2.5-72B/blob/main/LICENSE)

added_tokens.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a32bc0d990603eb93fd389dc164fe6fbfc442db2ab3a65e4a99a249433ab11f6
+size 632

config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:56d518ef863dba5baacbf14703b651930b7dac9461b1a70054683e54666ad50b
+size 740

generation_config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cffaff49109b279cffdf516565044bdf0464d01753990e64d6723b6b687dddc6
+size 117

model-00001-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4805f03558721551a7250f9d43a4bdbb5d07657d642d8fe9ba866a962706584c
+size 4548798728

model-00002-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:22269f48fe416f8286b2e9d0d52f6a90f9b4607f3b27eff1e299a94ed0df7602
+size 4964101384

model-00003-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2c6c2747a684ec9b17c436c0dc7767a791b806c3a5bdd3b6ba1fdca8d383769a
+size 4781637328

model-00004-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01bff0119f91ba50a485e4d00fdbb044b5fdd2a5a41eaa8f2a0c57b7f09215b0
+size 4781670320

model-00005-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:28ff5fc2228a8f19a1d95d79ccd01686a61128cd094b9d48f56a1c43012e29b8
+size 4781670360

model-00006-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4e45b1cc0a0fda4fa42020f767d187c2046031bd924bdd32ebdafd45ed4dbe8d
+size 4964101416

model-00007-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e06fee423a20fc2c6bd62788b7f73c86ced12690d21ec96f2d5e51126fcad033
+size 4781637360

model-00008-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7f8de5b7cdeb7982716daeda051a2d08bbd0c01c3ed117fda812f8b239d4cf0
+size 4781670360

model-00009-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5310bfb1d2a2e69709dadd2368a83c2572bf389237eb1f0b55f8e2894375430b
+size 4781670360

model-00010-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:afaa5371800df8efde4699141c271f55d77d113387fa9223510b555d81319a93
+size 4964101416

model-00011-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eaa2aa70e037e353b0473562c9cba7f4dd3ef0a91ef5d93b0ae5847b99193ecd
+size 4781637360

model-00012-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b8eea792283c8e9ae0fb77ff0429976ea25cd5c0b656e37e68591f77e5f377e1
+size 4781670360

model-00013-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9357b0cd2f127c172cfbec2a03deaa7d1b0a4d3dc5f95fde80b8237d5cb9d063
+size 4781670360

model-00014-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cdf8e9f483830ec6d5e8e4e1550610bb318ad0be29d8d16d2058be94428b72cf
+size 4964101416

model-00015-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:74085d1150ce1911f54b63ddb075ce6e9fe0810ab3170b146293c3d60989ce3b
+size 4781637360

model-00016-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e64b00a88037a606b09b8ab827b5d0703bdca4f8666bcc2e40e0d756434bf44d
+size 4781670360

model-00017-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b1d2c43082b332a5da00653d7c17244dadfe1299c14337554f912d3330258fb2
+size 4781670360

model-00018-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d2ad6d213787d874ccde62750484bfd5e1fdf33b62863da2ba955a6029ad6bdb
+size 4964101416

model-00019-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d804528c08be3efbde0a26499909600f03ee0f13b99aca6056f8613de86a681a
+size 4781637360

model-00020-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b252a6a39a2d5825795637f2c265f7172c6f56a6312498d59a378f609bfdf832
+size 4781670360

model-00021-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2e41f4ea0338eddec20fee6a234ee35b9b801186c2fd1e966d50e56762cd4d6b
+size 4781670360

model-00022-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:94f4457369a651bde095412937edd698565e50a5126d3319d13e89c2266baada
+size 4964101416

model-00023-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d84d84a2734e580a600b6d8bd3a99fe5352a05e856d1ecd18a59ed1971ac1a46
+size 4781637360

model-00024-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4f3c7dcc5f272bc183c66fa2f7982c8868598af05399a2db6bc27f4df7a5db57
+size 4781670360

model-00025-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c52c10a6b441be36e9792bdde497b733ece4f4e3a15c38f7c6063a882f54518c
+size 4781670360

model-00026-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb6d6bc9bf959796bfeae6e5266789649172e6869e600a4972ae7949eb0f2b0f
+size 4964101416

model-00027-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b4307c63f5181708b8be9effaeca9d4176046dacdc3fd33beffc3de40c7ccb17
+size 4781637360

model-00028-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3552187d3c9b1dae1b1839b60aee461a88506bf3de324f74fccab5498183f2ad
+size 4781670360

model-00029-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:bd55e4c8783ce82c68d4ee2e3fbfa50d6456f10039e509428f5d91e1e69efaf0
+size 4781670360

model-00030-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ea7839a9346ab5754c202110d0686e7d528eb7fbf8a430a8b1c07b263ed2ee3b
+size 3208747032

model-00031-of-00031.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7b23ce310f122819e85af06d64ed91c9327943cee4f11cc853d4775aa6a8a16f
+size 2491416704

model.safetensors.index.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a1b2faa7a18678ae6b7a633f3b7b39df1390b48c7ce2bde9bb74509cb1d7a4e3
+size 79025

special_tokens_map.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a6a53a38d0f1a08d04fae3ae1a48ce49b3d862b994ed5e4736ed7701cf9236bf
+size 616

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fab42efe8d17406525a9154b728cf9e957629a8ed7ce997770efdd71128c6a1a
+size 11422086

tokenizer_config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d9e3366bfb5f1dbda71cf68280e2c268efa8f1b5b043be229b9ca327d5546a22
+size 4895

vocab.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ca10d7e9fb3ed18575dd1e277a2579c16d108e32f27439684afa0e10b1440910
+size 2776833