shimmyshimmer commited on
Commit
8ff3198
·
verified ·
1 Parent(s): e9546a2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +75 -3
README.md CHANGED
@@ -82,6 +82,54 @@ A huge thank you to the DeepSeek team for creating and releasing these models.
82
 
83
 
84
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
  ## 1. Introduction
86
 
87
  We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1.
@@ -92,6 +140,8 @@ we introduce DeepSeek-R1, which incorporates cold-start data before RL.
92
  DeepSeek-R1 achieves performance comparable to OpenAI-o1 across math, code, and reasoning tasks.
93
  To support the research community, we have open-sourced DeepSeek-R1-Zero, DeepSeek-R1, and six dense models distilled from DeepSeek-R1 based on Llama and Qwen. DeepSeek-R1-Distill-Qwen-32B outperforms OpenAI-o1-mini across various benchmarks, achieving new state-of-the-art results for dense models.
94
 
 
 
95
  <p align="center">
96
  <img width="80%" src="figures/benchmark.jpg">
97
  </p>
@@ -128,7 +178,7 @@ To support the research community, we have open-sourced DeepSeek-R1-Zero, DeepSe
128
  </div>
129
 
130
  DeepSeek-R1-Zero & DeepSeek-R1 are trained based on DeepSeek-V3-Base.
131
- For more details regrading the model architecture, please refer to [DeepSeek-V3](https://github.com/deepseek-ai/DeepSeek-V3) repository.
132
 
133
  ### DeepSeek-R1-Distill Models
134
 
@@ -227,7 +277,20 @@ For instance, you can easily start a service using [vLLM](https://github.com/vll
227
  vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
228
  ```
229
 
230
- **NOTE: We recommend setting an appropriate temperature (between 0.5 and 0.7) when running these models, otherwise you may encounter issues with endless repetition or incoherent output.**
 
 
 
 
 
 
 
 
 
 
 
 
 
231
 
232
  ## 7. License
233
  This code repository and the model weights are licensed under the [MIT License](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE).
@@ -238,8 +301,17 @@ DeepSeek-R1 series support commercial use, allow for any modifications and deriv
238
 
239
  ## 8. Citation
240
  ```
 
 
 
 
 
 
 
 
 
241
 
242
  ```
243
 
244
  ## 9. Contact
245
- If you have any questions, please raise an issue or contact us at [[email protected]]([email protected]).
 
82
 
83
 
84
 
85
+ # DeepSeek-R1
86
+ <!-- markdownlint-disable first-line-h1 -->
87
+ <!-- markdownlint-disable html -->
88
+ <!-- markdownlint-disable no-duplicate-header -->
89
+
90
+ <div align="center">
91
+ <img src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/logo.svg?raw=true" width="60%" alt="DeepSeek-V3" />
92
+ </div>
93
+ <hr>
94
+ <div align="center" style="line-height: 1;">
95
+ <a href="https://www.deepseek.com/" target="_blank" style="margin: 2px;">
96
+ <img alt="Homepage" src="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/badge.svg?raw=true" style="display: inline-block; vertical-align: middle;"/>
97
+ </a>
98
+ <a href="https://chat.deepseek.com/" target="_blank" style="margin: 2px;">
99
+ <img alt="Chat" src="https://img.shields.io/badge/🤖%20Chat-DeepSeek%20R1-536af5?color=536af5&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
100
+ </a>
101
+ <a href="https://huggingface.co/deepseek-ai" target="_blank" style="margin: 2px;">
102
+ <img alt="Hugging Face" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-DeepSeek%20AI-ffc107?color=ffc107&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
103
+ </a>
104
+ </div>
105
+
106
+ <div align="center" style="line-height: 1;">
107
+ <a href="https://discord.gg/Tc7c45Zzu5" target="_blank" style="margin: 2px;">
108
+ <img alt="Discord" src="https://img.shields.io/badge/Discord-DeepSeek%20AI-7289da?logo=discord&logoColor=white&color=7289da" style="display: inline-block; vertical-align: middle;"/>
109
+ </a>
110
+ <a href="https://github.com/deepseek-ai/DeepSeek-V2/blob/main/figures/qr.jpeg?raw=true" target="_blank" style="margin: 2px;">
111
+ <img alt="Wechat" src="https://img.shields.io/badge/WeChat-DeepSeek%20AI-brightgreen?logo=wechat&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
112
+ </a>
113
+ <a href="https://twitter.com/deepseek_ai" target="_blank" style="margin: 2px;">
114
+ <img alt="Twitter Follow" src="https://img.shields.io/badge/Twitter-deepseek_ai-white?logo=x&logoColor=white" style="display: inline-block; vertical-align: middle;"/>
115
+ </a>
116
+ </div>
117
+
118
+ <div align="center" style="line-height: 1;">
119
+ <a href="https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE-CODE" style="margin: 2px;">
120
+ <img alt="Code License" src="https://img.shields.io/badge/Code_License-MIT-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>
121
+ </a>
122
+ <a href="https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE-MODEL" style="margin: 2px;">
123
+ <img alt="Model License" src="https://img.shields.io/badge/Model_License-Model_Agreement-f5de53?&color=f5de53" style="display: inline-block; vertical-align: middle;"/>
124
+ </a>
125
+ </div>
126
+
127
+
128
+ <p align="center">
129
+ <a href="https://github.com/deepseek-ai/DeepSeek-R1/blob/main/DeepSeek_R1.pdf"><b>Paper Link</b>👁️</a>
130
+ </p>
131
+
132
+
133
  ## 1. Introduction
134
 
135
  We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1.
 
140
  DeepSeek-R1 achieves performance comparable to OpenAI-o1 across math, code, and reasoning tasks.
141
  To support the research community, we have open-sourced DeepSeek-R1-Zero, DeepSeek-R1, and six dense models distilled from DeepSeek-R1 based on Llama and Qwen. DeepSeek-R1-Distill-Qwen-32B outperforms OpenAI-o1-mini across various benchmarks, achieving new state-of-the-art results for dense models.
142
 
143
+ **NOTE: Before running DeepSeek-R1 series models locally, we kindly recommend reviewing the [Usage Recommendation](#usage-recommendations) section.**
144
+
145
  <p align="center">
146
  <img width="80%" src="figures/benchmark.jpg">
147
  </p>
 
178
  </div>
179
 
180
  DeepSeek-R1-Zero & DeepSeek-R1 are trained based on DeepSeek-V3-Base.
181
+ For more details regarding the model architecture, please refer to [DeepSeek-V3](https://github.com/deepseek-ai/DeepSeek-V3) repository.
182
 
183
  ### DeepSeek-R1-Distill Models
184
 
 
277
  vllm serve deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --tensor-parallel-size 2 --max-model-len 32768 --enforce-eager
278
  ```
279
 
280
+ You can also easily start a service using [SGLang](https://github.com/sgl-project/sglang)
281
+
282
+ ```bash
283
+ python3 -m sglang.launch_server --model deepseek-ai/DeepSeek-R1-Distill-Qwen-32B --trust-remote-code --tp 2
284
+ ```
285
+
286
+ ### Usage Recommendations
287
+
288
+ **We recommend adhering to the following configurations when utilizing the DeepSeek-R1 series models, including benchmarking, to achieve the expected performance:**
289
+
290
+ 1. Set the temperature within the range of 0.5-0.7 (0.6 is recommended) to prevent endless repetitions or incoherent outputs.
291
+ 2. **Avoid adding a system prompt; all instructions should be contained within the user prompt.**
292
+ 3. For mathematical problems, it is advisable to include a directive in your prompt such as: "Please reason step by step, and put your final answer within \boxed{}."
293
+ 4. When evaluating model performance, it is recommended to conduct multiple tests and average the results.
294
 
295
  ## 7. License
296
  This code repository and the model weights are licensed under the [MIT License](https://github.com/deepseek-ai/DeepSeek-R1/blob/main/LICENSE).
 
301
 
302
  ## 8. Citation
303
  ```
304
+ @misc{deepseekai2025deepseekr1incentivizingreasoningcapability,
305
+ title={DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning},
306
+ author={DeepSeek-AI and Daya Guo and Dejian Yang and Haowei Zhang and Junxiao Song and Ruoyu Zhang and Runxin Xu and Qihao Zhu and Shirong Ma and Peiyi Wang and Xiao Bi and Xiaokang Zhang and Xingkai Yu and Yu Wu and Z. F. Wu and Zhibin Gou and Zhihong Shao and Zhuoshu Li and Ziyi Gao and Aixin Liu and Bing Xue and Bingxuan Wang and Bochao Wu and Bei Feng and Chengda Lu and Chenggang Zhao and Chengqi Deng and Chenyu Zhang and Chong Ruan and Damai Dai and Deli Chen and Dongjie Ji and Erhang Li and Fangyun Lin and Fucong Dai and Fuli Luo and Guangbo Hao and Guanting Chen and Guowei Li and H. Zhang and Han Bao and Hanwei Xu and Haocheng Wang and Honghui Ding and Huajian Xin and Huazuo Gao and Hui Qu and Hui Li and Jianzhong Guo and Jiashi Li and Jiawei Wang and Jingchang Chen and Jingyang Yuan and Junjie Qiu and Junlong Li and J. L. Cai and Jiaqi Ni and Jian Liang and Jin Chen and Kai Dong and Kai Hu and Kaige Gao and Kang Guan and Kexin Huang and Kuai Yu and Lean Wang and Lecong Zhang and Liang Zhao and Litong Wang and Liyue Zhang and Lei Xu and Leyi Xia and Mingchuan Zhang and Minghua Zhang and Minghui Tang and Meng Li and Miaojun Wang and Mingming Li and Ning Tian and Panpan Huang and Peng Zhang and Qiancheng Wang and Qinyu Chen and Qiushi Du and Ruiqi Ge and Ruisong Zhang and Ruizhe Pan and Runji Wang and R. J. Chen and R. L. Jin and Ruyi Chen and Shanghao Lu and Shangyan Zhou and Shanhuang Chen and Shengfeng Ye and Shiyu Wang and Shuiping Yu and Shunfeng Zhou and Shuting Pan and S. S. Li and Shuang Zhou and Shaoqing Wu and Shengfeng Ye and Tao Yun and Tian Pei and Tianyu Sun and T. Wang and Wangding Zeng and Wanjia Zhao and Wen Liu and Wenfeng Liang and Wenjun Gao and Wenqin Yu and Wentao Zhang and W. L. Xiao and Wei An and Xiaodong Liu and Xiaohan Wang and Xiaokang Chen and Xiaotao Nie and Xin Cheng and Xin Liu and Xin Xie and Xingchao Liu and Xinyu Yang and Xinyuan Li and Xuecheng Su and Xuheng Lin and X. Q. Li and Xiangyue Jin and Xiaojin Shen and Xiaosha Chen and Xiaowen Sun and Xiaoxiang Wang and Xinnan Song and Xinyi Zhou and Xianzu Wang and Xinxia Shan and Y. K. Li and Y. Q. Wang and Y. X. Wei and Yang Zhang and Yanhong Xu and Yao Li and Yao Zhao and Yaofeng Sun and Yaohui Wang and Yi Yu and Yichao Zhang and Yifan Shi and Yiliang Xiong and Ying He and Yishi Piao and Yisong Wang and Yixuan Tan and Yiyang Ma and Yiyuan Liu and Yongqiang Guo and Yuan Ou and Yuduan Wang and Yue Gong and Yuheng Zou and Yujia He and Yunfan Xiong and Yuxiang Luo and Yuxiang You and Yuxuan Liu and Yuyang Zhou and Y. X. Zhu and Yanhong Xu and Yanping Huang and Yaohui Li and Yi Zheng and Yuchen Zhu and Yunxian Ma and Ying Tang and Yukun Zha and Yuting Yan and Z. Z. Ren and Zehui Ren and Zhangli Sha and Zhe Fu and Zhean Xu and Zhenda Xie and Zhengyan Zhang and Zhewen Hao and Zhicheng Ma and Zhigang Yan and Zhiyu Wu and Zihui Gu and Zijia Zhu and Zijun Liu and Zilin Li and Ziwei Xie and Ziyang Song and Zizheng Pan and Zhen Huang and Zhipeng Xu and Zhongyu Zhang and Zhen Zhang},
307
+ year={2025},
308
+ eprint={2501.12948},
309
+ archivePrefix={arXiv},
310
+ primaryClass={cs.CL},
311
+ url={https://arxiv.org/abs/2501.12948},
312
+ }
313
 
314
  ```
315
 
316
  ## 9. Contact
317
+ If you have any questions, please raise an issue or contact us at [[email protected]]([email protected]).