RichardErkhov commited on
Commit
795fab9
·
verified ·
1 Parent(s): 70c9f3b

uploaded readme

Browse files
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Quantization made by Richard Erkhov.
2
+
3
+ [Github](https://github.com/RichardErkhov)
4
+
5
+ [Discord](https://discord.gg/pvy7H8DZMG)
6
+
7
+ [Request more models](https://github.com/RichardErkhov/quant_request)
8
+
9
+
10
+ OPT-1.3B-SFT-DSChatLoRA - AWQ
11
+ - Model creator: https://huggingface.co/kaitchup/
12
+ - Original model: https://huggingface.co/kaitchup/OPT-1.3B-SFT-DSChatLoRA/
13
+
14
+
15
+
16
+
17
+ Original model description:
18
+ ---
19
+ license: cc-by-nc-sa-4.0
20
+ datasets:
21
+ - Dahoas/rm-static
22
+ - Dahoas/synthetic-instruct-gptj-pairwise
23
+ - Anthropic/hh-rlhf
24
+ language:
25
+ - en
26
+ ---
27
+
28
+ # Model Card for Model ID
29
+
30
+ This a model is a fine-tuned with SFT using DeepSpeed Chat.
31
+ It is based on OPT-1.3M.B
32
+
33
+ ## Model Details
34
+
35
+ ### Model Description
36
+
37
+ - **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
38
+ - **Model type:** Causal
39
+ - **Language(s) (NLP):** English
40
+ - **License:** cc-by-nc-sa-4.0
41
+ - **Finetuned from model:** [facebook/opt-1.3b](https://huggingface.co/facebook/opt-1.3b)
42
+
43
+ ### Model Sources
44
+
45
+ The model has been trained with the procedure described in this article:
46
+
47
+ [Train Instruct LLMs On Your GPU with DeepSpeed Chat — Step #1: Supervised Fine-tuning](https://kaitchup.substack.com/p/train-instruct-llms-on-your-gpu-with)
48
+