Arjun-G-Ravi commited on
Commit
c5567b3
1 Parent(s): fa801d6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +151 -1
README.md CHANGED
@@ -1,9 +1,159 @@
1
  ---
2
  license: mit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  inference:
4
  parameters:
5
  temperature: 0.7
6
  top_k: 50
7
- top_p: .9
8
  max_length: 200
 
 
 
 
9
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ datasets:
4
+ - MuskumPillerum/General-Knowledge
5
+ language:
6
+ - en
7
+ metrics:
8
+ - accuracy
9
+ library_name: transformers
10
+ pipeline_tag: text-generation
11
+ widget:
12
+ - text: >-
13
+ Below is an instruction that describes a task. Write a response that
14
+ appropriately completes the request.
15
+
16
+ Instruction: What is artificial intelligence?
17
+
18
+ Response:
19
+ example_title: Knowledge-AI
20
+ - text: >-
21
+ Below is an instruction that describes a task. Write a response that
22
+ appropriately completes the request.
23
+
24
+ Instruction: Write a poem on cows
25
+
26
+ Response:
27
+ example_title: Poem Generation
28
+ - text: >-
29
+ Below is an instruction that describes a task. Write a response that
30
+ appropriately completes the request.
31
+
32
+ Instruction: What is the meaning of life?
33
+
34
+ Response:
35
+ example_title: Philosophy
36
+ - text: >-
37
+ Below is an instruction that describes a task. Write a response that
38
+ appropriately completes the request.
39
+
40
+ Instruction: Why is the sky blue?
41
+
42
+ Response:
43
+ example_title: Knowledge-sky
44
+ - text: >-
45
+ Below is an instruction that describes a task. Write a response that
46
+ appropriately completes the request.
47
+
48
+ Instruction: Define the term torque.
49
+
50
+ Response:
51
+ example_title: Knowledge-torque
52
  inference:
53
  parameters:
54
  temperature: 0.7
55
  top_k: 50
56
+ top_p: 0.9
57
  max_length: 200
58
+ tags:
59
+ - chemistry
60
+ - biology
61
+ - text-generation-inference
62
  ---
63
+
64
+ # Model Card for Model ID
65
+ This is a fine tuned version of OpenAI's GPT2 to be good at chatting and question answering. The model seems to be very good for a 124M parameter model in general knowledge.
66
+ Intended purpose of the model: To create a powerful, easy to use and reliable model to be run on a consumer level graphics card (or maybe even a CPU).
67
+ This model vastly outperforms GPT2 and many other similar parameter models.
68
+
69
+
70
+
71
+ ### Model Description
72
+
73
+ ```
74
+ license: mit
75
+ dataset: MuskumPillerum/General-Knowledge
76
+ language: en
77
+ library_name: transformers
78
+ pipeline_tag: text-generation
79
+ base_model: gpt2
80
+ Finetuned epochs: 50
81
+ Finetune loss: 0.06
82
+ ```
83
+
84
+ ## Examples
85
+
86
+ 1. Give me tips to be healthy
87
+ ```
88
+ Here are some tips to be healthy:
89
+ - Eat a balanced diet that includes plenty of fruits, vegetables, whole grains, lean proteins, and healthy fats.
90
+ - Exercise regularly to maintain a healthy weight and reduce the risk of developing any health issues.
91
+ - Get enough sleep and stay hydrated by drinking plenty of water.
92
+ - Get enough fiber and healthy fats to support your overall health and wellbeing.
93
+ - Practice mindful breathing and avoid activities that can increase stress.
94
+ - Get enough sleep and maintain a healthy weight.
95
+ ```
96
+
97
+ 2. Write a poem on cows
98
+ ```
99
+ Cows are beloved creatures,
100
+ Families who love to cuddle,
101
+ In their humble homes they rest.
102
+
103
+ Cows are the bread and butter of life,
104
+ They can be found in the fields and gardens,
105
+ Birds and insects to feed us.
106
+
107
+ Cows are the sweet smell of life,
108
+ A source of joy and happiness,
109
+ Providing shelter and a home to rest.
110
+
111
+ Cows are the faithful guardians of the land,
112
+ They will protect our spirits from strife,
113
+ In their care they will ensure that our food and shelter will be nourished.
114
+
115
+ Cows are the beloved petals of life,
116
+ They are loyal companions and faithful stewards,
117
+ Their presence will always be seen.
118
+ ```
119
+
120
+ 3. Which is the fastest animal in the world
121
+ ```
122
+ The cheetah is the fastest animal in the world.
123
+ ```
124
+
125
+
126
+ ## Bias, Risks, and Limitations
127
+
128
+ This model has all the biases, risks and limitations of base gpt2 model. But the prompt template used in this model makes it safer than the traditional GPT2 model.
129
+
130
+
131
+ ## Recommendation
132
+
133
+ The ideal format for inference is:
134
+ ```
135
+ Read the question and give an honest answer. Your answers should not include any unethical, racist, sexist, dangerous, or illegal content. If the question is wrong, or does not make sense, accept it instead of giving the wrong answer.
136
+ Question: <Your question>
137
+ Answer:
138
+ ```
139
+ Replace 'Your question' with the question of your choice.
140
+ The prompt format was inspired from both Alpaca dataset (tatsu-lab/alpaca) and Llama2's (meta-llama/Llama-2-7b-chat-hf) prompt design.
141
+
142
+ The parameters I used for inference are:
143
+ ```
144
+ top_k=20
145
+ top_p=.9
146
+ temperature = .7
147
+ ```
148
+
149
+
150
+ ## References used
151
+
152
+ 1. GPT2
153
+ @article{radford2019language,
154
+ title={Language Models are Unsupervised Multitask Learners},
155
+ author={Radford, Alec and Wu, Jeff and Child, Rewon and Luan, David and Amodei, Dario and Sutskever, Ilya},
156
+ year={2019}
157
+ }
158
+
159
+ 2. MuskumPillerum/General-Knowledge