jacobfulano
commited on
Commit
•
9e4d458
1
Parent(s):
d37bf0a
Update README.md
Browse files
README.md
CHANGED
@@ -65,6 +65,28 @@ from transformers import AutoTokenizer
|
|
65 |
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neox-20b")
|
66 |
```
|
67 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
68 |
## Model Description
|
69 |
|
70 |
The architecture is a modification of a standard decoder-only transformer.
|
@@ -94,8 +116,8 @@ The data was tokenized using the [EleutherAI/gpt-neox-20b](https://huggingface.c
|
|
94 |
|
95 |
_The following language is modified from [EleutherAI's GPT-NeoX-20B](https://huggingface.co/EleutherAI/gpt-neox-20b)_
|
96 |
|
97 |
-
MPT-7B-
|
98 |
-
MPT-7B-
|
99 |
While great efforts have been taken to clean the pretraining data, it is possible that this model could generate lewd, biased or otherwise offensive outputs.
|
100 |
|
101 |
|
|
|
65 |
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-neox-20b")
|
66 |
```
|
67 |
|
68 |
+
## Example Epilogue
|
69 |
+
|
70 |
+
**MPT-7B-StoryWriter**
|
71 |
+
|
72 |
+
>I have lived so long in the shadow of this dream that I may never see the bright sunlight of reality. I may look up some morning and find that I am six feet under, and that Gatsby, who gave me the dream and everything else, will have vanished behind me.
|
73 |
+
>
|
74 |
+
>And so it was. I had hardly crossed the threshold of the old world when my eye caught the headlines of a newspaper, and I knew at once that my dream was over. I knew that Gatsby was dead.
|
75 |
+
>
|
76 |
+
>And I knew that day that I didn't love her.
|
77 |
+
|
78 |
+
That night I took the last train for West Egg, and when I reached home I went directly to my attic and brought down all Gatsby's letters.
|
79 |
+
|
80 |
+
I have sorted them by date and placed them in the order in which they were written. They are very few in number.
|
81 |
+
|
82 |
+
They are dated between April of nineteen eighteen and January of nineteen nineteen, and the last one I have here is the one that told me he was dead.
|
83 |
+
|
84 |
+
There is something in that last letter that frightens me. It is the sense of a finality, of a completeness. I never heard of him after that, and I was glad.
|
85 |
+
|
86 |
+
But a few months ago I read somewhere that he had been seen in New York. He had become a great man.
|
87 |
+
|
88 |
+
And I knew that he had not changed at all.
|
89 |
+
|
90 |
## Model Description
|
91 |
|
92 |
The architecture is a modification of a standard decoder-only transformer.
|
|
|
116 |
|
117 |
_The following language is modified from [EleutherAI's GPT-NeoX-20B](https://huggingface.co/EleutherAI/gpt-neox-20b)_
|
118 |
|
119 |
+
MPT-7B-StoryWriter can produce factually incorrect output, and should not be relied on to produce factually accurate information.
|
120 |
+
MPT-7B-StoryWriter was trained on various public datasets.
|
121 |
While great efforts have been taken to clean the pretraining data, it is possible that this model could generate lewd, biased or otherwise offensive outputs.
|
122 |
|
123 |
|