Update README.md
Browse files
README.md
CHANGED
@@ -11,9 +11,15 @@ Please refer to the [original model card](https://huggingface.co/hivemind/gpt-j-
|
|
11 |
## Usage
|
12 |
|
13 |
|
14 |
-
> **NOTE:** PRIOR to loading the model you need to "patch" it to be compatible with loading 8bit weights etc. See the original model card above for details on how to do this.
|
15 |
|
16 |
```python
|
|
|
|
|
|
|
|
|
|
|
|
|
17 |
|
18 |
tokenizer = AutoTokenizer.from_pretrained("ethzanalytics/gpt-j-6B-8bit-sharded")
|
19 |
|
|
|
11 |
## Usage
|
12 |
|
13 |
|
14 |
+
> **NOTE:** PRIOR to loading the model, you need to "patch" it to be compatible with loading 8bit weights etc. See the original model card above for details on how to do this.
|
15 |
|
16 |
```python
|
17 |
+
import transformers
|
18 |
+
from transformers import AutoTokenizer
|
19 |
+
|
20 |
+
"""
|
21 |
+
CODE TO PATCH GPTJForCausalLM GOES HERE
|
22 |
+
"""
|
23 |
|
24 |
tokenizer = AutoTokenizer.from_pretrained("ethzanalytics/gpt-j-6B-8bit-sharded")
|
25 |
|