mjbuehler commited on
Commit
80da32b
1 Parent(s): 3a2ea58

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -2
README.md CHANGED
@@ -21,8 +21,11 @@ Abstract: The study of biological materials and bio-inspired materials science i
21
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/623ce1c6b66fedf374859fe7/Xdp_nCYiF2IAPamG5ffIC.png)
22
 
23
  ```
24
- model = PeftModel.from_pretrained('lamm-mit/BioinspiredLLM')
25
- tokenizer = AutoTokenizer.from_pretrained(model_name)
 
 
 
26
  ```
27
 
28
  Variants of the model are included, featuring various GGUF versions for use withm llama.cpp, for instance. In LM Studio, choose the "ChatML" prompt template.
 
21
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/623ce1c6b66fedf374859fe7/Xdp_nCYiF2IAPamG5ffIC.png)
22
 
23
  ```
24
+ from transformers import AutoModelForCausalLM, AutoTokenizer
25
+ from accelerate import infer_auto_device_map
26
+
27
+ model = AutoModelForCausalLM.from_pretrained('lamm-mit/BioinspiredLLM')
28
+ tokenizer = AutoTokenizer.from_pretrained('lamm-mit/BioinspiredLLM')
29
  ```
30
 
31
  Variants of the model are included, featuring various GGUF versions for use withm llama.cpp, for instance. In LM Studio, choose the "ChatML" prompt template.