File size: 307 Bytes
fe8f70a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
---
license: mit
---

## Run Inf

```bash
!git clone https://github.com/huggingface/transformers.git
%cd transformers
!git checkout <commit_id_for_4.47.0.dev0>
!pip install -q .
!pip install -q accelerate==0.34.2 bitsandbytes==0.44.1 peft==0.13.1
```

```py
model_id = 'Ahanaas/Zephyr_7b_Finetuned_role'
```