AmelieSchreiber
commited on
Commit
•
d5f5792
1
Parent(s):
634f89e
Update README.md
Browse files
README.md
CHANGED
@@ -34,11 +34,8 @@ You may also need to run some `pip install` statements at the beginning of the s
|
|
34 |
```python
|
35 |
!pip install accelerate -U -q
|
36 |
```
|
37 |
-
|
38 |
-
|
39 |
-
[found here](https://github.com/Amelie-Schreiber/esm2_LoRA_binding_sites/tree/main). This version uses wandb sweeps for hyperparameter search.
|
40 |
-
However, it does not use class weighting.
|
41 |
-
|
42 |
```
|
43 |
{'eval_loss': 0.49476009607315063,
|
44 |
'eval_precision': 0.14372964169381108,
|
@@ -48,6 +45,11 @@ However, it does not use class weighting.
|
|
48 |
'epoch': 15.0}
|
49 |
```
|
50 |
|
|
|
|
|
|
|
|
|
|
|
51 |
### Framework versions
|
52 |
|
53 |
- PEFT 0.4.0
|
|
|
34 |
```python
|
35 |
!pip install accelerate -U -q
|
36 |
```
|
37 |
+
Try to improve upon these metrics by adjusting the hyperparameters:
|
38 |
+
```
|
|
|
|
|
|
|
39 |
```
|
40 |
{'eval_loss': 0.49476009607315063,
|
41 |
'eval_precision': 0.14372964169381108,
|
|
|
45 |
'epoch': 15.0}
|
46 |
```
|
47 |
|
48 |
+
A similar model can also be trained using the Github with a training script and conda env YAML, which can be
|
49 |
+
[found here](https://github.com/Amelie-Schreiber/esm2_LoRA_binding_sites/tree/main). This version uses wandb sweeps for hyperparameter search.
|
50 |
+
However, it does not use class weighting.
|
51 |
+
|
52 |
+
|
53 |
### Framework versions
|
54 |
|
55 |
- PEFT 0.4.0
|