README.md

---
base_model: westlake-repl/SaProt_35M_AF2
library_name: peft
---
# Base model: [westlake-repl/SaProt_35M_AF2](https://huggingface.co./westlake-repl/SaProt_35M_AF2)

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
This model is used to predict the spike receptor-binding domain (RBD) expression of SARSCoV-2 Omicron XBB.1.5 variants.

### Task type
protein level regression

### Dataset description
The dataset is from [Deep mutational scans of XBB.1.5 and BQ.1.1 reveal ongoing epistatic drift during SARSCoV-2 evolution](https://doi.org/10.1371/journal.ppat.1011901).
Label means the delta level of RBD expression (log-mean fluorescence intensity) compre to wildtype, 
ranging from minus infinity to positive infinity. Zero means wildtype expression, lager means higher expression and smaller means lower expression.
### Model input type
Amino acid sequence

### Performance
0.68 Spearman's ρ

### LoRA config
lora_dropout: 0.0

lora_alpha: 16

target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]

modules_to_save: ["classifier"]

### Training config
class: AdamW

betas: (0.9, 0.98)

weight_decay: 0.01

learning rate: 5e-4

epoch: 100

batch size: 200

precision: 16-mixed