---
base_model: westlake-repl/SaProt_35M_AF2
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
This model is used to predict mutation fitness score of protein DLG4_RAT. 

### Task type
protein level regression
### Dataset description
The dataset is from [Deep generative models of genetic variation capture the effects of mutations](https://www.nature.com/articles/s41592-018-0138-4).
### Model input type
Amino acid sequence
### Performance
 0.70 Spearman's ρ

### LoRA config
lora_dropout: 0.0
lora_alpha: 16
target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]
modules_to_save: ["classifier"]

### Training config
class: AdamW

betas: (0.9, 0.98)

weight_decay: 0.01

learning rate: 1e-4

epoch: 50

batch size: 128

precision: 16-mixed