finetune sample data and script.
pip install transformers
pip install datasets
pip install peft
pip install trl
pip install auto-gptq
pip install optimum
Sorry, But When I tried to install a new clean environment, it seems that it has stopped working due to some version difference. It might be better to wait until the stable version comes out. The documentation says to install from source, but in rare cases it may stop working.
- finetune.py gptq finetune sample file.
- jawiki3.csv sample data.(Japanese)
- lora_test.py after finetune, you can use lora with this script.