Hugging Face's logo

Open-Orca
/
Mistral-7B-OpenOrca

Text Generation
Transformers
PyTorch
English
mistral
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
32

Can you share the training configuration of Axolotl?

#24
by timlim123 - opened
Discussion
timlim123

What's the training script/config used for this?

It seems that axolotl does not support chat dataset well, I guess you did some customisation to their repo?

winglian
 OpenOrca org

The axolotl configuration is already shared in this repo. https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca/blob/main/configs/mistral-7b-oo-phase1.yml

winglian changed discussion status to closed
timlim123

@winglian can we directly use that config as the dataset set up is different?

Did you make edits to the code to run:
alpaca_w_system.load_open_orca_chatml

timlim123

All good, saw that you have added it into prompt strategies. Thanks for your work 👍💪

Sign up or log in to comment