metadata
library_name: transformers
tags:
- unsloth
- trl
- sft
Interim-MN-fp16
This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here.
Probably best if using normal Nemo settings, no weird stuff. (Or just use the recommended ones in the Recommended Settings repo)