File size: 461 Bytes
473569f 7c7e95c 473569f a92efa6 7c7e95c 473569f 7c7e95c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
---
library_name: transformers
tags:
- unsloth
- trl
- sft
---
## Interim-MN-fp16
![Interim](interim-1.png)
This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here.
Probably best if using normal Nemo settings, no weird stuff. |