| library_name: transformers | |
| tags: | |
| - unsloth | |
| - trl | |
| - sft | |
| ## Interim-MN-fp16 | |
|  | |
| This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here. | |
| Probably best if using normal Nemo settings, no weird stuff. |