README.md

---
library_name: transformers
tags:
- unsloth
- trl
- sft
---

## Interim-MN-fp16

![Interim](interim-1.png)

This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here.

Probably best if using normal Nemo settings, no weird stuff. (Or just use the recommended ones in the [Recommended Settings repo](https://huggingface.co/Quant-Cartel/Recommended-Settings/tree/main/Interim-MN))

[iMat GGUFs courtesy of your local Cartel frens](https://huggingface.co/Quant-Cartel/Interim-MN-iMat-GGUF)