well, nothing. Just a test model, maybe good. you can use GGUF from my friend, he do many quant :)
https://huggingface.co/mradermacher/Inixion-2x8B-GGUF
thank for AWQ version, I didn't know that my model have AWQ version too:
- Downloads last month
- 13
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.