Hugging Face's logo

MaziyarPanahi
/
GritLM-8x7B-GGUF

Text Generation
Transformers
GGUF
PyTorch
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
mteb
conversational
custom_code
dataset:GritLM/tulu2
arxiv:2402.09906
Eval Results
Inference Endpoints
text-generation-inference
Model card Files Community
1
GritLM-8x7B-GGUF / GritLM-8x7B.Q4_K_M.gguf

Commit History

Upload folder using huggingface_hub
f11bb0d
verified

MaziyarPanahi commited on