duyntnet/GritLM-7B-imatrix-GGUF

Quantizations of https://huggingface.co/GritLM/GritLM-7B

From original readme

Model Summary

GritLM is a generative representational instruction tuned language model. It unifies text representation (embedding) and text generation into a single model achieving state-of-the-art performance on both types of tasks.

• Repository: ContextualAI/gritlm
• Paper: https://arxiv.org/abs/2402.09906
• Logs: https://wandb.ai/muennighoff/gritlm/runs/0uui712t/overview
• Script: https://github.com/ContextualAI/gritlm/blob/main/scripts/training/train_gritlm_7b.sh

Model	Description
GritLM 7B	Mistral 7B finetuned using GRIT
GritLM 8x7B	Mixtral 8x7B finetuned using GRIT

Use

The model usage is documented here.