Hugging Face's logo

MykytaPetrenko
/
Hermes-3-Llama-3.1-8B-GPTQ-8bit

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
gptq
Model card Files Community
Edit model card

Model Card for Model ID

Model Details

Model Description

This repo contains GPTQ 8bit version of for NousResearch Hermes 3 - Llama-3.1 8B.

Downloads last month
7
Safetensors
Model size
2.87B params
Tensor type
I32
·
FP16
·
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.