casperhansen
/

llama-3-8b-instruct-awq

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

No model card

New: Create and edit this model card directly on the website!

Contribute a Model Card

Downloads last month: 144,327

Safetensors

Model size

1.98B params

Tensor type

I32

·

FP16

·

Space using casperhansen/llama-3-8b-instruct-awq 1