Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
LWDCLS
/
Meta-Llama-3-8B-Instruct-GGUF-Imatrix-Request
like
2
Follow
LWDCLS Research
44
GGUF
Inference Endpoints
imatrix
conversational
License:
unlicense
Model card
Files
Files and versions
Community
1
Deploy
Use this model
Edit model card
Quant-Request #64
. |
Quant-Testing.
Downloads last month
192
GGUF
Model size
8.03B params
Architecture
llama
4-bit
IQ4_XS
Q4_K_S
Q4_K_M
5-bit
Q5_K_S
Q5_K_M
6-bit
Q6_K
8-bit
Q8_0
16-bit
BF16
F16
Inference API
Unable to determine this model's library. Check the
docs
.