Hugging Face's logo
Matthew Douglas's picture
TFLOPS icon 189.2 TFLOPS
6 34 182

Matthew Douglas

mdouglas
julien-c's profile picture Malko18's profile picture malavwarke's profile picture
·

AI & ML interests

LLMs, quantization, NLP, embeddings, hardware, DevEx

Articles

Organizations

Hugging Face's profile picture Hugging Face Discord Community's profile picture LLHF's profile picture llmc's profile picture SLLHF's profile picture Hugging Quants's profile picture blhf's profile picture

mdouglas's activity

New activity in hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16 about 2 months ago

update the config.json and the weights

1
#1 opened 3 months ago by Rudra-ai
New activity in google/gemma-2-27b-it 3 months ago

4 bit and 8 bit bnb quants only generate empty strings or one token repeated endlessly

1
#32 opened 4 months ago by nicorinn-google

4bit-quantized gemma-2-27b-it generates only pad tokens, like '<pad><pad><pad><pad><pad><pad><pad><pad><pad>'.

3
#29 opened 4 months ago by kshinoda

Update bitsandbytes examples

1
#33 opened 3 months ago by mdouglas
New activity in hugging-quants/Meta-Llama-3.1-8B-BNB-NF4 4 months ago

Update `license`
#1 opened 4 months ago by alvarobartt
New activity in mdouglas/guanamyra-small 12 months ago

Adding `safetensors` variant of this model
#1 opened 12 months ago by SFconvertbot