Hugging Face's logo
Munish Kumar's picture
42 5 417

Munish Kumar

munish0838
21world's profile picture Txico's profile picture rreed-pha's profile picture
·
https://hf.co/QuantFactory

AI & ML interests

LLM Quantizations

Recent Activity

liked a dataset about 12 hours ago
munish0838/cuad_vqa
liked a model 4 days ago
QuantFactory/Llama-3.1-8B-ArliAI-RPMax-v1.3-GGUF
liked a model 4 days ago
QuantFactory/Qwen2.5-Gutenberg-Doppel-14B-GGUF

Organizations

Blog-explorers's profile picture Indic Benchmarks's profile picture Quant Factory's profile picture Data Is Better Together's profile picture Hugging Face Discord Community's profile picture Dataset Tools's profile picture Data Is Better Together Contributor's profile picture

munish0838's activity

New activity in QuantFactory/Ministral-3b-instruct-GGUF about 1 month ago

Heads up: this isn't the new ministral 3b

2
#1 opened about 1 month ago by bartowski
New activity in QuantFactory/LLAMA-3_8B_Unaligned_BETA-GGUF about 1 month ago

Requesting Re-Quant. Tokenizer Updated with better chatml Support

1
#1 opened about 1 month ago by Luni
New activity in QuantFactory/quant-req 3 months ago

Update app.py
#2 opened 3 months ago by munish0838
New activity in QuantFactory/Mistral-Nemo-Instruct-2407-GGUF 4 months ago

Error loading model in llama.cpp ?

8
#1 opened 4 months ago by ubergarm
New activity in QuantFactory/internistai-base-7b-v0.2-GGUF 4 months ago

Add paper and citation
#1 opened 4 months ago by maximegmd
New activity in munish0838/Gemma2-9b-Matter-0.1-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in munish0838/Phi-3-mini-4k-instruct-Matter-0.1-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in munish0838/llama-3-8b-Instruct-Matter-0.1-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in munish0838/Mistral-v0.3-Instruct-Matter-Slim-A 5 months ago

Adding `safetensors` variant of this model
#1 opened 5 months ago by SFconvertbot
New activity in instruction-pretrain/medicine-Llama3-8B 5 months ago

Tokenizer files missing

4
#2 opened 5 months ago by munish0838

Unable to use model

2
#1 opened 5 months ago by munish0838
New activity in QuantFactory/dolphin-2.9-llama3-8b-GGUF 6 months ago

What am I doing wrong? Using Oobabooga.

3
#1 opened 7 months ago by Goldenblood56

does not appear to have a file named config.json

2
#2 opened 7 months ago by atubong
New activity in QuantFactory/Meta-Llama-3-8B-Instruct-GGUF 6 months ago

Compatibility with llama-cpp and Ollama

6
#17 opened 6 months ago by liashchynskyi
New activity in QuantFactory/Llama-3-Alpha-Ko-8B-Instruct-GGUF 6 months ago

Is the original model allganize/Llama-3-Alpha-Ko-8B-Instruct?

3
#1 opened 6 months ago by coconut00
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 6 months ago

error when loading the model

5
#3 opened 6 months ago by StefanStroescu
New activity in mistralai/Codestral-22B-v0.1 6 months ago

How to convert to HF format?

5
#6 opened 6 months ago by ddh0
New activity in internlm/internlm2-math-plus-1_8b 6 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 6 months ago by munish0838
New activity in internlm/internlm2-math-plus-7b 6 months ago

Rename configuration_internlm.py to configuration_internlm2.py
#1 opened 6 months ago by munish0838
New activity in QuantFactory/Phi-3-mini-128k-instruct-GGUF 6 months ago

I have now tried two quantizations 8_0, and 6_K, they both fail like you see below.

3
#2 opened 7 months ago by BigDeeper