Hugging Face's logo

Langboat
/
Mengzi3-13B-Base

Text Generation
Transformers
Safetensors
Chinese
English
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1

This Model Has Now Been Quantized In EXL2 Format.

#1
by Kquant03 - opened
Discussion
Kquant03

Here are the links for the quantized files.

https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw2.5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw3
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw3.5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw3.7
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.2
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.4
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.6
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw4.8
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw5.5
https://huggingface.co/blockblockblock/Mengzi3-13B-Base-bpw6

Sign up or log in to comment