Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen2.5-7B-Instruct-GGUF
like
7
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
b015bc5
Qwen2.5-7B-Instruct-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
5e18745403b6d85559abb00cd90cc5525272db9835c11e441993172f944b7cf4
b015bc5
verified
about 2 months ago
.gitattributes
2.2 kB
5e18745403b6d85559abb00cd90cc5525272db9835c11e441993172f944b7cf4
about 2 months ago
Qwen2.5-7B-Instruct-GGUF_imatrix.dat
4.54 MB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
about 2 months ago
Qwen2.5-7B-Instruct.IQ1_M.gguf
2.04 GB
LFS
bd8e65b52f4f53e23de01329b261b1719a296b83a1e4e4b08a4193edded1db51
about 2 months ago
Qwen2.5-7B-Instruct.IQ2_XS.gguf
2.47 GB
LFS
44c6a0b8f78825a3147de8de592c166ba11e8cc6f8c922b2da4449fed4a71e57
about 2 months ago
Qwen2.5-7B-Instruct.IQ3_XS.gguf
3.35 GB
LFS
d59be69841e6cb9d31e8cc0ed148704e163918c6724d4493e7bcdc9cf2beb8b8
about 2 months ago
Qwen2.5-7B-Instruct.IQ4_XS.gguf
4.22 GB
LFS
06292debb4788bcf595f31aac201dff738b4736fcead2dcfef54ca58f485b2a1
about 2 months ago
Qwen2.5-7B-Instruct.Q2_K.gguf
3.02 GB
LFS
cff37708b2fd6e0282a61b2bb2a53c6d799c97f6cd1ae9116beba2c3ec3506f5
about 2 months ago
Qwen2.5-7B-Instruct.Q3_K_L.gguf
4.09 GB
LFS
d3cedffa67593fb5c39b5de428aef59e3407ef79af5850a02c9b6fab593be9ff
about 2 months ago
Qwen2.5-7B-Instruct.Q3_K_M.gguf
3.81 GB
LFS
ef1f9f7b91c20401f0fa9926c0d070325576fb134d43d17ac8043f649421b82d
about 2 months ago
Qwen2.5-7B-Instruct.Q3_K_S.gguf
3.49 GB
LFS
42d222e934c07e4e9b99c5202d7027463a767f8b52fb34908150705193616d21
about 2 months ago
Qwen2.5-7B-Instruct.Q4_K_M.gguf
4.68 GB
LFS
5e18745403b6d85559abb00cd90cc5525272db9835c11e441993172f944b7cf4
about 2 months ago
