Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
T3qm7xpExperiment26-7B-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Merge
mergekit
lazymergekit
automerger
Inference Endpoints
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
refs/pr/1
T3qm7xpExperiment26-7B-GGUF
1 contributor
History:
13 commits
MaziyarPanahi
c0334f92243aa8a69693629ca51aa28425b1ea3fa60c3fac09b89ed2921ee0c7
0f0b372
verified
7 months ago
.gitattributes
2.3 kB
d4e4dad5dbc2313af6f91a54c32dd9b316c4bf8c68b649f95d4cc79767000e9a
7 months ago
README.md
11.1 kB
c0334f92243aa8a69693629ca51aa28425b1ea3fa60c3fac09b89ed2921ee0c7
7 months ago
T3qm7xpExperiment26-7B.IQ3_XS.gguf
3.02 GB
LFS
354bc86a5a20c4e7954f41512a483c68b448d00ccae9d9070404a62880809d57
7 months ago
T3qm7xpExperiment26-7B.IQ4_XS.gguf
3.94 GB
LFS
df62823a4b09fcc5815c21f7c1db18050c5f4a7c1f146e1bebb4477e8aa33d1b
7 months ago
T3qm7xpExperiment26-7B.Q2_K.gguf
2.72 GB
LFS
2d9c1d4433625eb84237208b532a89017bc3b9645338a97bb126c0e09b72af1b
7 months ago
T3qm7xpExperiment26-7B.Q3_K_L.gguf
3.82 GB
LFS
6bf745d159ef5b8d8eee66f4f9a70064958facd616c2a2ec278a7c36a0f5eb21
7 months ago
T3qm7xpExperiment26-7B.Q3_K_M.gguf
3.52 GB
LFS
5785641201f2a2ef1c76bc6af673e79a95d06ce5992be7728e99c8188a54b9f9
7 months ago
T3qm7xpExperiment26-7B.Q3_K_S.gguf
3.16 GB
LFS
b134d25a33a387ad1e3d003ebd5684ee757f5fda965b12a2e9400a21248d7ef0
7 months ago
T3qm7xpExperiment26-7B.Q4_K_M.gguf
4.37 GB
LFS
8875ede09c3f4994f89c62a671a073d5b9e227e5873f33a9c487f7775d2d8561
7 months ago
T3qm7xpExperiment26-7B.Q4_K_S.gguf
4.14 GB
LFS
ef7d109b80cffe23f537001afd907035e71ac7b6d06545c264a977550c3d7151
7 months ago
T3qm7xpExperiment26-7B.Q5_K_M.gguf
5.13 GB
LFS
d1c0abc32e5bbaf8dbf5629e860b239d3624c274a35eefbba0a09d34fecc0f99
7 months ago
T3qm7xpExperiment26-7B.Q5_K_S.gguf
5 GB
LFS
f2b9377ad85975cc9e40bbf0c64b51e0c035c51ab609f3b85fb3e6926ae4d367
7 months ago
T3qm7xpExperiment26-7B.Q6_K.gguf
5.94 GB
LFS
d4e4dad5dbc2313af6f91a54c32dd9b316c4bf8c68b649f95d4cc79767000e9a
7 months ago
