Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Nexesenex
/
MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF
like
68
GGUF
Inference Endpoints
imatrix
conversational
Model card
Files
Files and versions
Community
10
Deploy
Use this model
6cc0fdb
MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF
1 contributor
History:
73 commits
Nexesenex
Upload miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ3_S.gguf
6cc0fdb
verified
8 months ago
.gitattributes
3.74 kB
Upload miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ3_S.gguf
8 months ago
README.md
26.3 kB
Update README.md
8 months ago
miqu-1-70b-Requant-b1989-Q8_0.iMatrix_Wiki_c32_ch400.dat
24.9 MB
LFS
Upload miqu-1-70b-Requant-b1989-Q8_0.iMatrix_Wiki_c32_ch400.dat
10 months ago
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q2_K_S.gguf
23.6 GB
LFS
Upload miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q2_K_S.gguf
10 months ago
miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf
33.3 GB
LFS
Upload miqu-1-70b-Requant-b1989-iMat-c32_ch400-Q3_K_M.gguf
10 months ago
miqu-1-70b-Requant-b2007-iMat-c32_ch400-IQ2_XS.gguf
20.3 GB
LFS
Upload miqu-1-70b-Requant-b2007-iMat-c32_ch400-IQ2_XS.gguf
10 months ago
miqu-1-70b-Requant-b2007-iMat-c32_ch400-IQ3_XXS.gguf
27 GB
LFS
Upload miqu-1-70b-Requant-b2007-iMat-c32_ch400-IQ3_XXS.gguf
10 months ago
miqu-1-70b-Requant-b2007-iMat-c32_ch400-Q3_K_S.gguf
29.9 GB
LFS
Upload miqu-1-70b-Requant-b2007-iMat-c32_ch400-Q3_K_S.gguf
10 months ago
miqu-1-70b-Requant-b2007-iMat-c32_ch400-Q3_K_XS.gguf
28.3 GB
LFS
Upload miqu-1-70b-Requant-b2007-iMat-c32_ch400-Q3_K_XS.gguf
10 months ago
miqu-1-70b-Requant-b2035-iMat-c32_ch400-IQ2_XXS.gguf
18.3 GB
LFS
Upload miqu-1-70b-Requant-b2035-iMat-c32_ch400-IQ2_XXS.gguf
10 months ago
miqu-1-70b-Requant-b2035-iMat-c32_ch400-Q2_K.gguf
25.5 GB
LFS
Upload miqu-1-70b-Requant-b2035-iMat-c32_ch400-Q2_K.gguf
10 months ago
miqu-1-70b-Requant-b2035-iMat-c32_ch400-Q3_K_L.gguf
36.1 GB
LFS
Upload miqu-1-70b-Requant-b2035-iMat-c32_ch400-Q3_K_L.gguf
10 months ago
miqu-1-70b-Requant-b2035-iMat-c32_ch400-Q4_K_S.gguf
39.2 GB
LFS
Upload miqu-1-70b-Requant-b2035-iMat-c32_ch400-Q4_K_S.gguf
10 months ago
miqu-1-70b-Requant-b2116-iMat-c32_ch400-IQ1_S.gguf
14.2 GB
LFS
Upload miqu-1-70b-Requant-b2116-iMat-c32_ch400-IQ1_S.gguf
9 months ago
miqu-1-70b-Requant-b2128-iMat-c32_ch400-IQ1_S_v2.gguf
14.2 GB
LFS
Upload miqu-1-70b-Requant-b2128-iMat-c32_ch400-IQ1_S_v2.gguf
9 months ago
miqu-1-70b-Requant-b2131-iMat-c32_ch400-IQ1_S_v3.gguf
14.5 GB
LFS
Upload miqu-1-70b-Requant-b2131-iMat-c32_ch400-IQ1_S_v3.gguf
9 months ago
miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_ES.gguf
15.9 GB
LFS
Upload miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_ES.gguf
8 months ago
miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FS.gguf
14.2 GB
LFS
Upload miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_FS.gguf
8 months ago
miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_MS.gguf
15.6 GB
LFS
Upload miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_MS.gguf
8 months ago
miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_NS.gguf
15.1 GB
LFS
Upload miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_NS.gguf
8 months ago
miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_PS.gguf
14.6 GB
LFS
Upload miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_PS.gguf
8 months ago
miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf
14.5 GB
LFS
Upload miqu-1-70b-Requant-b2409-iMat-c512_ch600-IQ1_S_v5.gguf
8 months ago
miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ1_SR.gguf
16.6 GB
LFS
Upload miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ1_SR.gguf
8 months ago
miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ3_S.gguf
29.9 GB
LFS
Upload miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ3_S.gguf
8 months ago
miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ3_XS.gguf
28.3 GB
LFS
Upload miqu-1-70b-Requant-b2431-iMat-c512_ch600-IQ3_XS.gguf
8 months ago
