Arki05 commited on
Commit
1312307
1 Parent(s): 14dd1ce

Update to new gguf-split for direct loading.

Browse files
README.md CHANGED
@@ -1,8 +1,13 @@
1
  ---
2
  license: apache-2.0
3
  ---
4
- Unofficial GGML Quantizations of Grok-1. Should just run with llama.cpp once the PR is merged.
 
5
 
6
  You need to merge the GGUF file using `gguf-split` before using them (there's already a PR to change this).
 
 
 
 
 
7
 
8
- For now only Q2_K Quant, others will follow soon.
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+
5
+ Unofficial GGUF Quantizations of Grok-1. Should just run with llama.cpp once the [PR- Add grok-1 support #6204](https://github.com/ggerganov/llama.cpp/pull/6204) is merged.
6
 
7
  You need to merge the GGUF file using `gguf-split` before using them (there's already a PR to change this).
8
+ The splits now use [PR: llama_model_loader: support multiple split/shard GGUFs](https://github.com/ggerganov/llama.cpp/pull/6187).
9
+ Therefore no merging using `gguf-split` is needed anymore.
10
+
11
+ For now only Q2_K Quant, others (Q3_K, Q4_K, Q5_K & Q6_K) are prepared waiting to upload.
12
+
13
 
 
grok-1-Q2_K-split-00001-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a6350402a806074ed2b12957f18b28bbde97289a4b2ee1ac522dfd51f89a356
3
- size 14898085728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1db56d899df9ed37cb1cc015aef0d5275020d6e940f8c5ed99db8c2fb34bb7c0
3
+ size 14898085760
grok-1-Q2_K-split-00002-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8ade204bf9bf3da2b0b00add6bae12ca2ca2869ffc4ee36acf2c398ac3f610fa
3
- size 13817626272
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:257be550ea42cb6878d2e041c95062e8866dc19292fac86c039147ff66db1be6
3
+ size 13817626304
grok-1-Q2_K-split-00003-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c215ece2e3c997b7a63e9a1410f7c1913346c15ff3779667eabcd584d26efce5
3
- size 13817626336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3e9001fdf252128c247989ca870c301ec586ce2d26e85757365d8d1416d13c18
3
+ size 13817626368
grok-1-Q2_K-split-00004-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3925e0a0a1133278be79ba71a3f62c6ff3c41002fb04f99dd7a64075fe04ebd2
3
  size 14223499008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:957d6174af4ae2618ada7bd594626deaed9b6622a926e2dd21e6efe47a3d337e
3
  size 14223499008
grok-1-Q2_K-split-00005-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2b839f964b053168c7f636e910ee948299afdea99562f98bdd7d71ba74f764c3
3
- size 14036180736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c60377303e347a08c8876d33a055757ce54345e82bacd850deafd87705d0024
3
+ size 14036180768
grok-1-Q2_K-split-00006-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4d834988a3e7b378d0dbbdb2410c591173dd283d0404940a6d1e031210fa0d45
3
- size 13838073568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8640abdd4d61201db7d19851f7b71b6c8541d1fd1b6280abd9718aed8f0d73e1
3
+ size 13838073600
grok-1-Q2_K-split-00007-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3ab1e1d0c6ad80d4ba15dddddd70afdc361879941538ffc2e72fa3954144e978
3
- size 13817626336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b248ad03b13dc8224753125411c3fa2c019bed0eb22c9756ba2ab8535e9b797c
3
+ size 13817626368
grok-1-Q2_K-split-00008-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7fdfc35bb56c1f33f5101361274f47744c80c2dfda3450cf3d6119cf13b43c24
3
  size 14137016064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48bef2547453453da432ad52fef9a053c134714f8678e57f6819c36ff1039493
3
  size 14137016064
grok-1-Q2_K-split-00009-of-00009.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3fd8972c199df5fb44bfaedaa359afcf654373458894044f8ed86090e4a2b77a
3
  size 3601887424
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb0bd4b2a0acbcbd6818b6e13aeb693d8d811c286008a9ad73d57aa43df1109c
3
  size 3601887424