Text Generation
Transformers
code
Eval Results
Inference Endpoints
Sergey Kostyaev commited on
Commit
ef61b10
1 Parent(s): e6ff521

Requantize models

Browse files

Requantize models after last changes in ggml repo

starcoderbase-ggml-q4_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3e5bcad4f976d904fc8f00e6cc53cb98dd3373a844ab9952a05b1a8f4fcfdf7e
3
- size 11916774288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8befb69d50f4d90c04c936c728a131b9cb688db953111d5bfe17c42e6b93fb7c
3
+ size 10746563472
starcoderbase-ggml-q4_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ab14d1fcfdb022fea06aa2afad71edf020b3aa64ec400caf637cc0584dd7d12e
3
- size 14257195920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcf19baa9c6a104e32e1f59a13376de2b0c2a599bfcbed7fd50f83586f7f958f
3
+ size 11916774288
starcoderbase-ggml-q5_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a7025e5ee3f87cd4a9b11ff005a7a2a3576ca230cac510840229bb3ba654b75
3
  size 13086985104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:238d3f83e4574956b04ba012105a9e0caa1703f8bfd9e03a3e7fc37496d87fdb
3
  size 13086985104
starcoderbase-ggml-q5_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ddc45a61045398f83078b28d846ee422f4a474ff7a02ace63b36bc376160a428
3
  size 14257195920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:892237b112d10590620addb39d2fa27f35329736446b58276e69dad6446cd3d5
3
  size 14257195920
starcoderbase-ggml-q8_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8dd001643dc10fc484bf8a2bb220a76478929d32dad7f6e7e7283b0d31aa17b6
3
- size 21278460816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d92d17680714b4e9ef197e6af9f4adcbce8ad5f158c027addea0ddacc0d261d7
3
+ size 20108250000