Hugging Face's logo

MaziyarPanahi
/
reader-lm-1.5b-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
Model card Files Community
1
MaziyarPanahi commited on
Commit
3f04b72
•
1 Parent(s): df7dd7c

Upload folder using huggingface_hub (#1)

Browse files

- ffeeb43d00174b0a0a5f7960365264e95bfc1cb0dc9455a9f937828aad2733ee (7f01198130f392f17e35804395bce4142e804a41)
- efddeb9702e79e966224597972fb2f49c5dce154bcaae6765cc0540cfbcbe729 (78ecb5d91aa4c4944c26ed35e08d836c804008f4)
- 82964822ead575572f8491cb852c0bc4b85e715eff35bd136ff61b9df98aa118 (a04825aebcd02259196bfa6063241ea288e56da5)
- 041af9817f6798c1eab6c10bb0fc13e2cf94036b77ff9ba57f0d8fa26f5a147f (97727ea8c4c70d48d6eeece669df3320683ccf18)
- 521979261b069b40a333ce79d913fca92bacf88ee4774eced8d4b1450b8f1a7b (e2256af3d269ac68e6bf1d6a80b4cb5f6b1d80f9)
- 17abfaab413ec171dddbde8eb99eeccc6307b35856044c3e7167315c196f2652 (ae994b79a56264357b980a1d0691a2888d3fcdcc)
- fd8efffc8bf39ddffa2c4a77ebc9026cf58547bf5ff2202f836aba7994934907 (0e55b3392a17f0b501a6915a2f15fa98790b8706)
- 8b4aaf8d53a7e4131334609d53e05040c660acd63d696dc2eadba8a4a34961df (576e8324475dfae75170670fd0bacdba5775d986)
- 0a295e701a72d0e043f01dfdcff21092837b8a521d5b47ed9e2edcd89c7353c8 (c6977a0eea33865b816704f40e0f0b025e6e3933)
- b7d2266212f8c2882b4505d20b57d14ded08128526c7b3ed6af382e99fd67169 (89f130a9c6ab99f90d6dc3c52dd2bd96500c8262)

Files changed (19) hide show
  1. .gitattributes +17 -0
  2. README.md +46 -0
  3. reader-lm-1.5b-GGUF_imatrix.dat +3 -0
  4. reader-lm-1.5b.IQ1_M.gguf +3 -0
  5. reader-lm-1.5b.IQ1_S.gguf +3 -0
  6. reader-lm-1.5b.IQ2_XS.gguf +3 -0
  7. reader-lm-1.5b.IQ3_XS.gguf +3 -0
  8. reader-lm-1.5b.IQ4_XS.gguf +3 -0
  9. reader-lm-1.5b.Q2_K.gguf +3 -0
  10. reader-lm-1.5b.Q3_K_L.gguf +3 -0
  11. reader-lm-1.5b.Q3_K_M.gguf +3 -0
  12. reader-lm-1.5b.Q3_K_S.gguf +3 -0
  13. reader-lm-1.5b.Q4_K_M.gguf +3 -0
  14. reader-lm-1.5b.Q4_K_S.gguf +3 -0
  15. reader-lm-1.5b.Q5_K_M.gguf +3 -0
  16. reader-lm-1.5b.Q5_K_S.gguf +3 -0
  17. reader-lm-1.5b.Q6_K.gguf +3 -0
  18. reader-lm-1.5b.Q8_0.gguf +3 -0
  19. reader-lm-1.5b.fp16.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,20 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ reader-lm-1.5b-GGUF_imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ reader-lm-1.5b.IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ reader-lm-1.5b.IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ reader-lm-1.5b.IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ reader-lm-1.5b.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ reader-lm-1.5b.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ reader-lm-1.5b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
43
+ reader-lm-1.5b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ reader-lm-1.5b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ reader-lm-1.5b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ reader-lm-1.5b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ reader-lm-1.5b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
48
+ reader-lm-1.5b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
49
+ reader-lm-1.5b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ reader-lm-1.5b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
51
+ reader-lm-1.5b.fp16.gguf filter=lfs diff=lfs merge=lfs -text
52
+ reader-lm-1.5b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - quantized
4
+ - 2-bit
5
+ - 3-bit
6
+ - 4-bit
7
+ - 5-bit
8
+ - 6-bit
9
+ - 8-bit
10
+ - GGUF
11
+ - text-generation
12
+ - text-generation
13
+ model_name: reader-lm-1.5b-GGUF
14
+ base_model: jinaai/reader-lm-1.5b
15
+ inference: false
16
+ model_creator: jinaai
17
+ pipeline_tag: text-generation
18
+ quantized_by: MaziyarPanahi
19
+ ---
20
+ # [arcee-train/reader-lm-1.5b-GGUF](https://huggingface.co/arcee-train/reader-lm-1.5b-GGUF)
21
+ - Model creator: [jinaai](https://huggingface.co/jinaai)
22
+ - Original model: [jinaai/reader-lm-1.5b](https://huggingface.co/jinaai/reader-lm-1.5b)
23
+
24
+ ## Description
25
+ [arcee-train/reader-lm-1.5b-GGUF](https://huggingface.co/arcee-train/reader-lm-1.5b-GGUF) contains GGUF format model files for [jinaai/reader-lm-1.5b](https://huggingface.co/jinaai/reader-lm-1.5b).
26
+
27
+ ### About GGUF
28
+
29
+ GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
30
+
31
+ Here is an incomplete list of clients and libraries that are known to support GGUF:
32
+
33
+ * [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
34
+ * [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
35
+ * [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
36
+ * [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
37
+ * [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
38
+ * [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
39
+ * [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
40
+ * [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
41
+ * [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
42
+ * [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
43
+
44
+ ## Special thanks
45
+
46
+ 🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
reader-lm-1.5b-GGUF_imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24282803c2c22586428242b8a3956084b54b0223a9e5e8f55c577b32104ed2e3
3
+ size 2042190
reader-lm-1.5b.IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf2d7462b353b04bd2721bd140fb20d5c0a9ca1a20825fcf85aa7d8f8d3ca6d4
3
+ size 464458944
reader-lm-1.5b.IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a467d2bd6c61bdb8a299eae0766cf48c7bddb6c5629e429f3ff3026999d7ee67
3
+ size 436525248
reader-lm-1.5b.IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e50c56a69dec94156b6e0e7de70861e02aa5b41a0a94533a170dba202a56d2a0
3
+ size 550324416
reader-lm-1.5b.IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:de3f0b506e2b836f14d25eee1ab4db264cbc8c6e607872b52fc2b8e1de1863e6
3
+ size 731696832
reader-lm-1.5b.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bc4cce15539781a0341acc3976f28c315532346efcce8cae9b3f8b2077a3ada8
3
+ size 895729344
reader-lm-1.5b.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1c3fcebe9f6388168673c6bdfb37b43fb972128897743b6ca2f068705ee8ef66
3
+ size 676302528
reader-lm-1.5b.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:223b12755d9a9b8d58b80872ee4dfe9b230e8f1bbcc6655c32f744d190778e4b
3
+ size 880160448
reader-lm-1.5b.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c49105a8097b7591cc59c527a4e28ffa7269f5ebe57f7c59c14d59ab7d934bb4
3
+ size 824176320
reader-lm-1.5b.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78d9fbd0272367cc216d045e299324677ba67c1469372b6c6a7f316fb206d325
3
+ size 760942272
reader-lm-1.5b.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47bac4318a29fa2558c6920afe8832417ebb2c01d033f7ad37fd3f3e4ba5b9c1
3
+ size 986046144
reader-lm-1.5b.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:214dd03d99ebcf09ec95ad5681bef15b9e3a5d0360fdf71d6bec1d319d8e2920
3
+ size 940310208
reader-lm-1.5b.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea4264ad1859252bfde0a6524ddb879a93f772c4fe7cd3c5fcf11337e081d36a
3
+ size 1125048000
reader-lm-1.5b.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a79a55300157b3a86666d67cb2e89a561151b234600a5a90359d7552f0b1c599
3
+ size 1098727104
reader-lm-1.5b.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:77e9b503647a695bb04297e48d52731fb1554af162b2f2f71d61b432b57a6a01
3
+ size 1272737472
reader-lm-1.5b.Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09e9ff906fc69005d8647b96bf9556c332942c12ed249afdb90df3e5a46565d2
3
+ size 1646570688
reader-lm-1.5b.fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:71f04e7ccdedda52848920383dfd82a2ee4f1a9864e30025cee5bf2d5b461ad0
3
+ size 3093666784