Generated README.md
Browse files
README.md
CHANGED
|
@@ -27,18 +27,22 @@ MPT-7B is part of the family of MosaicPretrainedTransformer (MPT) models, which
|
|
| 27 |
| [mpt-7b-chat-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-f16.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | F16 | GGML | V3 |
|
| 28 |
| [mpt-7b-chat-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q4_0 | GGML | V3 |
|
| 29 |
| [mpt-7b-chat-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0-ggjt.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q4_0 | GGJT | V3 |
|
|
|
|
| 30 |
| [mpt-7b-chat-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q5_1-ggjt.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q5_1 | GGJT | V3 |
|
| 31 |
| [mpt-7b-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-f16.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | F16 | GGML | V3 |
|
| 32 |
| [mpt-7b-instruct-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-f16.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | F16 | GGML | V3 |
|
| 33 |
| [mpt-7b-instruct-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q4_0 | GGML | V3 |
|
| 34 |
| [mpt-7b-instruct-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0-ggjt.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q4_0 | GGJT | V3 |
|
|
|
|
| 35 |
| [mpt-7b-instruct-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q5_1-ggjt.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q5_1 | GGJT | V3 |
|
| 36 |
| [mpt-7b-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q4_0 | GGML | V3 |
|
| 37 |
| [mpt-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0-ggjt.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q4_0 | GGJT | V3 |
|
|
|
|
| 38 |
| [mpt-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q5_1-ggjt.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q5_1 | GGJT | V3 |
|
| 39 |
| [mpt-7b-storywriter-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-f16.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | F16 | GGML | V3 |
|
| 40 |
| [mpt-7b-storywriter-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q4_0 | GGML | V3 |
|
| 41 |
| [mpt-7b-storywriter-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0-ggjt.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q4_0 | GGJT | V3 |
|
|
|
|
| 42 |
| [mpt-7b-storywriter-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q5_1-ggjt.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q5_1 | GGJT | V3 |
|
| 43 |
|
| 44 |
⚠️Caution⚠️: mpt-7b-storywriter is still under development!
|
|
|
|
| 27 |
| [mpt-7b-chat-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-f16.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | F16 | GGML | V3 |
|
| 28 |
| [mpt-7b-chat-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q4_0 | GGML | V3 |
|
| 29 |
| [mpt-7b-chat-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q4_0-ggjt.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q4_0 | GGJT | V3 |
|
| 30 |
+
| [mpt-7b-chat-q5_1.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q5_1.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q5_1 | GGML | V3 |
|
| 31 |
| [mpt-7b-chat-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-chat-q5_1-ggjt.bin) | [mosaicml/mpt-7b-chat](https://huggingface.co/mosaicml/mpt-7b-chat) | Q5_1 | GGJT | V3 |
|
| 32 |
| [mpt-7b-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-f16.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | F16 | GGML | V3 |
|
| 33 |
| [mpt-7b-instruct-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-f16.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | F16 | GGML | V3 |
|
| 34 |
| [mpt-7b-instruct-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q4_0 | GGML | V3 |
|
| 35 |
| [mpt-7b-instruct-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q4_0-ggjt.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q4_0 | GGJT | V3 |
|
| 36 |
+
| [mpt-7b-instruct-q5_1.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q5_1.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q5_1 | GGML | V3 |
|
| 37 |
| [mpt-7b-instruct-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-instruct-q5_1-ggjt.bin) | [mosaicml/mpt-7b-instruct](https://huggingface.co/mosaicml/mpt-7b-instruct) | Q5_1 | GGJT | V3 |
|
| 38 |
| [mpt-7b-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q4_0 | GGML | V3 |
|
| 39 |
| [mpt-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q4_0-ggjt.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q4_0 | GGJT | V3 |
|
| 40 |
+
| [mpt-7b-q5_1.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q5_1.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q5_1 | GGML | V3 |
|
| 41 |
| [mpt-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-q5_1-ggjt.bin) | [mosaicml/mpt-7b](https://huggingface.co/mosaicml/mpt-7b) | Q5_1 | GGJT | V3 |
|
| 42 |
| [mpt-7b-storywriter-f16.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-f16.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | F16 | GGML | V3 |
|
| 43 |
| [mpt-7b-storywriter-q4_0.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q4_0 | GGML | V3 |
|
| 44 |
| [mpt-7b-storywriter-q4_0-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q4_0-ggjt.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q4_0 | GGJT | V3 |
|
| 45 |
+
| [mpt-7b-storywriter-q5_1.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q5_1.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q5_1 | GGML | V3 |
|
| 46 |
| [mpt-7b-storywriter-q5_1-ggjt.bin](https://huggingface.co/rustformers/mpt-7b-ggml/blob/main/mpt-7b-storywriter-q5_1-ggjt.bin) | [mosaicml/mpt-7b-storywriter](https://huggingface.co/mosaicml/mpt-7b-storywriter) | Q5_1 | GGJT | V3 |
|
| 47 |
|
| 48 |
⚠️Caution⚠️: mpt-7b-storywriter is still under development!
|