init

.gitattributes

@@ -1,34 +1,36 @@
 *.7z filter=lfs diff=lfs merge=lfs -text
 *.arrow filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text
-*.bin.* filter=lfs diff=lfs merge=lfs -text
 *.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
 *.h5 filter=lfs diff=lfs merge=lfs -text
 *.joblib filter=lfs diff=lfs merge=lfs -text
 *.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 *.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
 *.onnx filter=lfs diff=lfs merge=lfs -text
 *.ot filter=lfs diff=lfs merge=lfs -text
 *.parquet filter=lfs diff=lfs merge=lfs -text
 *.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
 *.pth filter=lfs diff=lfs merge=lfs -text
 *.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
 saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
 *.tflite filter=lfs diff=lfs merge=lfs -text
 *.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
 *.xz filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
-*.zstandard filter=lfs diff=lfs merge=lfs -text
-*.tfevents* filter=lfs diff=lfs merge=lfs -text
-*.db* filter=lfs diff=lfs merge=lfs -text
-*.ark* filter=lfs diff=lfs merge=lfs -text
-**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
-**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
-**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
-*.safetensors filter=lfs diff=lfs merge=lfs -text
-*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+*.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,12 +1,57 @@
 ---
-#以下为文本生成的 "tasks"示例，您可以从此网页中了解更多相关信息：https://modelscope.cn/docs/%E4%BB%BB%E5%8A%A1%E7%9A%84%E4%BB%8B%E7%BB%8D
-#tasks:
-#- text-generation
-license: Apache License 2.0
+inference: false
+language:
+  - zh
+  - en
+license: other
+model_creator: baichuan-inc
+model_link: https://www.modelscope.cn/models/baichuan-inc/Baichuan2-7B-Chat
+model_name: Baichuan2-7B-Chat
+model_type: baichuan
+pipeline_tag: text-generation
+quantized_by: shaowenchen
+tasks:
+  - text2text-generation
+tags:
+  - gguf
+  - baichuan
+  - chinese
 ---
-###### 该模型当前使用的是默认介绍模版，处于“预发布”阶段，页面仅限所有者可见。
-###### 请根据[模型贡献文档说明](https://www.modelscope.cn/docs/%E5%A6%82%E4%BD%95%E6%92%B0%E5%86%99%E5%A5%BD%E7%94%A8%E7%9A%84%E6%A8%A1%E5%9E%8B%E5%8D%A1%E7%89%87)，及时完善模型卡片内容。ModelScope平台将在模型卡片完善后展示。谢谢您的理解。
-#### Clone with HTTP
-```bash
- git clone https://www.modelscope.cn/shaowenchen/baichuan2-7b-chat-gguf.git
-```
+
+## Provided files
+
+| Name                          | Quant method | Size   |
+| ----------------------------- | ------------ | ------ |
+| baichuan2-7b-chat.Q2_K.gguf   | Q2_K         | 3.0 GB |
+| baichuan2-7b-chat.Q3_K.gguf   | Q3_K         | 3.5 GB |
+| baichuan2-7b-chat.Q3_K_L.gguf | Q3_K_L       | 3.8 GB |
+| baichuan2-7b-chat.Q3_K_S.gguf | Q3_K_S       | 3.2 GB |
+| baichuan2-7b-chat.Q4_0.gguf   | Q4_0         | 4.1 GB |
+| baichuan2-7b-chat.Q4_1.gguf   | Q4_1         | 4.5 GB |
+| baichuan2-7b-chat.Q4_K.gguf   | Q4_K         | 4.3 GB |
+| baichuan2-7b-chat.Q4_K_S.gguf | Q4_K_S       | 4.1 GB |
+| baichuan2-7b-chat.Q5_0.gguf   | Q5_0         | 4.9 GB |
+| baichuan2-7b-chat.Q5_1.gguf   | Q5_1         | 5.3 GB |
+| baichuan2-7b-chat.Q5_K.gguf   | Q5_K         | 5.0 GB |
+| baichuan2-7b-chat.Q5_K_S.gguf | Q5_K_S       | 4.9 GB |
+| baichuan2-7b-chat.Q6_K.gguf   | Q6_K         | 5.7 GB |
+| baichuan2-7b-chat.Q8_0.gguf   | Q8_0         | 7.4 GB |
+| baichuan2-7b-chat.gguf        | full         | 14 GB  |
+
+## Provided images
+
+| Name                                        | Quant method | Size    |
+| ------------------------------------------- | ------------ | ------- |
+| `shaowenchen/baichuan2-7b-chat-gguf:Q2_K`   | Q2_K         | 7.59 GB |
+| `shaowenchen/baichuan2-7b-chat-gguf:Q3_K`   | Q3_K         | 8.61 GB |
+| `shaowenchen/baichuan2-7b-chat-gguf:Q3_K_L` | Q3_K_L       | 9.23 GB |
+| `shaowenchen/baichuan2-7b-chat-gguf:Q3_K_S` | Q3_K_S       | 7.93 GB |
+| `shaowenchen/baichuan2-7b-chat-gguf:Q4_0`   | Q4_0         | 9.6 GB  |
+
+Usage:
+
+```
+docker run --rm -p 8000:8000 shaowenchen/baichuan2-7b-chat-gguf:Q2_K
+```
+
+and you can view http://localhost:8000/docs to see the swagger UI.

configuration.json

@@ -0,0 +1,10 @@
+{
+    "framework": "pytorch",
+    "task": "text-generation",
+    "model": {
+        "type": "baichuan"
+    },
+    "pipeline": {
+        "type": "baichuan2-7b-chat-text-generation-pipe"
+    }
+}