doberst commited on
Commit
404490b
1 Parent(s): a56b00b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -1
README.md CHANGED
@@ -1,8 +1,36 @@
1
  ---
2
  license: other
 
 
3
  ---
4
 
 
 
 
 
5
  This model is licensed under MRL (Mistral Research License), which can be found [here](https://mistral.ai/licenses/MRL-0.1.md). Per this license, this model is available only for research.
6
 
7
- We are including in the Model Depot collection for AI PC primarily for testing the ability to run a 22B parameter model locally on an AI PC.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
 
 
1
  ---
2
  license: other
3
+ inference: false
4
+ tags: [p22, ov, llmware-chat, green]
5
  ---
6
 
7
+ # mistral-small-instruct-2409-ov
8
+
9
+ **mistral-small-instruct-2409-ov** is an OpenVino int4 quantized version of [mistral-small-instruct-2409](https://huggingface.co/mistralai/mistral-small-instruct-2409), which is a research 22B general purpose chat/instruct model from Mistral.
10
+
11
  This model is licensed under MRL (Mistral Research License), which can be found [here](https://mistral.ai/licenses/MRL-0.1.md). Per this license, this model is available only for research.
12
 
13
+ We are including in the Model Depot collection for AI PC primarily for testing the speed and quality of a 4-bit OpenVino quantized 22B parameter model running locally on an AI PC.
14
+
15
+
16
+ ### Model Description
17
+
18
+ - **Developed by:** mistralai
19
+ - **Quantized by:** llmware
20
+ - **Model type:** mistral-small-instruct-2409-ov
21
+ - **Parameters:** 22 billion
22
+ - **Model Parent:** mistralai/mistral-small-instruct-2409
23
+ - **Language(s) (NLP):** English
24
+ - **License:** MRL - research only - not commercial
25
+ - **Uses:** General use
26
+ - **Quantization:** int4
27
+
28
+
29
+ ## Model Card Contact
30
+
31
+ [llmware on github](https://www.github.com/llmware-ai/llmware)
32
+
33
+ [llmware on hf](https://www.huggingface.co/llmware)
34
+
35
+ [llmware website](https://www.llmware.ai)
36