File size: 667 Bytes
a0d4ad9
 
 
 
 
 
8e58cc3
a0d4ad9
 
 
 
 
93d15d9
 
8e18576
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
---
license: other
license_name: deepseek-license
license_link: LICENSE
quantized_by: bartowski
pipeline_tag: text-generation
base_model: deepseek-ai/DeepSeek-Coder-V2-Instruct
---
Slowly creating, with imatrix, will add my usual details later

So far IQ1_M is up with an eyewatering size of 52.7GB

[IQ1_M](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ1_M.gguf)

[IQ2_XS](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-IQ2_XS.gguf)

[Q2_K](https://huggingface.co/bartowski/DeepSeek-Coder-V2-Instruct-GGUF/tree/main/DeepSeek-Coder-V2-Instruct-Q2_K.gguf)