dranger003/deepseek-coder-33b-instruct-iMat.GGUF

GGUF importance matrix (imatrix) quants for https://huggingface.co/deepseek-ai/deepseek-coder-33b-instruct
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.

2024-03-13: Updated IQ1_S using latest commit 19885d20. More info here and here.

Layers	Context	Template
62	16384	{instructions} ### Instruction: {prompt} ### Response: {response}