---
tags:
- gguf
---

This repository hosts GGUF-IQ-Imatrix quantizations for [ResplendentAI/Datura_7B](https://huggingface.co/ResplendentAI/Datura_7B).

**This is experimental.**

```python
    quantization_options = [
        "Q4_K_M", "Q5_K_M", "Q6_K", "Q8_0"
    ]
```