Datura_7B-GGUF-Imatrix / README.md

Create README.md

8629a8b verified 8 months ago

273 Bytes

metadata

tags:
  - gguf

This repository hosts GGUF-IQ-Imatrix quantizations for ResplendentAI/Datura_7B.

This is experimental.

    quantization_options = [
        "Q4_K_M", "Q5_K_M", "Q6_K", "Q8_0"
    ]