File size: 1,303 Bytes
f3658f0 c7c7f9c f3658f0 c7c7f9c 01002cd c7c7f9c 01002cd c7c7f9c 01002cd 51f1643 01002cd c7c7f9c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
license: cc-by-4.0
tags:
- requests
- gguf
- quantized
---
# Welcome to my GGUF-IQ-Imatrix Model Quantization Requests card!
Read bellow for more information.
**Requirements to request model quantizations:**
For the model:
- Maximum model parameter size of **11B**. <br>
*At the moment I am unable to accept requests for larger models due to hardware/time limitations.*
Important:
- Fill the request template as outlined in the next section.
#### How to request a model quantization:
1. Open a [**New Discussion**](https://huggingface.co/Lewdiculous/Model-Requests/discussions/new) with a title of "`Request: Model-Author/Model-Name`", for example, "`Request: Nitral-AI/Infinitely-Laydiculous-7B`".
2. Include the following template in your message and fill the information ([example request here](https://huggingface.co/Lewdiculous/Model-Requests/discussions/1)):
```
**Model name:**
**Model link:**
**Brief description:**
**This is the default list of quants I'll upload, if you want something that is not on this list, feel free add bellow:**
Default quants for reference:
"Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",
"Q6_K", "Q8_0", "IQ3_M", "IQ3_S", "IQ3_XXS"
Additonal quants (if you want any):
**An image to represent the model (square shaped):**
``` |