Exl2
Collection
Models that we have quantized to exllamav2's quantization format
•
22 items
•
Updated
•
2
This is a Exl2 quantized version of Pygmalion-2-13b-SuperCOT-weighed
Please refer to the original creator for more information.
Branches:
- main: 4 bits per weight
- 5.0bpw: 5 bits per weight
- 6.0bpw: 6 bits per weight
- Downloads last month
- 8
Inference API (serverless) is not available, repository is disabled.