Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
4.5bpw EXL2 quant of https://huggingface.co/TheDrummer/Cydonia-22B-v1.3
6bit heads. Default measurement dataset.
- Downloads last month
- 8
4.5bpw EXL2 quant of https://huggingface.co/TheDrummer/Cydonia-22B-v1.3
6bit heads. Default measurement dataset.