EXL2 quants of Mixtral 8x22B Instruct v0.1
More bitrates still cooking
2.30 bits per weight
2.50 bits per weight
4.50 bits per weight
5.00 bits per weight
EXL2 quants of Mixtral 8x22B Instruct v0.1
More bitrates still cooking
2.30 bits per weight
2.50 bits per weight
4.50 bits per weight
5.00 bits per weight