Qwen2.5-1.5B-Instruct Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate IQ1_S 417 193.6245 1.77149 IQ1_M 443 66.9068 0.52878 IQ2_XXS 488 33.3356 0.25559 IQ2_XS 525 20.2870 0.14936 IQ2_S 538 18.2927 0.13380 IQ2_M 574 15.4838 0.11113 Q2_K_S 611 16.0169 0.11623 IQ3_XXS 638 12.3935 0.08770 Q2_K 645 14.1657 0.10105 IQ3_XS 698 11.7112 0.08256 Q3_K_S 726 12.4782 0.08842 IQ3_S 728 11.4241 0.07977 IQ3_M 741 11.4058 0.07862 Q3_K_M 786 11.3529 0.08018 Q3_K_L 840 11.1934 0.07913 IQ4_XS 855 10.5302 0.07351 IQ4_NL 893 10.5116 0.07335 Q4_0 895 10.8217 0.07576 Q4_K_S 897 10.5236 0.07360 Q4_K_M 941 10.4628 0.07310 Q4_1 970 10.5100 0.07347 Q5_K_S 1048 10.2715 0.07148 Q5_0 1051 10.3196 0.07212 Q5_K_M 1073 10.2529 0.07143 Q5_1 1126 10.2624 0.07140 Q6_K 1214 10.2030 0.07108 Q8_0 1571 10.1670 0.07068 F16 2951 10.1512 0.07058