Chryslerx10
/

Llama-3.2-1B-finetuned-generalQA-peft-4bit

Upload quant_config.json

615aae3 verified 3 days ago

124 Bytes

{"load_in_4bit": true, "bnb_4bit_quant_type": "nf4", "bnb_4bit_compute_dtype": "float16", "bnb_4bit_use_double_quant": true}