Hugging Face's logo

Intel
/
Phi-3-mini-4k-instruct-int4-inc

English
Model card Files Community
1
yintongl commited on
Commit
7ddd818
•
1 Parent(s): 111a6c0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -31,6 +31,7 @@ python3 main.py \
31
  --group_size 128 \
32
  --bits 4 \
33
  --iters 1000 \
 
34
  --deployment_device 'gpu' \
35
  --disable_quanted_input \
36
  --output_dir "./tmp_autoround" \
 
31
  --group_size 128 \
32
  --bits 4 \
33
  --iters 1000 \
34
+ --nsamples 512 \
35
  --deployment_device 'gpu' \
36
  --disable_quanted_input \
37
  --output_dir "./tmp_autoround" \