Edit model card

This model has been quantized using GPTQModel.

bits: 4
group_size: 128
desc_act: true
static_groups: false
sym: true
lm_head: false
damp_percent: 0.01
true_sequential: true
model_name_or_path: ""
model_file_base_name: "model"
quant_method: "gptq"
checkpoint_format: "gptq"
meta：
- quantizer: "gptqmodel:0.9.9-dev0"

Downloads last month: 4,737

Safetensors

Model size

2.8B params

Tensor type

I32

BF16

FP16

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.