Edit model card

gemma-2-9b-it - bnb 4bit

Description

This model is 4bit quantized version of gemma-2-9b-it using bitsandbytes. It's designed for fine-tuning! The PAD token is set as "".

Downloads last month
16
Safetensors
Model size
5.21B params
Tensor type
F32
·
BF16
·
U8
·
Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for leliuga/gemma-2-9b-it-bnb-4bit

Base model

google/gemma-2-9b
Quantized
(95)
this model

Collection including leliuga/gemma-2-9b-it-bnb-4bit