Edit model card

gemma2b-it-dutch-v1

Model description

Really shitty finetune of gemma-2b-it using BramVanroy/alpaca-cleaned-dutch.

Intended uses & limitations

Its finetuned on gemma-2b-it which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch.

Training and evaluation data

Trained on BramVanroy/alpaca-cleaned-dutch dataset. Therefore, commercial use of this model is forbidden. The model is intended for research purposes only.

Training procedure

Trained with QLoRA and merged before upload.

Training hyperparameters

idk anymore tbh (i think it has been trained on 400 steps)

Downloads last month
7
Safetensors
Model size
2.51B params
Tensor type
FP16
·
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Dataset used to train cherryboi/gemma2b-it-dutch-v1