UltraMerge-7B

This model is an experimental DPO fine-tune of automerger/YamShadow-7B on the following datasets:

I have no idea about what's the best chat template. Probably Mistral-Instruct or ChatML.

Safetensors

Model size

7.24B params

Tensor type

FP16

Inference Examples

Inference API (serverless) is not available, repository is disabled.

Model tree for mlabonne/UltraMerge-7B

Finetunes

Merges

Quantizations