FLOR-6.3B-xat-Q8_0

FLOR-6.3B-xat-Q8_0 és la versió quantitzada del model FLOR-6.3B-xat d'en xaviviro

Prompt Template

FLOR-6.3B-xat-Q8_0 usa ChatML com a prompt template:

<|im_start|>user
Qui va ser Isaac Newton?<|im_end|>
<|im_start|>assistant\n

GGUF

Model size

6.45B params

Architecture

bloom

8-bit

Inference Examples

Inference API (serverless) is not available, repository is disabled.

Base model

Quantized

this model