Felladrin
/

gguf-sharded-OLMo-7B-Instruct

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Sharded GGUF version of allenai/OLMo-7B-Instruct.

Downloads last month: 9

GGUF

Model size

6.89B params

Architecture

olmo

4-bit

Inference API

Unable to determine this model's library. Check the docs .

Model tree for Felladrin/gguf-sharded-OLMo-7B-Instruct

Base model

allenai/OLMo-7B-Instruct

Quantized

(1)

this model