Edit Models filters

Model Tree

ibm-granite/granite-3.0-2b-instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

23

Full-text search

Active filters: ibm-granite/granite-3.0-2b-instruct

bartowski/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 3.21k • 5

lmstudio-community/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 659 • 1

aashish1904/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 29 • 1

aashish1904/granite-3.0-2b-instruct-Q2_K-GGUF

Text Generation • Updated Oct 21 • 21 • 1

osllmai-community/granite-3.0-2b-instruct-GGUF

Text Generation • Updated 25 days ago • 177 • 1

davelsphere/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 14

Triangle104/granite-3.0-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 12

Triangle104/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 10

Triangle104/granite-3.0-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 14

Triangle104/granite-3.0-2b-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 17

Triangle104/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 9

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 87

Felladrin/gguf-q5_k_m-granite-3.0-2b-instruct

Updated Oct 21 • 152

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 11

onnx-community/granite-3.0-2b-instruct

Text Generation • Updated about 1 month ago • 63

DevQuasar/ibm-granite.granite-3.0-2b-instruct-GGUF

Updated 29 days ago • 155

MaziyarPanahi/granite-3.0-2b-instruct-GGUF

Text Generation • Updated 29 days ago • 555

Esperanto/granite-3.0-2b-instruct-fp16-onnx

Text Generation • Updated 28 days ago • 17

osllmai/granite-3.0-2b-instruct-GGUF

Text Generation • Updated 27 days ago • 118

psolarvi/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated 24 days ago • 19

mradermacher/granite-3.0-2b-instruct-GGUF

Updated 1 day ago • 223

mradermacher/granite-3.0-2b-instruct-i1-GGUF

Updated 1 day ago • 433