Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

115

Full-text search

Active filters: language

davelsphere/granite-3.0-3b-a800m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 11

davelsphere/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 22

davelsphere/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 11

lmstudio-community/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 21 • 349

lmstudio-community/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 525

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 11

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 18

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-1b-a400m-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 7

Triangle104/granite-3.0-1b-a400m-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 20

Triangle104/granite-3.0-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 12

Triangle104/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 10

Triangle104/granite-3.0-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 14

Triangle104/granite-3.0-2b-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 17

Triangle104/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated 27 days ago • 48

Triangle104/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 22

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 87

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 11

MCZK/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 223

1FriendlyDoge/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • Updated about 1 month ago • 26

farpluto/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated about 1 month ago • 23

royleibov/granite-3.0-8b-instruct-ZipNN-Compressed

Text Generation • Updated about 1 month ago • 43

osllmai/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated 28 days ago • 179

Esperanto/granite-3.0-2b-instruct-fp16-onnx

Text Generation • Updated 28 days ago • 17

tsalles/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated 28 days ago • 45

eformat/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated 28 days ago • 71

osllmai/granite-3.0-8b-instruct-GGUF

Text Generation • Updated 28 days ago • 85