Edit Models filters

Inference status

Misc

AutoTrain Compatible

Inference Endpoints

Misc with no match

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

87

Full-text search

Active filters: granite-3.0

davelsphere/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 14

davelsphere/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 9

davelsphere/granite-3.0-8b-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 48

davelsphere/granite-3.0-2b-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 32

davelsphere/granite-3.0-3b-a800m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 11

davelsphere/granite-3.0-1b-a400m-base-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 22

davelsphere/granite-3.0-3b-a800m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 11

lmstudio-community/granite-3.0-1b-a400m-instruct-GGUF

Text Generation • Updated Oct 21 • 349

lmstudio-community/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 525

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 11

Triangle104/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 18

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-1b-a400m-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-1b-a400m-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 7

Triangle104/granite-3.0-1b-a400m-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 20

Triangle104/granite-3.0-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 21 • 12

Triangle104/granite-3.0-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 10

Triangle104/granite-3.0-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 21 • 8

Triangle104/granite-3.0-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 21 • 14

Triangle104/granite-3.0-2b-instruct-Q6_K-GGUF

Text Generation • Updated Oct 21 • 17

Triangle104/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 9

Triangle104/granite-3.0-8b-instruct-Q4_K_S-GGUF

Text Generation • Updated 27 days ago • 48

Triangle104/granite-3.0-8b-instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 21 • 22

MCZK/granite-3.0-2b-instruct-GGUF

Text Generation • Updated Oct 21 • 87

aashish1904/granite-3.0-2b-instruct-Q8_0-GGUF

Text Generation • Updated Oct 21 • 11

MCZK/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated Oct 21 • 223

1FriendlyDoge/granite-3.0-8b-instruct-Q8_0-GGUF

Text Generation • Updated about 1 month ago • 26

farpluto/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF

Text Generation • Updated about 1 month ago • 23

royleibov/granite-3.0-8b-instruct-ZipNN-Compressed

Text Generation • Updated about 1 month ago • 43

osllmai/granite-3.0-3b-a800m-instruct-GGUF

Text Generation • Updated 28 days ago • 179