Edit Models filters

Inference status

Misc

Misc with no match

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

251

Full-text search

Active filters: web-llm

mlc-ai/gemma-2b-it-q4f16_1-MLC

Updated Aug 1 • 5.51k • 4

mlc-ai/Hermes-2-Pro-Mistral-7B-q4f16_1-MLC

Updated Aug 5 • 924 • 1

mlc-ai/Phi-3-mini-4k-instruct-q0f32-MLC

Updated Jul 11 • 1 • 1

mlc-ai/gemma-2-2b-it-q4f16_1-MLC

Updated Aug 1 • 2.4k • 5

mlc-ai/Phi-3.5-mini-instruct-q4f16_1-MLC

Updated 27 days ago • 2.59k • 2

mlc-ai/gemma-2-2b-it-q4f16_0-MLC

Updated 27 days ago • 31 • 1

mlc-ai/Qwen2.5-0.5B-Instruct-q0f16-MLC

Updated about 14 hours ago • 1

mlc-ai/Qwen2.5-72B-Instruct-q4f16_1-MLC

Updated about 14 hours ago • 1

mlc-ai/Llama-2-7b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 1.28k • 8

mlc-ai/Llama-2-7b-chat-hf-q4f32_1-MLC

Updated Jul 11 • 35.6k • 2

mlc-ai/Mistral-7B-Instruct-v0.2-q4f16_1-MLC

Updated Jul 11 • 1.5k • 4

mlc-ai/Llama-2-13b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 39 • 1

mlc-ai/Llama-2-70b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 2 • 1

mlc-ai/OpenHermes-2.5-Mistral-7B-q4f16_1-MLC

Updated Jul 11 • 28 • 1

mlc-ai/NeuralHermes-2.5-Mistral-7B-q4f16_1-MLC

Updated Jul 11 • 21 • 3

mlc-ai/WizardMath-7B-V1.0-q4f16_1-MLC

mlc-ai/WizardMath-13B-V1.0-q4f16_1-MLC

Updated Jul 11 • 1

mlc-ai/WizardMath-70B-V1.0-q4f16_1-MLC

Updated Jul 11 • 1

mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f16_1-MLC

Updated Jul 11 • 1.08k • 2

mlc-ai/RedPajama-INCITE-Chat-3B-v1-q4f32_1-MLC

Updated Jul 11 • 100 • 2

mlc-ai/WizardMath-7B-V1.1-q4f16_1-MLC

Updated Jul 11 • 35

mlc-ai/phi-2-q0f16-MLC

Updated Jul 11 • 9 • 1

mlc-ai/phi-2-q4f16_1-MLC

Updated Jul 11 • 1.14k • 2

mlc-ai/phi-1_5-q0f16-MLC

mlc-ai/phi-1_5-q4f16_1-MLC

Updated Jul 11 • 158

mlc-ai/gpt2-q0f16-MLC

Updated Jul 11 • 45

mlc-ai/gpt2-medium-q0f16-MLC

Updated Jul 11 • 1

mlc-ai/Mistral-7B-Instruct-v0.2-q3f16_1-MLC

Updated Jul 11 • 214 • 4

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f16_1-MLC

Updated Jul 11 • 347 • 1

mlc-ai/TinyLlama-1.1B-Chat-v0.4-q4f32_1-MLC

Updated Jul 11 • 1.71k • 1