Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

3,847

Full-text search

Active filters: exl2

denru/Behemoth-123B-v1.1-5_0bpw-h6-exl2-pippa

Updated 26 days ago • 78 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-6.0bpw-h6-exl2

Updated 25 days ago • 37 • 2

MikeRoz/TheDrummer_Behemoth-123B-v1.1-5.0bpw-h6-exl2

Updated 25 days ago • 231 • 3

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.0bpw-h6-exl2

Updated 25 days ago • 992 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-2.5bpw-h6-exl2

Updated 25 days ago • 37 • 1

waldie/Cydonia-v1.2-Magnum-v4-22B-6.5bpw-h6-exl2

Text Generation • Updated 24 days ago • 112 • 1

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.75bpw

Text Generation • Updated 19 days ago • 13 • 1

async0x42/EVA-Qwen2.5-32B-v0.2-exl2_5.0bpw

Text Generation • Updated 16 days ago • 43 • 1

WaveCut/IlyaGusev-saiga_nemo_12b_sft_m9_d16_simpo_m21_d36-EXL2-8bpw

Updated 15 days ago • 11 • 1

waldie/EVA-Qwen2.5-32B-v0.2-4bpw-h6-exl2

Text Generation • Updated 13 days ago • 55 • 1

MikeRoz/TheDrummer_Behemoth-123B-v1.1-4.25bpw-h6-exl2

Updated 13 days ago • 45 • 2

cgus/Qwen2.5-14B-Instruct-abliterated-v2-exl2

Text Generation • Updated 10 days ago • 25 • 1

openerotica/Mistral-Small-Instruct-2409-abliterated-4.5bpw-exl2

Text Generation • Updated 10 days ago • 24 • 1

MarsupialAI/UnslopNemo-12B-v3_EXL2_6bpw_H8

Updated 8 days ago • 14 • 1

async0x42/Athene-V2-Chat-exl2_3.5bpw

Text Generation • Updated 6 days ago • 11 • 1

Jellon/Athene-V2-Chat-72b-exl2-3bpw

Text Generation • Updated 5 days ago • 6 • 1

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated 5 days ago • 8 • 1

waldie/Beepo-22B-5.5bpw-h6-exl2

Updated 4 days ago • 12 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-3.0bpw-h6-exl2

Updated 3 days ago • 21 • 1

MikeRoz/mistralai_Mistral-Large-Instruct-2411-5.0bpw-h6-exl2

Updated 2 days ago • 15 • 1

BigHuggyD/NeverSleep_Lumimaid-v0.2-123B_exl2_4.0bpw_h8

Text Generation • Updated Jul 29 • 25 • 3

ParasiticRogue/EVA-Instruct-32B-exl2-4.0

Text Generation • Updated 23 days ago • 77 • 2

Statuo/MiS-Firefly-v0.2-22b-EXL2-4bpw

Text Generation • Updated 13 days ago • 22 • 1

MikeRoz/sophosympatheia_Evathene-v1.0-6.0bpw-h6-exl2

Text Generation • Updated 4 days ago • 19 • 1

MikeRoz/sophosympatheia_Evathene-v1.0-4.25bpw-h6-exl2

Text Generation • Updated 4 days ago • 27 • 1

waldie/EVA-Instruct-32B-v2-4bpw-h6-exl2

Text Generation • Updated 2 days ago • 15 • 1

mo137/Amethyst-13B-Mistral-8bpw-hb8-exl2

Text Generation • Updated Oct 20, 2023 • 6

mo137/Amethyst-13B-Mistral-2.2bpw-exl2

Text Generation • Updated Oct 21, 2023 • 4

mo137/Amethyst-13B-Mistral-3bpw-exl2

Text Generation • Updated Oct 20, 2023 • 3 • 1

mo137/Amethyst-13B-Mistral-6bpw-exl2

Text Generation • Updated Oct 20, 2023 • 7