Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,589

Full-text search

Active filters: awq

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9 • 31.8k • 38

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 222k • 87

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9 • 27.5k • 36

WisPerMed/Llama-3.1-SauerkrautLM-70b-Instruct-AWQ

Text Generation • Updated 17 days ago • 201 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 93 • 1

TheBloke/llama2_70b_chat_uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 69 • 6

TheBloke/Pygmalion-2-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 105 • 5

TheBloke/Phind-CodeLlama-34B-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 433 • 32

TheBloke/Wizard-Vicuna-13B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 82 • 13

TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 112 • 13

TheBloke/WizardLM-7B-uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 45 • 4

TheBloke/LLaMA-65B-AWQ

Text Generation • Updated Nov 9, 2023 • 10 • 2

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 366k • 37

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 244 • 33

TheBloke/LLaMA2-13B-Tiefighter-AWQ

Text Generation • Updated Nov 9, 2023 • 697 • 38

TheBloke/MetaMath-Mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 92 • 1

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 1.35k • 71

TheBloke/OpenHermes-2.5-Mistral-7B-AWQ

Text Generation • Updated Nov 9, 2023 • 68.8k • 21

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 22.4k • 8

TheBloke/goliath-120b-AWQ

Text Generation • Updated Nov 9, 2023 • 128 • 11

TheBloke/Qwen-7B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 115 • 8

jamesdborin/llama2-13b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 20 • 1

TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 14, 2023 • 382 • 58

ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ

Text Generation • Updated Dec 12, 2023 • 3.05k • 15

casperhansen/mixtral-instruct-awq

Text Generation • Updated Feb 11 • 35.8k • 43

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1 • 2.67k • 21

TheBloke/Sensualize-Solar-10.7B-AWQ

Text Generation • Updated Jan 6 • 23 • 2

TheBloke/dolphin-2.6-mistral-7B-dpo-laser-AWQ

Text Generation • Updated Jan 10 • 65 • 10

LuongNam/Vistral-7B-Chat-AWQ

Text Generation • Updated Jan 15 • 49 • 2

TheBloke/Nous-Hermes-2-Mixtral-8x7B-DPO-AWQ

Text Generation • Updated Jan 16 • 233 • 22