Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

5,185

Full-text search

Active filters: pruna-ai

PrunaAI/Phi-3-mini-128k-instruct-GGUF-Imatrix-smashed

Updated Aug 2 • 2.97k • 67

PrunaAI/pkupie-lawyer-llama-13b-beta1.0-GGUF-smashed

Updated Jul 12 • 381 • 1

PrunaAI/yodayo-ai-nephra_v1.0-GGUF-smashed

Updated Jul 12 • 503 • 9

PrunaAI/w4r10ck-SOLAR-10.7B-Instruct-v1.0-uncensored-HQQ-1bit-smashed

Text Generation • Updated Jul 16 • 16 • 1

PrunaAI/THUDM-LongWriter-glm4-9b-bnb-4bit-smashed

Updated Aug 16 • 12 • 2

PrunaAI/THUDM-LongWriter-glm4-9b-HQQ-2bit-smashed

Updated Aug 16 • 4 • 1

PrunaAI/THUDM-LongWriter-glm4-9b-HQQ-1bit-smashed

Updated Aug 16 • 2 • 2

PrunaAI/ContactDoctor-Bio-Medical-Llama-3-8B-QUANTO-int4bit-smashed

Updated Aug 20 • 6 • 1

PrunaAI/facebook-opt-125m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 52

PrunaAI/bigscience-bloom-560m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/bigscience-bloomz-560m-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/bigscience-bloom-1b7-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 21

PrunaAI/bigscience-bloom-1b1-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/bigscience-bloomz-3b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/bigscience-bloom-560m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/bigscience-bloom-3b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 19

PrunaAI/bigscience-bloom-1b7-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 13

PrunaAI/bigscience-bloomz-560m-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/bigscience-bloomz-7b1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/bigscience-bloom-3b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/bigscience-bloom-1b1-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 11

PrunaAI/huggyllama-llama-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/NousResearch-Llama-2-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 12

PrunaAI/bigscience-bloomz-3b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/yahma-llama-7b-hf-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 15

PrunaAI/vj1148-llama-2-7b-legal-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 20

PrunaAI/huggyllama-llama-7b-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 18

PrunaAI/shan2003-llama-2-7b-legal-laws-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 17

PrunaAI/yahma-llama-7b-hf-bnb-8bit-smashed

Text Generation • Updated Aug 2 • 14

PrunaAI/mosaicml-mpt-7b-bnb-4bit-smashed

Text Generation • Updated Aug 2 • 4