Edit Models filters

Model Tree

01-ai/Yi-9B-200K

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

7

Full-text search

Active filters: 01-ai/Yi-9B-200K

PrunaAI/01-ai-Yi-9B-200K-QUANTO-int8bit-smashed

PrunaAI/01-ai-Yi-9B-200K-QUANTO-int4bit-smashed

PrunaAI/01-ai-Yi-9B-200K-QUANTO-int2bit-smashed

Updated Jul 24 • 2

PrunaAI/01-ai-Yi-9B-200K-QUANTO-float8bit-smashed

Updated Jul 24 • 3

PrunaAI/01-ai-Yi-9B-200K-HQQ-1bit-smashed

Text Generation • Updated Jul 24 • 9 • 1

PrunaAI/01-ai-Yi-9B-200K-HQQ-2bit-smashed

Text Generation • Updated Jul 24 • 7 • 2

PrunaAI/01-ai-Yi-9B-200K-HQQ-4bit-smashed

Text Generation • Updated Jul 24 • 9