TheBloke
/

dolphin-2.2.1-mistral-7B-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

dolphin-2.2.1-mistral-7B-AWQ / zero_to_fp32.py

Commit History

AWQ model commit

507b1ac

TheBloke commited on Oct 30, 2023