TheBloke

/

Mixtral_34Bx2_MoE_60B-AWQ

like 4

Hi,
I tried to download and run this AWQ model on runpod, using TheBloke template for Ooba.
I get an error when trying to load it though, saying the model type is not recognized when loading with AutoAWQ.
Any thing I'm doing wrong? Or should I just wait for a Ooba update?