Can you please also convert dbrx-instruct to bnb-4bit

#2
by MLDataScientist - opened

Hi team,

Thank you for converting the base to 4 bits. Can you please convert dbrx-instruct to bnb-4bit? Thank you!

Pruna AI org

Hi,

Sure, we did it here: https://huggingface.co/PrunaAI/dbrx-instruct-bnb-4bit

Enjoy!

johnrachwanpruna changed discussion status to closed

Sign up or log in to comment