Edit model card

The Gemma 2 model family, developed by Google, consists of lightweight, open-source models that demonstrate state-of-the-art performance across various tasks.

This repo covers 2b and 9b gemma2 different size gguf models, which are very applicable for deploying and using in PCs, laptops or mobiles.

If you are a Mac user, you can download the beautiful ChatPDFLocal MacOS app from here, load one or batch PDF files at will, and quickly experience the effect of the model through chat reading.

Subscription or inviting friends in ChatPDFLocal MacOS app can earn credits to use freely.

Downloads last month
1,412
GGUF
Model size
9.24B params
Architecture
gemma2

4-bit

8-bit

16-bit

Inference API
Unable to determine this model's library. Check the docs .