---
license: other
tags:
- Transformers
- falcon
- text-generation-inference
---
Some GGML quantizations of for [TII](https://www.tii.ae)'s [tiiuae/falcon-40b](https://huggingface.co/tiiuae/falcon-40b) base model for use with ggllm.cpp.