Model Card for Falcon-7B-instruct-NF4
Model Details
This model is a NF4 quantized version of the tiiuae/falcon-7b-instruct model.
- Developed by: Ted Whooley
- Library: Transformers, NF4
- Model type: falcon
- Model name: Falcon-7B-instruct-NF4
- Pipeline tag: text-generation
- Qunatized by: twhoool02
- Language(s) (NLP): en
- License: other
- Downloads last month
- 5
Inference API (serverless) is not available, repository is disabled.
Model tree for twhoool02/Falcon-7B-instruct-NF4
Base model
tiiuae/falcon-7b-instruct
Quantized
this model