TheBloke
/

falcon-40b-instruct-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

falcon-40b-instruct-GPTQ

2 contributors

History: 45 commits

TheBloke's picture

Update for Transformers GPTQ support

57ac6ea about 1 year ago