text-generation-inference

Join the Hugging Face community

and get access to the augmented documentation experience

Collaborate on models, datasets and Spaces

Faster examples with accelerated inference

Switch between documentation themes

to get started

Using TGI with Intel Gaudi

Check out this repository to serve models with TGI on Gaudi and Gaudi2 with Optimum Habana.