Using TGI with Intel Gaudi
Check out this repository to serve models with TGI on Gaudi and Gaudi2 with Optimum Habana.
< > Update on GitHubCheck out this repository to serve models with TGI on Gaudi and Gaudi2 with Optimum Habana.
< > Update on GitHub