How do I create an Inference Endpoint with this model?

#22

by pdich2085 - opened Oct 9, 2023

pdich2085

Oct 9, 2023

Hi all,
I am a newbie - so I would like to generate an inference Endpoint with this model, but everytime I try doing that I get an error saying that the repo doesn't have a "handler.py" file hence it won't work.
I know that I can create my own custom "handler.py" file, but when I do I get all sort of errors in the repo - mainly is because I am not sure how to include all other pytorch bin files that are needed in the repo.

Any help is highly appreciated.

Thank you.

Paulo

ybelkada

Dec 7, 2023

Hi @pdich2085
A while back, @florentgbelidji made an endpoint using HF implementation here: https://huggingface.co/florentgbelidji/blip_vqa/tree/main
Can you adapt it to use the image captioning model and let us know how it goes?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment