fastapi
llama-cpp-python[server]
huggingface-hub