Safetensors
llama

demo with vllm?

#4
by brando - opened

demo with vllm?

Bro check this out https://github.com/deepseek-ai/DeepSeek-Prover-V1.5/blob/main/prover/launch.py
I think you would need more than vllm as it is not one shot solution if you are trying to replicate.

Sign up or log in to comment