Containerization support would be nice.

#1
by HlexNC - opened

The plan.

So, I do not like to edit the code to each machine, so my plan is to attempt to make a Dockerfile and a docker-compose file to set everything up automatically. I also plan to try and make this llama3 npu model compatible with ollama and run it on the container.

Why?

Because I can stop and start the container instance at any point of time, not problem. I already have a couple of containers web-apps running, so as to simplify my offline and plane life.

Owner

Hello!

It's certainly a pain to set up, so it would be useful.
However, the AMD driver is not yet stable, so it will be difficult to run it via Docker.

Sign up or log in to comment