AMD/Nvdia GPU issue
Hi, n installed the GGUF file in Ollama, but Ollama crashes when loading the model, in the log it states I do not have a AMD gpu (I have a Nvidia Tesla P40), how can I try Fietje with another GPU than AMD?
Kind regards!
he is what I get in my log:
ama[834]: time=2024-05-17T10:02:30.467Z level=INFO source=amd_linux.go:311 msg="no compatible amdgpu devices detected"
May 17 10:02:30 duckie ollama[834]: time=2024-05-17T10:02:30.714Z level=INFO source=amd_linux.go:311 msg="no compatible amdgpu devices detected"
May 17 10:02:30 duckie ollama[834]: time=2024-05-17T10:02:30.853Z level=WARN source=sched.go:507 msg="gpu VRAM usage didn't recover within timeout" seconds=5.078562648
May 17 10:02:30 duckie ollama[834]: time=2024-05-17T10:02:30.958Z level=INFO source=amd_linux.go:311 msg="no compatible amdgpu devices detected"
May 17 10:02:31 duckie ollama[834]: time=2024-05-17T10:02:31.103Z level=WARN source=sched.go:507 msg="gpu VRAM usage didn't recover within timeout" seconds=5.328556556
May 17 10:02:31 duckie ollama[834]: time=2024-05-17T10:02:31.214Z level=INFO source=amd_linux.go:311 msg="no compatible amdgpu devices detected"
May 17 10:02:31 duckie ollama[834]: time=2024-05-17T10:02:31.353Z level=WARN source=sched.go:507 msg="gpu VRAM usage didn't recover within timeout" seconds=5.578560452
Hi @foxyperson . Can you try again? Recently a lot of ollama issues have been solved. Issues specific to AMD GPUs should probably be addressed to ollama since that is out of my control.