GPU Accelaration - Llama.cpp

by frbackup - opened Aug 6

Aug 6

Hi! I am running this on an Intel 16gb Mac 2019 using Llama.cpp, is there any way I could connect to the local GPU and accelarate performance?

Thanks!

Owner Aug 6

do you have a dedicated GPU? should be able to offload to it with -ngl

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment