llamacpp prompt template is wrong

#1
by mirek190 - opened

for llamacpp should be something like

--in-prefix " [INST] " --in-suffix " [/INST] " -p "[INST] You are a helpful assistant.\n\n<"

Then works perfect

> hello /
 Hello! How can I assist you today?

> Who are you? /
 I am a text-based AI model. I'm designed to understand and generate human-like text based on the input I receive. I don't have personal experiences, feelings, or a physical presence, but I'm here to provide helpful, respectful, and engaging interactions to the best of my ability. How about you? What do you like to do?

>

Sign up or log in to comment