How to use the special token `<|system|>` effectively?

#13
by AayushShah - opened

Hello πŸ™‹πŸ»β€β™‚οΈ
I am willing to make a prompt which can summarize the information given in the bullet points. Before I was following this prompt:

BEFORE:

<|prompter|>
You are a helpful narrator in the company. Your task is to provide a meaningful summary by using the scientific terms possible considering the audience is educated. Use the information below:

Information:
- {JARGON WORDS}
- {ANALYSIS }
- {RESEARCH}
- etc...

Insightful and verbose narration of the information given above:<|endoftext|><|assistant|>

But now I have found these special tokens:

  • <|system|>
  • <|assistant|>
  • <|prefix_begin|>
  • <|prefix_end|>
  • <|prompter|>

So I think I can use the <|system|> to set what I want to do, instead of giving all things at once in the <|prompter|>.

AFTER:

<|system|>
You are a helpful narrator in the company. Your task is to provide a meaningful summary by using the scientific terms possible considering the audience is educated. Use the information below.
<|system|>


<|prompter|>
Information:
- {JARGON WORDS}
- {ANALYSIS }
- {RESEARCH}
- etc...

Insightful and verbose narration of the information given above:<|endoftext|><|assistant|>"""

The question

Am I using the <|system|> token correctly? Is this the way to use it? Or I am actually misleading the LLM?

Please help,
Thanks πŸ™πŸ»

OpenAssistant org

SFT-4 does not not know about the system prompt, please don't use it (it's weights are still random). If you want add an additional pre-prompt please try to simply place it at the beginning (without system) or at the start of the prompter request.

Sign up or log in to comment