How to use the special token `<|system|>` effectively?
#13
by
AayushShah
- opened
Hello ππ»ββοΈ
I am willing to make a prompt which can summarize the information given in the bullet points. Before I was following this prompt:
BEFORE:
<|prompter|>
You are a helpful narrator in the company. Your task is to provide a meaningful summary by using the scientific terms possible considering the audience is educated. Use the information below:
Information:
- {JARGON WORDS}
- {ANALYSIS }
- {RESEARCH}
- etc...
Insightful and verbose narration of the information given above:<|endoftext|><|assistant|>
But now I have found these special tokens:
- <|system|>
- <|assistant|>
- <|prefix_begin|>
- <|prefix_end|>
- <|prompter|>
So I think I can use the
<|system|>
to set what I want to do, instead of giving all things at once in the<|prompter|>
.
AFTER:
<|system|>
You are a helpful narrator in the company. Your task is to provide a meaningful summary by using the scientific terms possible considering the audience is educated. Use the information below.
<|system|>
<|prompter|>
Information:
- {JARGON WORDS}
- {ANALYSIS }
- {RESEARCH}
- etc...
Insightful and verbose narration of the information given above:<|endoftext|><|assistant|>"""
The question
Am I using the
<|system|>
token correctly? Is this the way to use it? Or I am actually misleading the LLM?
Please help,
Thanks ππ»
SFT-4 does not not know about the system prompt, please don't use it (it's weights are still random). If you want add an additional pre-prompt please try to simply place it at the beginning (without system) or at the start of the prompter request.