How to use system prompt?
#69
by
mznw
- opened
same way as Llama2 ?
[INST] <>
{your_system_message}
<>
{user_message_1} [/INST]
I believe this instruct version was not trained on a dataset with examples of "system" messages. I recommend putting the system message right after your instruction, so for example: <s> [INST] Hello, how are you? Respond like a pirate. [/INST]
Here, Hello, how are you? is the instruction, and Respond like a pirate. is the system prompt.
Feel free to experiment and try different approaches. If you'd really need a system message, you would probably have to fine-tune this further on your own dataset.