system role

#15
by wuriyanto - opened

how to use this model using the System role, does it support the use of system roles?

Just create a string formatted as required by Gemma instruct model and add the system part.
Here an example.

Input:
Screenshot from 2024-07-03 15-32-36.png

Output:

Screenshot from 2024-07-03 15-33-21.png

Google org

Hi @wuriyanto , I hope the issue has been resolved. Please let us know if any further assistance is needed. Thanks!

Hi @Renu11 , sorry for the late response, issue has been resolved
Thank you very much @matteoperiani

wuriyanto changed discussion status to closed
wuriyanto changed discussion status to open

Screen Shot 2024-08-20 at 11.24.35.png
Screen Shot 2024-08-20 at 11.26.00.png

Sorry to reopen this issue, I entered the System role in the chat template.

it seems gemma doesn't support the System role. or is there something wrong with my code?

Hi @wuriyanto , I guess gemma supports user mode only, so you need to type prompts originally for system in user prompt as in @matteoperiani 's comment.

wuriyanto changed discussion status to closed

Sign up or log in to comment