Prompt template
Hi @cxllin , I am trying to inference this model but getting some frustrating results. I guess the reason is that I didn't use the proper prompt format. What is the prompt format you used to finetune the model?
My current method is to split the question and answer apart and ask the model with the question only.
For example,
"Please answer with one of the option in the bracket\nQ:A 23-year-old pregnant woman at 22 weeks gestation presents with burning upon urination. She states it started 1 day ago and has been worsening despite drinking more water and taking cranberry extract. She otherwise feels well and is followed by a doctor for her pregnancy. Her temperature is 97.7\u00b0F (36.5\u00b0C), blood pressure is 122/77 mmHg, pulse is 80/min, respirations are 19/min, and oxygen saturation is 98% on room air. Physical exam is notable for an absence of costovertebral angle tenderness and a gravid uterus. Which of the following is the best treatment for this patient?? \n{'A': 'Ampicillin', 'B': 'Ceftriaxone', 'C': 'Ciprofloxacin', 'D': 'Doxycycline', 'E': 'Nitrofurantoin'},\nE: Nitrofurantoin"
Ask the model, "Please answer... E': 'Nitrofurantoin'}", and expect the model to respond with, "E: Nitrofurantoin".