Please provide an ollama example.
Can you please provide an Ollama modefile config example?
https://github.com/ollama/ollama/blob/main/docs/modelfile.md
Thank you.
Done! https://ollama.com/kubernetes_bad/chargen-v2
CharGen v2 has following recommended generation settings:
temperature 1
repetition_penalty 1.1
min_p 0.05
As you may know, min_p currently is not supported by Ollama, despite it being a mere wrapper of llama.cpp which supports it. There is a PR, but it has been unmerged for last 6 months.
Since it's not a supported generation parameter in Ollama, it is not a valid parameter on the Modelfile. What I'm saying is that you'd need to either build Ollama from source or find some other parameters that work for you.
I see. Thank you very much for this.
Ollama now has min_p.
Updated the model on Ollama Hub to take advantage of that. Thanks!