Keeps repeating the same sentence (3.1-8B-Instruct)
#138
by
duhking
- opened
For those who struggle with this problem, i found the answer: https://huggingface.co/blog/zh/llama31#how-much-memory-does-llama-31-need
@duhking What's the answer to this problem ?