I am getting error as "ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported"
I am trying to download the model and want to use transformers. I am getting the following error.
ValueError: Tokenizer class GemmaTokenizer does not exist or is not currently imported.
I cleared cache several times. looks like the model is not getting downloaded. any suggestions??
never mind. got it fixed.
pip install --upgrade transformers
What was the fix for this issue? I am on an M1 Mac. Running
pip install --upgrade transformers
did not resolve the issue for me
nvm, My problem was that I was using python 3.9 when I should have been using 3.10
same question.
Yes. you should have the latest pyhton, 3.10 and upgraded transformers. That should resolve the issue. If you are having 16G RAM and CPU (no GPU), try 2B version rather than 7B. Hope that helps.
failed on 3.10.0.
I upgraded transformers and worked!
version==4.38.1 worked for me