can I see MMLU By Task?

#559
by jijivski - opened

Hi, I look forward to checking LLM's score in some areas.
I have found this MMLU By Task Leaderboard - a Hugging Face Space by CoreyMorris, but it stopped and not enough for me( but he did a lot of work).
I am wondering if huggingface has these by-task scores? Or if you only have average ones, is it possible to have this feature added?

Open LLM Leaderboard org

Hi, you can find all models score here each result file contains score for individual tasks. Hope this helps !

SaylorTwift changed discussion status to closed

Sign up or log in to comment