Earlier checkpoints?

#11
by RylanSchaeffer - opened

Hi! Could earlier checkpoints (i.e. before 240B tokens) please be added? Thank you!!

I'd like this data to better study scaling properties of models during pretraining.

Sign up or log in to comment