allenai

/

OLMo-7B

like 628

Hopefully within the next month but it depends on queue times... lots of other groups using the LUMI supercomputer right now as well, and the job time limit is 48 hours. So at most we can only run for 48 hours at a time before sitting in the queue again.

@epwalsh Thank you very much for the information! Hope everything will go well!

@epwalsh BTW, it may be beneficial to the community if you release the intermediate checkpoints before the model is fully trained.

Just pushing this after some time has gone now, is the release of the 65B model still planned?