Intermediate Checkpoints
I noticed that there are intermediate checkpoints available for OLMo-1B, and for OLMo-7B and OLMo-1.7-7B-hf, but there are no checkpoints for this model (OLMo-1B-hf) or the other -hf 7B model (OLMo-7B-hf). Are there any plans to add the OLMo-1B checkpoints to this repo as well, so we can use them without setting trust_remote_code=True
and installing ai2-olmo
? Thanks to the creators of OLMo for this great resource :)
As of today, we have released almost all the checkpoints of the newer allenai/OLMo-1.7-7B-hf model. The original 1B model (i.e. this repo) will probably be next.
If you have any particular intermediate checkpoints you are interested in using, then one option is to convert these to HF format yourself (it takes maybe 5-10 mins per checkpoint once you have the checkpoint on your machine). The instructions are in Checkpoints.md. The idea is to find the official checkpoint you want in https://github.com/allenai/OLMo/blob/main/checkpoints/official and then use convert_olmo_to_hf_new.py to convert it to HF format.
These checkpoints are in progress now and will hopefully be done in a day or two
They're all up now!