Back to projectsEffective learning rate & pretraining dynamicsFurther details will be added here in a future update.Read the paper on arXiv