New preprint on LLM pretraining and in-context learning
Released our paper “How does the pretraining distribution shape in-context learning?” - joint work with Ali Hasan from our Morgan Stanley collaboration. Available on arXiv.
Released our paper “How does the pretraining distribution shape in-context learning?” - joint work with Ali Hasan from our Morgan Stanley collaboration. Available on arXiv.