New preprint on LLM pretraining and in-context learning
Released our paper “How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off” - joint work with Ali Hasan from our Morgan Stanley collaboration. Read the paper.
Released our paper “How Does the Pretraining Distribution Shape In-Context Learning? A Fundamental Trade-Off” - joint work with Ali Hasan from our Morgan Stanley collaboration. Read the paper.