Dust: Pretraining Transformers Without Backpropagation

NanoGPT Slowrun: 10x Data Efficiency with Infinite Compute

NanoGPT Slowrun: Language Modeling with Limited Data, Infinite Compute