Pile-T5

Yi-34B, Llama 2, and common practices in LLM training

Llemma: An Open Language Model For Mathematics

Basic math related to computation and memory usage for transformers

Exploratory Analysis of TRLX RLHF Transformers with TransformerLens

EleutherAI announces it has become a non-profit

Announcing GPT-NeoX-20B

EleutherAI One Year Retrospective