← Search

Less Wright

2 accepted papers

2025

Accelerating neural network training: An analysis of the AlgoPerf competition

ICLR 2025poster

The goal of the AlgoPerf: Training Algorithms competition is to evaluate practical speed-ups in neural network training achieved solely by improving the underlying training algorithms. In the external tuning ruleset, submissions must provide workload-agnostic hyperparameter search spaces, while in t…

Cited by 0SourcePDFScholar
2025

TorchTitan: One-stop PyTorch native solution for production ready LLM pretraining

ICLR 2025poster

The development of large language models (LLMs) has been instrumental in advancing state-of-the-art natural language processing applications. Training LLMs with billions of parameters and trillions of tokens requires sophisticated distributed systems that enable composing and comparing several state…