Nuno P. Lopes

Pfeife: Automatic Pipeline Parallelism for PyTorch

The memory requirements of machine learning (ML) models has been growing quickly. However, the memory capacity of GPUs has not kept pace. Despite significant research on reducing the memory usage of ML models, the larger models do not fit in a single device. A popular solution to the memory capacity…