← Search

Woosuk Kwon

2 accepted papers

2022

A Fast Post-Training Pruning Framework for Transformers

NeurIPS 2022accept

Pruning is an effective way to reduce the huge inference cost of Transformer models. However, prior work on pruning Transformers requires retraining the models. This can add high training cost and high complexity to model deployment, making it difficult to use in many practical situations. To addres…

2020

Nimble: Lightweight and Parallel GPU Task Scheduling for Deep Learning

NeurIPS 2020spotlight

Deep learning (DL) frameworks take advantage of GPUs to improve the speed of DL inference and training. Ideally, DL frameworks should be able to fully utilize the computation power of GPUs such that the running time depends on the amount of computation assigned to GPUs. Yet, we observe that in sched…