Shuailou Li

Dual Decoder for Fast Inference in Natural Language Generation

Natural language generation is an important task in natural language processing and has been applied in various scenarios. Most state-of-the-art generation models, however, are usually slow at inference time mainly due to the sequential dependencies of autoregressive generation and the use of more a…