A Novel Repetition Normalized Adversarial Reward for Headline Generation

Peng Xu; Pascale Fung

ICASSP 2019accepted0 citations

A Novel Repetition Normalized Adversarial Reward for Headline Generation

Abstract

While reinforcement learning can effectively improve language generation models, it often suffers from generating incoherent and repetitive phrases [1]. In this paper, we propose a novel repetition normalized adversarial reward to mitigate these problems. Our repetition penalized reward can greatly reduce the repetition rate and adversarial training mitigates generating incoherent phrases. Our model significantly outperforms the baseline model on ROUGE-1 (+3.24), ROUGE-L (+2.25), and a decreased repetition-rate (-4.98%).

BibTeX

@inproceedings{icassp2019_anovelrepetition,
  title = {A Novel Repetition Normalized Adversarial Reward for Headline Generation},
  author = {Peng Xu and Pascale Fung},
  booktitle = {ICASSP 2019},
  year = {2019}
}