Yi-Reun Kim

Local Temperature Beam Search: Avoid Neural Text DeGeneration via Enhanced Calibration

Previous studies have constantly observed that a language model repeats itself, creating repetitions in an output sequence. To cope with the issue, stochastic decoding schemes have been the de facto approaches; the strategies add randomness in inference, hence avoiding the “self-loop”. However, the…