3 accepted papers
Augmenting neural machine translation with external memory at decoding time, in the form of k -nearest neighbors machine translation ( k -NN MT), is a well-established strategy for increasing translation performance. k -NN MT retrieves a set of tokens that occurred in the most similar contexts recor
Recent works have widely adopted large language model pretraining for source code, suggested source code-specific pretraining objectives and investigated the applicability of various Transformer-based language model architectures for source code. This work investigates another important aspect of su…
There is an emerging interest in the application of natural language processing models to source code processing tasks. One of the major problems in applying deep learning to software engineering is that source code often contains a lot of rare identifiers, resulting in huge vocabularies. We propose…