Yibiao Yang

Towards Better Code Understanding in Decoder-Only Models with Contrastive Learning

Recent advances in large-scale code generation models have led to remarkable progress in producing high-quality code. These models are trained in a self-supervised manner on extensive unlabeled code corpora using a decoder-only architecture. However, despite their generative strength, decoder-only m