← Search

Renyu Zhu

8 accepted papers

2025

Towards Transferable Personality Representation Learning based on Triplet Comparisons and Its Applications

EMNLP 2025

Personality is an important concept in psychology that reflects individual differences in thinking and behavior, and has significant applications across various fields. Most existing personality analysis methods address this issue at the bag level, treating the entire corpus gathered from one indivi

2024

Conjoin after Decompose: Improving Few-Shot Performance of Named Entity Recognition

COLING 2024main

Prompt-based methods have been widely used in few-shot named entity recognition (NER). In this paper, we first conduct a preliminary experiment and observe that the key to affecting the performance of prompt-based NER models is the capability to detect entity boundaries. However, most existing model…

2024

Make Prompt-based Black-Box Tuning Colorful: Boosting Model Generalization from Three Orthogonal Perspectives

COLING 2024main

Large language models (LLMs) have shown increasing power on various natural language processing (NLP) tasks. However, tuning these models for downstream tasks usually needs exorbitant costs or is unavailable due to commercial considerations. Recently, black-box tuning has been proposed to address th…

2024

Structure-aware Fine-tuning for Code Pre-trained Models

COLING 2024main

Over the past few years, we have witnessed remarkable advancements in Code Pre-trained Models (CodePTMs). These models achieved excellent representation capabilities by designing structure-based pre-training tasks for code. However, how to enhance the absorption of structural knowledge when fine-tun…

Cited by 1SourcePDFScholar
2023

When Gradient Descent Meets Derivative-Free Optimization: A Match Made in Black-Box Scenario

ACL 2023findings

Large pre-trained language models (PLMs) have garnered significant attention for their versatility and potential for solving a wide spectrum of natural language processing (NLP) tasks. However, the cost of running these PLMs may be prohibitive. Furthermore, PLMs may not be open-sourced due to commer…

Cited by 8SourcePDFScholar
2022

A Neural Network Architecture for Program Understanding Inspired by Human Behaviors

ACL 2022long

Program understanding is a fundamental task in program language processing. Despite the success, existing works fail to take human behaviors as reference in understanding programs. In this paper, we consider human behaviors and propose the PGNN-EK model that consists of two main components. On the o…

2022

CAT-probing: A Metric-based Approach to Interpret How Pre-trained Models for Programming Language Attend Code Structure

EMNLP 2022finding

Code pre-trained models (CodePTMs) have recently demonstrated significant success in code intelligence. To interpret these models, some probing methods have been applied. However, these methods fail to consider the inherent characteristics of codes. In this paper, to address the problem, we propose…

2022

Finding Global Homophily in Graph Neural Networks When Meeting Heterophily

ICML 2022spotlight

We investigate graph neural networks on graphs with heterophily. Some existing methods amplify a node’s neighborhood with multi-hop neighbors to include more nodes with homophily. However, it is a significant challenge to set personalized neighborhood sizes for different nodes. Further, for other ho…