← Search

Chengyi Yang

10 accepted papers

2026

ZeroUnlearn: Few-Shot Knowledge Unlearning in Large Language Models

ICML 2026poster

Large language models inevitably retain sensitive information, defined as inputs that may induce harmful generations, due to training on massive web corpora, raising concerns for privacy and safety. Existing machine unlearning methods primarily rely on retraining or aggressive fine-tuning, which are…

Cited by 0SourceScholar
2025

HCLTS: Mining Customers' Consumption Patterns in Natural Gas Time Series with Hierarchical Contrastive Learning

ICASSP 2025accepted

Accurate forecasting of resource consumption, such as gas, is essential for efficient energy management, cost reduction, and sustainability. Time series forecasting (TSF) techniques like recurrent neural networks (RNNs), convolutional networks (TCNs), and Transformers have been employed to model com…

Cited by 0SourceScholar
2025

LagTS: Toward Adaptive Lag Relationship Modeling for Multivariate Time Series Forecasting

ICASSP 2025accepted

Multivariate time series forecasting has become increasingly crucial in fields such as energy and transportation. Recent research has focused on local lag relationships across variates, yielding impressive results. However, these methods typically require pre-calculating lag indicators and steps bet…

Cited by 0SourceScholar
2025

Locate-and-Focus: Enhancing Terminology Translation in Speech Language Models

ACL 2025long

Direct speech translation (ST) has garnered increasing attention nowadays, yet the accurate translation of terminology within utterances remains a great challenge. In this regard, current studies mainly concentrate on leveraging various translation knowledge into ST models. However, these methods of…

Cited by 0SourcePDFScholar
2025

Tribe Graph Enhanced Bidirectional Mamba for Multivariate Time Series Forecasting

ICASSP 2025accepted

In multivariate time series forecasting, transformer-based methods have gained attention for their ability to capture complex dependencies and are often integrated with graph neural networks to improve forecasting performance. However, these approaches are computationally intensive. Mamba, a more co…

Cited by 0SourceScholar
2024

HiFi-Gas: Hierarchical Federated Learning Incentive Mechanism Enhanced Gas Usage Estimation

AAAI 2024technical

Gas usage estimation plays a critical role in various aspects of the power generation and delivery business, including budgeting, resource planning, and environmental preservation. Federated Learning (FL) has demonstrated its potential in enhancing the accuracy and reliability of gas usage estimatio…

Cited by 9SourcePDFScholar
2024

Mitigating Catastrophic Forgetting in Large Language Models with Self-Synthesized Rehearsal

ACL 2024long

Large language models (LLMs) suffer from catastrophic forgetting during continual learning. Conventional rehearsal-based methods rely on previous training data to retain the model’s ability, which may not be feasible in real-world applications. When conducting continual learning based on a publicly-…

2024

Towards Better Graph-based Cross-document Relation Extraction via Non-bridge Entity Enhancement and Prediction Debiasing

ACL 2024findings

Cross-document Relation Extraction aims to predict the relation between target entities located in different documents. In this regard, the dominant models commonly retain useful information for relation prediction via bridge entities, which allows the model to elaborately capture the intrinsic inte…

2023

Efficient Training of Large-Scale Industrial Fault Diagnostic Models through Federated Opportunistic Block Dropout

AAAI 2023technical

Artificial intelligence (AI)-empowered industrial fault diagnostics is important in ensuring the safe operation of industrial applications. Since complex industrial systems often involve multiple industrial plants (possibly belonging to different companies or subsidiaries) with sensitive data collec…

Cited by 7SourcePDFScholar