← Search

Cong Liao

4 accepted papers

2024

AmortizedPeriod: Attention-based Amortized Inference for Periodicity Identification

ICLR 2024poster

Periodic patterns are a fundamental characteristic of time series in natural world, with significant implications for a range of disciplines, from economics to cloud systems. However, the current literature on periodicity detection faces two key challenges: limited robustness in real-world scenarios…

Cited by 1SourcePDFScholar
2024

CoBa: Convergence Balancer for Multitask Finetuning of Large Language Models

EMNLP 2024main

Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, presenting a resource-efficient alternative to developing separate models for each task. Yet, existing MTL strategies for…

2023

ZeroAE: Pre-trained Language Model based Autoencoder for Transductive Zero-shot Text Classification

ACL 2023findings

Many text classification tasks require handling unseen domains with plenty of unlabeled data, thus giving rise to the self-adaption or the so-called transductive zero-shot learning (TZSL) problem. However, current methods based solely on encoders or decoders overlook the possibility that these two m…

2022

Pyraformer: Low-Complexity Pyramidal Attention for Long-Range Time Series Modeling and Forecasting

ICLR 2022oral

Accurate prediction of the future given the past based on time series data is of paramount importance, since it opens the door for decision making and risk management ahead of time. In practice, the challenge is to build a flexible but parsimonious model that can capture a wide range of temporal dep…