← Search

Jun Yao

9 accepted papers

2025

FlatQuant: Flatness Matters for LLM Quantization

ICML 2025poster

Recently, quantization has been widely used for the compression and acceleration of large language models (LLMs). Due to the outliers in LLMs, it is crucial to flatten weights and activations to minimize quantization error with equally spaced quantization points. Prior research explores various pre-…

2025

GSDNet: Revisiting Incomplete Multimodality-Diffusion Emotion Recognition from the Perspective of Graph Spectrum

IJCAI 2025

Multimodal Emotion Recognition (MER) combines technologies from multiple fields (e.g., computer vision, natural language processing, and audio signal processing), aiming to infer an individual's emotional state by analyzing information from different sources (i.e., video, audio, and text). Compared

Cited by 0SourcePDFScholar
2024

IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact

ACL 2024findings

Large language models (LLMs) excel in natural language processing but demand intensive computation. To mitigate this, various quantization methods have been explored, yet they compromise LLM performance. This paper unveils a previously overlooked type of outliers in LLMs. Such outliers are found to…

2024

Sparse Multi-Relational Graph Convolutional Network for Multi-type Object Trajectory Prediction

IJCAI 2024poster

Object trajectory prediction is a hot research issue with wide applications in video surveillance and autonomous driving. The previous studies consider the interaction sparsity mainly among the pedestrians instead of multi-type of objects, which brings new types of interactions and consequently supe…

Cited by 1SourcePDFScholar
2023

ArCL: Enhancing Contrastive Learning with Augmentation-Robust Representations

ICLR 2023poster

Self-Supervised Learning (SSL) is a paradigm that leverages unlabeled data for model training. Empirical studies show that SSL can achieve promising performance in distribution shift scenarios, where the downstream and training distributions differ. However, the theoretical understanding of its tran…

Cited by 8SourcePDFScholar
2023

When Noisy Labels Meet Long Tail Dilemmas: A Representation Calibration Method

ICCV 2023oral

Real-world large-scale datasets are both noisily labeled and class-imbalanced. The issues seriously hurt the generalization of trained models. It is hence significant to address the simultaneous incorrect labeling and class-imbalance, i.e., the problem of learning with noisy labels on long-tailed da…

Cited by 25PDFcodeScholar
2022

Accelerating Sparse Convolution with Column Vector-Wise Sparsity

NeurIPS 2022accept

Weight sparsity is a promising approach to reducing the model size and computation cost of convolutional neural networks (CNNs). Nevertheless, non-zero weights often distribute randomly in sparse CNN models, introducing enormous difficulty in obtaining actual speedup on common hardware (e.g., GPU) o…

Cited by 14SourcePDFScholar
2021

Commission Fee is not Enough: A Hierarchical Reinforced Framework for Portfolio Management

AAAI 2021technical

Portfolio management via reinforcement learning is at the forefront of fintech research, which explores how to optimally reallocate a fund into different financial assets over the long term by trial-and-error. Existing methods are impractical since they usually assume each reallocation can be finish…

Cited by 50SourcePDFScholar