← Search

Guangji Bai

7 accepted papers

2025

FedSpaLLM: Federated Pruning of Large Language Models

NAACL 2025long

Large Language Models (LLMs) achieve state-of-the-art performance but are challenging to deploy due to their high computational and storage demands. Pruning can reduce model size, yet existing methods assume public access to calibration data, which is impractical for privacy-sensitive applications.…

2024

SparseLLM: Towards Global Pruning of Pre-trained Language Models

NeurIPS 2024poster

The transformative impact of large language models (LLMs) like LLaMA and GPT on natural language processing is countered by their prohibitive computational demands. Pruning has emerged as a pivotal compression strategy, introducing sparsity to enhance both memory and computational efficiency. Yet, t…

2024

Uncertainty Quantification for In-Context Learning of Large Language Models

NAACL 2024long

In-context learning has emerged as a groundbreaking ability of Large Language Models (LLMs) and revolutionized various fields by providing a few task-relevant demonstrations in the prompt. However, trustworthy issues with LLM’s response, such as hallucination, have also been actively discussed. Exis…

2024

Visual Attention Prompted Prediction and Learning

IJCAI 2024poster

Visual explanation (attention)-guided learning uses not only labels but also explanations to guide the model reasoning process. While visual attention-guided learning has shown promising results, it requires a large number of explanation annotations that are time-consuming to prepare. However, in ma…

2023

Temporal Domain Generalization with Drift-Aware Dynamic Neural Networks

ICLR 2023top-5%

Temporal domain generalization is a promising yet extremely challenging area where the goal is to learn models under temporally changing data distributions and generalize to unseen data distributions following the trends of the change. The advancement of this area is challenged by: 1) characterizing…