← Search

Mengshu Sun

23 accepted papers

2026

Self-Correction Distillation for Structured Data Question Answering

AAAI 2026technical

Structured data question answering (QA), including table QA, Knowledge Graph (KG) QA, and temporal KG QA, is a pivotal research area. Advances in large language models (LLMs) have driven significant progress in unified structural QA frameworks like TrustUQA. However, these frameworks face

Cited by 0SourcePDFScholar
2026

Thinker: Training LLMs in Hierarchical Thinking for Deep Search via Multi-Turn Interaction

AAAI 2026technical

Efficient retrieval of external knowledge bases and web pages is crucial for enhancing the reasoning abilities of LLMs. Previous works on training LLMs to leverage external retrievers for solving complex problems have predominantly employed end-to-end reinforcement learning. However, these approache

Cited by 0SourcePDFScholar
2025

Have We Designed Generalizable Structural Knowledge Promptings? Systematic Evaluation and Rethinking

ACL 2025long

Large language models (LLMs) have demonstrated exceptional performance in text generation within current NLP research. However, the lack of factual accuracy is still a dark cloud hanging over the LLM skyscraper. Structural knowledge prompting (SKP) is a prominent paradigm to integrate external knowl…

2025

Improving Natural Language Understanding for LLMs via Large-Scale Instruction Synthesis

AAAI 2025technical

High-quality, large-scale instructions are crucial for aligning large language models (LLMs), however, there is a severe shortage of instruction in the field of natural language understanding (NLU). Previous works on constructing NLU instructions mainly focus on information extraction (IE), neglect…

Cited by 0SourcePDFScholar
2025

K-ON: Stacking Knowledge on the Head Layer of Large Language Model

AAAI 2025technical

Recent advancements in large language models (LLMs) have significantly improved various natural language processing (NLP) tasks. Typically, LLMs are trained to predict the next token, aligning well with many NLP tasks. However, in knowledge graph (KG) scenarios, entities are the fundamental units an…

Cited by 0SourcePDFScholar
2025

LightThinker: Thinking Step-by-Step Compression

EMNLP 2025

Large language models (LLMs) have shown remarkable performance in complex reasoning tasks, but their efficiency is hindered by the substantial memory and computational costs associated with generating lengthy tokens. In this paper, we propose LightThinker, a novel method that enables LLMs to dynamic

2025

SKA-Bench: A Fine-Grained Benchmark for Evaluating Structured Knowledge Understanding of LLMs

EMNLP 2025

Although large language models (LLMs) have made significant progress in understanding Structured Knowledge (SK) like KG and Table, existing evaluations for SK understanding are non-rigorous (i.e., lacking evaluations of specific capabilities) and focus on a single type of SK. Therefore, we aim to pr

2024

ChatUIE: Exploring Chat-based Unified Information Extraction Using Large Language Models

COLING 2024main

Recent advancements in large language models have shown impressive performance in general chat. However, their domain-specific capabilities, particularly in information extraction, have certain limitations. Extracting structured information from natural language that deviates from known schemas or i…

2024

Continual Few-shot Event Detection via Hierarchical Augmentation Networks

COLING 2024main

Traditional continual event detection relies on abundant labeled data for training, which is often impractical to obtain in real-world applications. In this paper, we introduce continual few-shot event detection (CFED), a more commonly encountered scenario when a substantial number of labeled sample…

2024

Efficient Knowledge Infusion via KG-LLM Alignment

ACL 2024findings

To tackle the problem of domain-specific knowledge scarcity within large language models (LLMs), knowledge graph-retrievalaugmented method has been proven to be an effective and efficient technique for knowledge infusion. However, existing approaches face two primary challenges: knowledge mismatch b…

2024

Gaining the Sparse Rewards by Exploring Lottery Tickets in Spiking Neural Networks

IROS 2024poster

Deploying energy-efficient deep learning algorithms on computational-limited devices, such as robots, is still a pressing issue for real-world applications. Spiking Neural Networks (SNNs), a novel brain-inspired algorithm, offer a promising solution due to their low-latency and low-energy properties…

Cited by 2SourceScholar
2024

IEPile: Unearthing Large Scale Schema-Conditioned Information Extraction Corpus

ACL 2024short

Large Language Models (LLMs) demonstrate remarkable potential across various domains; however, they exhibit a significant performance gap in Information Extraction (IE). Note that high-quality instruction data is the vital key for enhancing the specific capabilities of LLMs, while current IE dataset…

2024

MKGL: Mastery of a Three-Word Language

NeurIPS 2024spotlight

Large language models (LLMs) have significantly advanced performance across a spectrum of natural language processing (NLP) tasks. Yet, their application to knowledge graphs (KGs), which describe facts in the form of triplets and allow minimal hallucinations, remains an underexplored frontier. In th…

Cited by 1SourcePDFScholar
2024

OneGen: Efficient One-Pass Unified Generation and Retrieval for LLMs

EMNLP 2024finding

Despite the recent advancements in Large Language Models (LLMs), which have significantly enhanced the generative capabilities for various NLP tasks, LLMs still face limitations in directly handling retrieval tasks. However, many practical applications demand the seamless integration of both retriev…

2024

Zero-Shot Cross-Lingual Document-Level Event Causality Identification with Heterogeneous Graph Contrastive Transfer Learning

COLING 2024main

Event Causality Identification (ECI) refers to the detection of causal relations between events in texts. However, most existing studies focus on sentence-level ECI with high-resource languages, leaving more challenging document-level ECI (DECI) with low-resource languages under-explored. In this pa…

2023

LEGO: A Multi-agent Collaborative Framework with Role-playing and Iterative Feedback for Causality Explanation Generation

EMNLP 2023long findings

Causality Explanation Generation refers to generate an explanation in natural language given an initial cause-effect pair. It demands rigorous explicit rationales to demonstrate the acquisition of implicit commonsense knowledge, which is unlikely to be easily memorized, making it challenging for lar…

Cited by 0SourceScholar
2023

Peeling the Onion: Hierarchical Reduction of Data Redundancy for Efficient Vision Transformer Training

AAAI 2023technical

Vision transformers (ViTs) have recently obtained success in many applications, but their intensive computation and heavy memory usage at both training and inference time limit their generalization. Previous compression algorithms usually start from the pre-trained dense models and only focus on eff…

2022

Extracting Trigger-sharing Events via an Event Matrix

EMNLP 2022finding

A growing interest emerges in event extraction which aims to extract multiple events with triggers and arguments. Previous methods mitigate the problem of multiple events extraction by predicting the arguments conditioned on the event trigger and event type, assuming that these arguments belong to a…

2022

SPViT: Enabling Faster Vision Transformers via Latency-Aware Soft Token Pruning

ECCV 2022poster

"Recently, Vision Transformer (ViT) has continuously established new milestones in the computer vision field, while the high computation and memory cost makes its propagation in industrial production difficult. Considering the computation complexity, the internal data pattern of ViTs, and the edge d…

2021

RMSMP: A Novel Deep Neural Network Quantization Framework With Row-Wise Mixed Schemes and Multiple Precisions

ICCV 2021poster

This work proposes a novel Deep Neural Network (DNN) quantization framework, namely RMSMP, with a \underline R ow-wise \underline M ixed-\underline S cheme and \underline M ulti-\underline P recision approach. Specifically, this is the first effort to assign mixed quantization schemes and multiple p…

Cited by 19PDFScholar
2021

RT3D: Achieving Real-Time Execution of 3D Convolutional Neural Networks on Mobile Devices

AAAI 2021technical

Mobile devices are becoming an important carrier for deep learning tasks, as they are being equipped with powerful, high-end mobile CPUs and GPUs. However, it is still a challenging task to execute 3D Convolutional Neural Networks (CNNs) targeting for real-time performance, besides high inference ac…

Cited by 14SourcePDFScholar
2020

Adversarial T-shirt! Evading Person Detectors in A Physical World

ECCV 2020poster

It is known that deep neural networks (DNNs) are vulnerable to adversarial attacks. The so-called physical adversarial examples deceive DNN-based decision makers by attaching adversarial patches to real objects. However, most of the existing works on physical adversarial attacks focus on static obje…

Cited by 435SourcePDFScholar
2020

Towards an Efficient and General Framework of Robust Training for Graph Neural Networks

ICASSP 2020accepted

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications. However, despite GNNs' impressive performance, it has been obser…

Cited by 0SourceScholar