← Search

Yunshi Lan

21 accepted papers

2026

MCP-SafetyBench: A Benchmark for Safety Evaluation of Large Language Models with Real-World MCP Servers

ICLR 2026poster

Large language models (LLMs) are evolving into agentic systems that reason, plan, and operate external tools. The Model Context Protocol (MCP) is a key enabler of this transition, offering a standardized interface for connecting LLMs with heterogeneous tools and services. Yet MCP's openness and mult…

Cited by 0SourcecodeScholar
2026

MELLA: Bridging Linguistic Capability and Cultural Groundedness for Low-Resource Language MLLMs

IJCAI 2026

Multimodal Large Language Models (MLLMs) perform strongly in high-resource languages, yet often produce fluent but culturally "thin" descriptions in low-resource settings. We argue that this failure is not merely a linguistic limitation: culture-specific visual knowledge depends on native visual-tex

Cited by 0Scholar
2025

Initializing and Retrofitting Key-Value Adaptors for Traceable Model Editing

ACL 2025finding

As the insight of knowledge storage in language models deepens, the ability to perform CRUD (Create, Read, Update, Delete) operations on language models becomes increasingly indispensable for satisfying the demands of managing rapidly updating knowledge. Considering the high cost of fine-tuning lang…

2025

Large Language Models are Good Annotators for Type-aware Data Augmentation in Grammatical Error Correction

COLING 2025main

Large Language Models (LLMs) have achieved outstanding performance across various NLP tasks. Grammatical Error Correction (GEC) is a task aiming at automatically correcting grammatical errors in text, but it encounters a severe shortage of annotated data. Researchers have tried to make full use of t…

2025

TreeEval: Benchmark-Free Evaluation of Large Language Models through Tree Planning

AAAI 2025technical

Recently, numerous new benchmarks have been established to evaluate the performance of large language models (LLMs) via either computing a holistic score or employing another LLM as a judge. However, these approaches suffer from data leakage due to the open access of the benchmark and inflexible ev…

2025

UnifiedGEC: Integrating Grammatical Error Correction Approaches for Multi-languages with a Unified Framework

COLING 2025system demonstrations

Grammatical Error Correction is an important research direction in NLP field. Although many models of different architectures and datasets across different languages have been developed to support the research, there is a lack of a comprehensive evaluation on these models, and different architecture…

2024

An LLM-Enhanced Adversarial Editing System for Lexical Simplification

COLING 2024main

Lexical Simplification (LS) aims to simplify text at the lexical level. Existing methods rely heavily on annotated data, making it challenging to apply in low-resource scenarios. In this paper, we propose a novel LS method without parallel corpora. This method employs an Adversarial Editing System w…

Cited by 5SourcePDFScholar
2024

Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis

EMNLP 2024finding

In recent years, the rapid increase in scientific papers has overwhelmed traditional review mechanisms, resulting in varying quality of publications. Although existing methods have explored the capabilities of Large Language Models (LLMs) for automated scientific reviewing, their generated contents…

2024

MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large Language Models

ECCV 2024poster

"redWarning: This paper contains examples of harmful language and images, and reader discretion is recommended. The security concerns surrounding Large Language Models (LLMs) have been extensively explored, yet the safety of Multimodal Large Language Models (MLLMs) remains understudied. In this pape…

2024

Safety of Multimodal Large Language Models on Images and Text

IJCAI 2024poster

Attracted by the impressive power of Multimodal Large Language Models (MLLMs), the public is increasingly utilizing them to improve the efficiency of daily work. Nonetheless, the vulnerabilities of MLLMs to unsafe instructions bring huge safety risks when these models are deployed in real-world scen…

2024

Unleashing the Power of Large Language Models in Zero-shot Relation Extraction via Self-Prompting

EMNLP 2024finding

Recent research in zero-shot Relation Extraction (RE) has focused on using Large Language Models (LLMs) due to their impressive zero-shot capabilities. However, current methods often perform suboptimally, mainly due to a lack of detailed, context-specific prompts needed for understanding various sen…

Cited by 0SourcePDFScholar
2023

DFRD: Data-Free Robustness Distillation for Heterogeneous Federated Learning

NeurIPS 2023poster

Federated Learning (FL) is a privacy-constrained decentralized machine learning paradigm in which clients enable collaborative training without compromising private data. However, how to learn a robust global model in the data-heterogeneous and model-heterogeneous FL scenarios is challenging. To add…

Cited by 18SourcePDFScholar
2023

GradMA: A Gradient-Memory-Based Accelerated Federated Learning With Alleviated Catastrophic Forgetting

CVPR 2023highlight

Federated Learning (FL) has emerged as a de facto machine learning area and received rapid increasing research interests from the community. However, catastrophic forgetting caused by data heterogeneity and partial participation poses distinctive challenges for FL, which are detrimental to the perfo…

2023

History Semantic Graph Enhanced Conversational KBQA with Temporal Information Modeling

ACL 2023long

Context information modeling is an important task in conversational KBQA. However, existing methods usually assume the independence of utterances and model them in isolation. In this paper, we propose a History Semantic Graph Enhanced KBQA model (HSGE) that is able to effectively model long-range se…

Cited by 2SourcePDFScholar
2023

Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models

ACL 2023long

Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, Few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step reasoning demonstrations which enable LLMs to explicitly generate…

2023

Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation

EMNLP 2023long main

The task of Question Generation over Knowledge Bases (KBQG) aims to convert a logical form into a natural language question. For the sake of expensive cost of large-scale question annotation, the methods of KBQG under low-resource scenarios urgently need to be developed. However, current methods hea…

Cited by 0SourceScholar
2023

R$^3$ Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context

EMNLP 2023long findings

With the help of Chain-of-Thought (CoT) prompting, Large Language Models (LLMs) have achieved remarkable performance on various reasoning tasks. However, most of them have been evaluated under noise-free context and the dilemma for LLMs to produce inaccurate results under the noisy context has not b…

Cited by 0SourceScholar
2023

Structure-Discourse Hierarchical Graph for Conditional Question Answering on Long Documents

ACL 2023findings

Conditional question answering on long documents aims to find probable answers and identify conditions that need to be satisfied to make the answers correct over long documents. Existing approaches solve this task by segmenting long documents into multiple sections, and attending information at glob…

2022

MWP-BERT: Numeracy-Augmented Pre-training for Math Word Problem Solving

NAACL 2022findings

Math word problem (MWP) solving faces a dilemma in number representation learning. In order to avoid the number representation issue and reduce the search space of feasible solutions, existing works striving for MWP solving usually replace real numbers with symbolic placeholders to focus on logic re…

2021

A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutions

IJCAI 2021poster

Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Recently, a large number of studies focus on semantically or syntactically complicated questions. In this paper, we elaborately summarize the typical challenges and solutions for complex KBQA. We begin wi…

Cited by 228SourcePDFScholar
2021

Modeling Transitions of Focal Entities for Conversational Knowledge Base Question Answering

ACL 2021long

Conversational KBQA is about answering a sequence of questions related to a KB. Follow-up questions in conversational KBQA often have missing information referring to entities from the conversation history. In this paper, we propose to model these implied entities, which we refer to as the focal ent…