← Search

Liangyu Chen

20 accepted papers

2026

ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing

AAAI 2026technical

Chart editing reduces manual effort in visualization design. Typical benchmarks assume access to complete chart code, which is unrealistic for real-world applications. In this paper, we present ChartEditVista, a comprehensive benchmark consisting of 7,964 samples spanning 31 chart categories. It enc

Cited by 0SourcePDFScholar
2026

DOCKSMITH: Scaling Reliable Coding Environments via an Agentic Docker Builder

ICML 2026poster

Reliable Docker-based environment construction is a dominant bottleneck for scaling execution-grounded training and evaluation of software engineering agents. We introduce DockSmith, a specialized agentic Docker builder designed to address this challenge. DockSmith treats environment construction no…

Cited by 0SourceScholar
2026

DUP: Detection-guided Unlearning for Backdoor Purification in Language Models

AAAI 2026technical

As backdoor attacks become more stealthy and robust, they reveal critical weaknesses in current defense strategies: detection methods often rely on coarse-grained feature statistics, and purification methods typically require full retraining or additional clean models. To address these challenges, w

Cited by 0SourcePDFScholar
2026

Tighter Truncated Rectangular Prism Approximation for RNN Robustness Verification

AAAI 2026technical

Robustness verification is a promising technique for rigorously proving Recurrent Neural Networks (RNNs) robustly. A key challenge is to over-approximate the nonlinear activation functions with linear constraints, which can transform the verification problem into an efficiently solvable linear progr

Cited by 0SourcePDFScholar
2026

UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction as Reasoning

ICLR 2026poster

GUI grounding, which maps natural-language instructions to actionable UI elements, is a core capability of GUI agents. Prior work largely treats instructions as a static proxy for user intent, overlooking the impact of instruction diversity on grounding performance. Through a careful investigation o…

Cited by 0SourcecodeScholar
2026

ViSurf: Visual Supervised-and-Reinforcement Fine-Tuning for Large Vision-and-Language Models

ICML 2026poster

Post-training Large Vision-and-Language Models (LVLMs) typically involves Supervised Fine-Tuning (SFT) for knowledge injection or Reinforcement Learning with Verifiable Rewards (RLVR) for performance enhancement. However, SFT often leads to sub-optimal performance, while RLVR remains constrained by …

Cited by 0SourceScholar
2025

Aurora-M: Open Source Continual Pre-training for Multilingual Language and Code

COLING 2025industry

Pretrained language models are integral part of AI applications, but their high computational cost for training limits accessibility. Initiatives such as Bloom and StarCoder aim to democratize access to pretrained models for collaborative community development. Despite these efforts, such models enc…

Cited by 2SourcePDFScholar
2025

BERT-Based Code Learning for Exception Localization and Type Prediction

AAAI 2025technical

Exception handling is crucial but challenging in program development. It needs to identify and handle all potential exceptions within programs to ensure system security and stabilization. Traditional exception handling relies on the expertise and experience of programmers, which often leads to overs…

Cited by 0SourcePDFScholar
2025

BIOMEDICA: An Open Biomedical Image-Caption Archive, Dataset, and Vision-Language Models Derived from Scientific Literature

CVPR 2025poster

The development of vision-language models (VLMs) is driven by large-scale and diverse multi-modal datasets. However, progress toward generalist biomedical VLMs is limited by the lack of annotated, publicly accessible datasets across biology and medicine. Existing efforts are limited to narrow domain…

2025

C3oT: Generating Shorter Chain-of-Thought Without Compromising Effectiveness

AAAI 2025technical

Generating Chain-of-Thought (CoT) before deriving the answer can effectively improve the reasoning capabilities of large language models (LLMs) and significantly improve the accuracy of the generated answer. However, in most cases, the length of the generated CoT is much longer than the desired fina…

Cited by 10SourcePDFScholar
2025

MMInA: Benchmarking Multihop Multimodal Internet Agents

ACL 2025finding

Autonomous embodied agents live on an Internet of multimedia websites. Can they hop around multimodal websites to complete complex user tasks? Existing benchmarks fail to assess them in a realistic, evolving environment for their embodiment across websites. To answer this question, we present MMInA,…

2024

LAMP: Learn A Motion Pattern for Few-Shot Video Generation

CVPR 2024poster

In this paper we present a few-shot text-to-video framework LAMP which enables a text-to-image diffusion model to Learn A specific Motion Pattern with 8 16 videos on a single GPU. Unlike existing methods which require a large number of training resources or learn motions that are precisely aligned w…

2024

MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations

NeurIPS 2024spotlight

Understanding documents with rich layouts and multi-modal components is a long-standing and practical task. Recent Large Vision-Language Models (LVLMs) have made remarkable strides in various tasks, particularly in single-page document understanding (DU). However, their abilities on long-context DU…

Cited by 27SourcePDFScholar
2023

Large Language Models are Visual Reasoning Coordinators

NeurIPS 2023poster

Visual reasoning requires multimodal perception and commonsense cognition of the world. Recently, multiple vision-language models (VLMs) have been proposed with excellent commonsense reasoning ability in various domains. However, how to harness the collective power of these complementary VLMs is rar…

2023

Panoptic Video Scene Graph Generation

CVPR 2023poster

Towards building comprehensive real-world visual perception systems, we propose and study a new problem called panoptic scene graph generation (PVSG). PVSG is related to the existing video scene graph generation (VidSGG) problem, which focuses on temporal interactions between humans and objects loca…

2022

Improving Image Restoration by Revisiting Global Information Aggregation

ECCV 2022poster

"Global operations, such as global average pooling, are widely used in top-performance image restorers. They aggregate global information from input features along entire spatial dimensions but behave differently during training and inference in image restoration tasks: they are based on different r…

2022

To Answer or Not To Answer? Improving Machine Reading Comprehension Model with Span-based Contrastive Learning

NAACL 2022findings

Machine Reading Comprehension with Unanswerable Questions is a difficult NLP task, challenged by the questions which can not be answered from passages. It is observed that subtle literal changes often make an answerable question unanswerable, however, most MRC models fail to recognize such changes.…

2021

Points As Queries: Weakly Semi-Supervised Object Detection by Points

CVPR 2021poster

We propose a novel point annotated setting for the weakly semi-supervised object detection task, in which the dataset comprises small fully annotated images and large weakly annotated images by points. It achieves a balance between tremendous annotation burden and detection performance. Based on thi…

Cited by 110PDFScholar