← Search

Kaixin Li

14 accepted papers

2026

Bringing Code ALIVE: Optimizing Interactive Frontend Mini-Games via Automated Play and Reinforcement Learning at Scale

ICML 2026poster

The rapid evolution of Large Language Models (LLMs) has empowered even non-programmers to create visually appealing frontend mini-games with a single instruction. However, open-source models significantly lag behind proprietary counterparts in this domain. The core bottleneck is the lack of an evalu…

Cited by 0SourceScholar
2026

Grounding Computer Use Agents on Human Demonstrations

ICLR 2026poster

Building reliable computer-use agents requires grounding: accurately connecting natural language instructions to the correct on-screen elements. While large datasets exist for web and mobile interactions, high-quality resources for desktop environments are limited. To address this gap, we introduce…

Cited by 0SourcecodeScholar
2026

Grounding and Enhancing Informativeness and Utility in Dataset Distillation

ICLR 2026poster

Dataset Distillation (DD) seeks to create a compact dataset from a large, real-world dataset. While recent methods often rely on heuristic approaches to balance efficiency and quality, the fundamental relationship between original and synthetic data remains underexplored. This paper revisits knowled…

Cited by 0SourceScholar
2026

HackWorld: Evaluating Computer-Use Agents on Exploiting Web Application Vulnerabilities

ICLR 2026poster

Web applications are prime targets for cyberattacks due to their role as entry points to vital services and sensitive data repositories. Traditional penetration testing is expensive and requires specialized expertise, creating scalability challenges for securing the expanding web ecosystem. While la…

Cited by 0SourcecodeScholar
2025

A Quadrotor Aerial Docking System Utilizing Both Vision and Magnetic Field

RA-L 2025

This paper presents a complete quadrotor aerial docking system that utilizes both vision and magnetic field guidance to achieve high-precision docking. Visual guidance is implemented using a combination of a forward-facing camera and an upward-facing camera, which provide feedback on the local and r

Cited by 1SourceScholar
2025

AdamMeme: Adaptively Probe the Reasoning Capacity of Multimodal Large Language Models on Harmfulness

ACL 2025long

The proliferation of multimodal memes in the social media era demands that multimodal Large Language Models (mLLMs) effectively understand meme harmfulness. Existing benchmarks for assessing mLLMs on harmful meme understanding rely on accuracy-based, model-agnostic evaluations using static datasets.…

2025

Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning

ACL 2025long

Fine-tuning large language models (LLMs) on task-specific data is essential for their effective deployment. As dataset sizes grow, efficiently selecting optimal subsets for training becomes crucial to balancing performance and computational costs. Traditional data selection methods often require fin…

2025

MM-CRITIC: A Holistic Evaluation of Large Multimodal Models as Multimodal Critique

EMNLP 2025

The ability of critique is vital for models to self-improve and serve as reliable AI assistants. While extensively studied in language-only settings, multimodal critique of Large Multimodal Models (LMMs) remains underexplored despite their growing capabilities in tasks like captioning and visual rea

2025

MemeArena: Automating Context-Aware Unbiased Evaluation of Harmfulness Understanding for Multimodal Large Language Models

EMNLP 2025

The proliferation of memes on social media necessitates the capabilities of multimodal Large Language Models (mLLMs) to effectively understand multimodal harmfulness. Existing evaluation approaches predominantly focus on mLLMs’ detection accuracy for binary classification tasks, which often fail to

2025

Robi Butler: Multimodal Remote Interaction with a Household Robot Assistant

ICRA 2025

Imagine a future when we can Zoom-call a robot to manage household chores remotely. This work takes one step in this direction. Robi Butler is a new household robot assistant that enables seamless multimodal remote interaction. It allows the human user to monitor its environment from a first-person

Cited by 6SourceScholar
2025

SE-GUI: Enhancing Visual Grounding for GUI Agents via Self-Evolutionary Reinforcement Learning

NeurIPS 2025poster

Graphical User Interface (GUI) agents have made substantial strides in understanding and executing user instructions across diverse platforms. Yet, grounding these instructions to precise interface elements remains challenging—especially in complex, high-resolution, professional environments. Tradit…

Cited by 0SourceScholar
2025

Tree-of-Evolution: Tree-Structured Instruction Evolution for Code Generation in Large Language Models

ACL 2025long

Data synthesis has become a crucial research area in large language models (LLMs), especially for generating high-quality instruction fine-tuning data to enhance downstream performance. In code generation, a key application of LLMs, manual annotation of code instruction data is costly. Recent method…

2024

Design and Flight Control of a Novel Tilt-Rotor Octocopter Using Passive Hinges

RA-L 2024

This letter presents a novel tilt-rotor octocopter that can generate tiltable thrust without the need for servo-driven mechanisms. The octocopter's eight rotors are divided into pairs and each pair is mounted on an arm, which is connected to the airframe through passive hinges. Each pair is also equ

Cited by 15SourceScholar
2024

MMCode: Benchmarking Multimodal Large Language Models for Code Generation with Visually Rich Programming Problems

EMNLP 2024finding

Programming often involves converting detailed and complex specifications into code, a process during which developers typically utilize visual aids to more effectively convey concepts. While recent developments in Large Multimodal Models have demonstrated remarkable abilities in visual reasoning an…