← Search

Yuxin Wang

52 accepted papers

2026

From Interactions to Principles: Experience-Driven Self-Distillation for Evolving LLM Agents

ICML 2026poster

LLM agents have achieved strong performance in tool-augmented reasoning, but most remain largely stateless: after each episode, the agent discards interaction traces and does not accumulate reusable strategies. Prior work either stores raw trajectories for case-based reuse or relies on external teac…

Cited by 0SourceScholar
2026

Identifying and Mitigating Errors in Gradient Aggregation of Distributed Data Parallel Training

ICML 2026poster

Hardware-related silent data corruptions during gradient aggregation pose significant challenges to fault-tolerant distributed training, often leading to slow or failed convergence. To address this, we first mathematically formulate these errors as gradient inconsistency and theoretically analyze ho…

Cited by 0SourceScholar
2026

JAEGER: Joint 3D Audio-Visual Grounding and Reasoning in Simulated Physical Environments

ICML 2026poster

Current audio-visual large language models (AV-LLMs) are predominantly restricted to 2D perception, relying on RGB video and monaural audio. This design choice introduces a fundamental dimensionality mismatch that precludes reliable source localization and spatial reasoning in complex 3D environment…

Cited by 0SourceScholar
2026

Reasoning Language Model Inference Serving Unveiled: An Empirical Study

ICLR 2026poster

The reasoning large language model (RLLM) has been proven competitive in solving complex reasoning tasks such as mathematics, coding, compared to traditional LLM. However, the serving performance and behavior of RLLM remains \textit{unexplored}, which may undermine the deployment and utilization of…

Cited by 0SourcecodeScholar
2026

ResearchEnvBench: Benchmarking Agents on Environment Synthesis for Research Code Execution

IJCAI 2026

Autonomous agents are increasingly expected to support scientific research, and recent benchmarks report progress in code repair and autonomous experimentation. However, these evaluations typically assume a pre-configured execution environment, which requires resolving complex software dependencies,

Cited by 0Scholar
2026

StyleDistillation: A New Insight of Image Style Enables Personalized Aesthetic Manipulation

ICML 2026poster

Text-guided stylized image generation has yielded promising advances by leveraging the powerful capabilities of text-to-image diffusion models. However, the inherent coupling of style and content information within the reference image presents a significant challenge. To address this, we propose Sty…

Cited by 0SourceScholar
2026

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces

ICLR 2026poster

AI agents may soon become capable of autonomously completing valuable, long-horizon tasks in diverse domains. Current benchmarks either do not measure real-world tasks, or are not sufficiently difficult to meaningfully measure frontier models. To this end, we present Terminal-Bench 1.5: a carefully…

Cited by 0SourcecodeScholar
2026

Test-Time Scaling with Reflective Generative Model

ICLR 2026poster

We introduce a new Reflective Generative Model (RGM), which obtains OpenAI o3-mini's performance via a novel Reflective Generative Form. This form focuses on high-quality reasoning trajectory selection and contains two novelties: 1) A unified interface for policy and process reward model: we share t…

Cited by 0SourcecodeScholar
2026

Unveiling Multi-regime Patterns in SciML: Distinct Failure Modes and Regime-specific Optimization

ICML 2026poster

Neural networks (NNs) trained under different hyperparameters can fall into distinct training ``regimes'', with models in the same regime showing homogeneous properties and models across regimes differing qualitatively. In this paper, we analyze multi-regime patterns in scientific machine learning (…

Cited by 0SourceScholar
2025

CFSP: An Efficient Structured Pruning Framework for LLMs with Coarse-to-Fine Activation Information

COLING 2025main

The colossal parameters and computational overhead of Large Language Models (LLMs) challenge their real-world applications. Network pruning, which targets unstructured or structured sparsity by removing redundant parameters, has recently been explored for LLM acceleration. Existing LLM pruning works…

2025

Constructing Confidence Intervals for Average Treatment Effects from Multiple Datasets

ICLR 2025poster

Constructing confidence intervals (CIs) for the average treatment effect (ATE) from patient records is crucial to assess the effectiveness and safety of drugs. However, patient records typically come from different hospitals, thus raising the question of how multiple observational/experimental datas…

2025

From One to More: Contextual Part Latents for 3D Generation

ICCV 2025poster

To generate 3D objects, early research focused on multi-view-driven approaches relying solely on 2D renderings. Recently, the 3D native latent diffusion paradigm has demonstrated superior performance in 3D generation, because it fully leverages the geometric information provided in ground truth 3D d…

2025

GRIP: A Graph-Based Reasoning Instruction Producer

NeurIPS 2025poster

Large-scale, high-quality data is essential for advancing the reasoning capabilities of large language models (LLMs). As publicly available Internet data becomes increasingly scarce, synthetic data has emerged as a crucial research direction. However, existing data synthesis methods often suffer fro…

Cited by 0SourceScholar
2025

IGD: Instructional Graphic Design with Multimodal Layer Generation

ICCV 2025poster

Graphic design visually conveys information and data by creating and combining text, images and graphics. Two-stage methods that rely primarily on layout generation lack creativity and intelligence, making graphic design still labor-intensive. Existing diffusion-based methods generate non-editable g…

2025

ImpScore: A Learnable Metric For Quantifying The Implicitness Level of Sentences

ICLR 2025spotlight

Handling implicit language is essential for natural language processing systems to achieve precise text understanding and facilitate natural interactions with users. Despite its importance, the absence of a metric for accurately measuring the implicitness of language significantly constrains the dep…

2025

Integrating Visual Modalities with Large Language Models for Mental Health Support

COLING 2025main

Current work of mental health support primarily utilizes unimodal textual data and often fails to understand and respond to users’ emotional states comprehensively. In this study, we introduce a novel framework that enhances Large Language Model (LLM) performance in mental health dialogue systems by…

Cited by 1SourcePDFScholar
2025

Prior-Fitted Networks Scale to Larger Datasets When Treated as Weak Learners

AISTATS 2025poster

Prior-Fitted Networks (PFNs) have recently been proposed to efficiently perform tabular classification tasks. Although they achieve good performance on small datasets, they encounter limitations with larger datasets. These limitations include significant memory consumption and increased computationa…

Cited by 0SourcecodeScholar
2025

R3-RAG: Learning Step-by-Step Reasoning and Retrieval for LLMs via Reinforcement Learning

EMNLP 2025

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to their limited parameters compared to LLMs and their inability to

2025

Recontextualizing Revitalization: A Mixed Media Approach to Reviving the Nüshu Language

EMNLP 2025

Nüshu is an endangered language from Jiangyong County, China, and the world’s only known writing system created and used exclusively by women. Recent Natural Language Processing (NLP) work has digitized small Nüshu-Chinese corpora, but the script remains computationally inaccessible due to its handw

Cited by 0SourcePDFScholar
2025

SynTab-LLaVA: Enhancing Multimodal Table Understanding with Decoupled Synthesis

CVPR 2025poster

Due to the limited scale of multimodal table understanding (MTU) data, model performance is constrained. A straightforward approach is to use multimodal large language models to obtain more samples, but this may cause hallucinations, generate incorrect sample pairs, and cost significantly.To address…

2025

VehicleWorld: A Highly Integrated Multi-Device Environment for Intelligent Vehicle Interaction

EMNLP 2025

Intelligent vehicle cockpits present unique challenges for API Agents, requiring coordination across tightly-coupled subsystems that exceed typical task environments’ complexity. Traditional Function Calling (FC) approaches operate statelessly, requiring multiple exploratory calls to build environme

2025

Visibility as Survival: Generalizing NLP for Native Alaskan Language Identification

ACL 2025finding

Indigenous languages remain largely invisible in commercial language identification (LID) systems, a stark reality exemplified by Google Translate’s LangID tool, which supports over 100 languages but excludes all 150 Indigenous languages of North America. This technological marginalization is partic…

Cited by 0SourcePDFScholar
2024

Angle Robustness Unmanned Aerial Vehicle Navigation in GNSS-Denied Scenarios

AAAI 2024technical

Due to the inability to receive signals from the Global Navigation Satellite System (GNSS) in extreme conditions, achieving accurate and robust navigation for Unmanned Aerial Vehicles (UAVs) is a challenging task. Recently emerged, vision-based navigation has been a promising and feasible alternativ…

2024

Boosting Semi-Supervised Scene Text Recognition via Viewing and Summarizing

NeurIPS 2024poster

Existing scene text recognition (STR) methods struggle to recognize challenging texts, especially for artistic and severely distorted characters. The limitation lies in the insufficient exploration of character morphologies, including the monotonousness of widely used synthetic training data and the…

2024

HARMONIC: Harnessing LLMs for Tabular Data Synthesis and Privacy Protection

NeurIPS 2024poster

Data serves as the fundamental basis for advancing deep learning. The tabular data presented in a structured format is highly valuable for modeling and training. However, even in the era of LLM, obtaining tabular data from sensitive domains remains a challenge due to privacy or copyright concerns.…

Cited by 10SourcePDFScholar
2024

Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal

ECCV 2024poster

"This paper tackles the intricate challenge of object removal to update the radiance field using the 3D Gaussian Splatting. The main challenges of this task lie in the preservation of geometric consistency and the maintenance of texture coherence in the presence of the substantial discrete nature of…

2024

Leveraging Text Localization for Scene Text Removal via Text-aware Masked Image Modeling

ECCV 2024poster

"Existing scene text removal (STR) task suffers from insufficient training data due to the expensive pixel-level labeling. In this paper, we aim to address this issue by introducing a Text-aware Masked Image Modeling algorithm (TMIM), which can pretrain STR models with low-cost text detection labels…

2024

MentalManip: A Dataset For Fine-grained Analysis of Mental Manipulation in Conversations

ACL 2024long

Mental manipulation, a significant form of abuse in interpersonal conversations, presents a challenge to identify due to its context-dependent and often subtle nature. The detection of manipulative language is essential for protecting potential victims, yet the field of Natural Language Processing (…

2024

OTE: Exploring Accurate Scene Text Recognition Using One Token

CVPR 2024poster

In this paper we propose a novel framework to fully exploit the potential of a single vector for scene text recognition (STR). Different from previous sequence-to-sequence methods that rely on a sequence of visual tokens to represent scene text images we prove that just one token is enough to charac…

2024

Self-Supervised Pre-training with Symmetric Superimposition Modeling for Scene Text Recognition

IJCAI 2024poster

In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or sequence contrastive learning. However, they omit modeling the ling…

2024

The Open-World Lottery Ticket Hypothesis for OOD Intent Classification

COLING 2024main

Most existing methods of Out-of-Domain (OOD) intent classification rely on extensive auxiliary OOD corpora or specific training paradigms. However, they are underdeveloped in the underlying principle that the models should have differentiated confidence in In- and Out-of-domain intent. In this work,…

2023

Exploring Stroke-Level Modifications for Scene Text Editing

AAAI 2023technical

Scene text editing (STE) aims to replace text with the desired one while preserving background and styles of the original text. However, due to the complicated background textures and various text styles, existing methods fall short in generating clear and legible edited text images. In this study,…

2023

From Hypergraph Energy Functions to Hypergraph Neural Networks

ICML 2023poster

Hypergraphs are a powerful abstraction for representing higher-order interactions between entities of interest. To exploit these relationships in making downstream predictions, a variety of hypergraph neural network architectures have recently been proposed, in large part building upon precursors fr…

2023

GTR: A Grafting-Then-Reassembling Framework for Dynamic Scene Graph Generation

IJCAI 2023poster

Dynamic scene graph generation aims to identify visual relationships (subject-predicate-object) in frames based on spatio-temporal contextual information in the video. Previous work implicitly models the spatio-temporal interaction simultaneously, which leads to entanglement of spatio-temporal conte…

Cited by 2SourcePDFScholar
2023

Lifelong Embedding Learning and Transfer for Growing Knowledge Graphs

AAAI 2023technical

Existing knowledge graph (KG) embedding models have primarily focused on static KGs. However, real-world KGs do not remain static, but rather evolve and grow in tandem with the development of KG applications. Consequently, new facts and previously unseen entities and relations continually emerge, ne…

2023

Linguistic More: Taking a Further Step toward Efficient and Accurate Scene Text Recognition

IJCAI 2023poster

Vision model have gained increasing attention due to their simplicity and efficiency in Scene Text Recognition (STR) task. However, due to lacking the perception of linguistic knowledge and information, recent vision models suffer from two problems: (1) the pure vision-based query results in attenti…

2023

NAS-LID: Efficient Neural Architecture Search with Local Intrinsic Dimension

AAAI 2023technical

One-shot neural architecture search (NAS) substantially improves the search efficiency by training one supernet to estimate the performance of every possible child architecture (i.e., subnet). However, the inconsistency of characteristics among subnets incurs serious interference in the optimization…

2023

OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation

CVPR 2023poster

Recent advances in modeling 3D objects mostly rely on synthetic datasets due to the lack of large-scale real-scanned 3D databases. To facilitate the development of 3D perception, reconstruction, and generation in the real world, we propose OmniObject3D, a large vocabulary 3D object dataset with mass…

Cited by 214SourcePDFScholar
2023

RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars

NeurIPS 2023poster

Synthesizing high-fidelity head avatars is a central problem for computer vision and graphics. While head avatar synthesis algorithms have advanced rapidly, the best ones still face great obstacles in real-world scenarios. One of the vital causes is the inadequate datasets -- 1) current public data…

2022

A Trainable Bounded Denoiser Using Double Tight Frame Network for Snapshot Compressive Imaging

ICASSP 2022accepted

Recently, the PnP-GAP algorithm has achieved remarkable reconstruction quality for snapshot compressive imaging (SCI), and its convergence has been proven based on the condition of diminishing noise levels and the assumption of bounded denoisers. However, most of deep denoisers are difficult to be p…

Cited by 0SourceScholar
2022

CPRAL: Collaborative Panoptic-Regional Active Learning for Semantic Segmentation

AAAI 2022technical

Acquiring the most representative examples via active learning (AL) can benefit many data-dependent computer vision tasks by minimizing efforts of image-level or pixel-wise annotations. In this paper, we propose a novel Collaborative Panoptic-Regional Active Learning framework (CPRAL) to address the…

Cited by 18SourcePDFScholar
2022

Detecting Tampered Scene Text in the Wild

ECCV 2022poster

"Text manipulation technologies cause serious worries in recent years, however, corresponding tampering detection methods have not been well explored. In this paper, we introduce a new task, named Tampered Scene Text Detection (TSTD), to localize text instances and recognize the texture authenticity…

2022

What Dense Graph Do You Need for Self-Attention?

ICML 2022spotlight

Transformers have made progress in miscellaneous tasks, but suffer from quadratic computational and memory complexities. Recent works propose sparse transformers with attention on sparse graphs to reduce complexity and remain strong performance. While effective, the crucial parts of how dense a grap…

2021

A Vision-based Irregular Obstacle Avoidance Framework via Deep Reinforcement Learning

IROS 2021poster

Deep reinforcement learning has achieved great success in laser-based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when it is migrated from the simulation environment to the real wo…

Cited by 20SourceScholar
2021

Dynamic Inconsistency-aware DeepFake Video Detection

IJCAI 2021poster

The spread of DeepFake videos causes a serious threat to information security, calling for effective detection methods to distinguish them. However, the performance of recent frame-based detection methods become limited due to their ignorance of the inter-frame inconsistency of fake videos. In this…

Cited by 0SourcePDFScholar
2021

From Two to One: A New Scene Text Recognizer With Visual Language Modeling Network

ICCV 2021poster

In this paper, we abandon the dominant complex language model and rethink the linguistic learning process in the scene text recognition. Different from previous methods considering the visual and linguistic information in two separate structures, we propose a Visual Language Modeling Network (Vision…

Cited by 184PDFcodeScholar
2021

Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition

CVPR 2021poster

Linguistic knowledge is of great benefit to scene text recognition. However, how to effectively model linguistic rules in end-to-end deep networks remains a research challenge. In this paper, we argue that the limited capacity of language models comes from: 1) implicitly language modeling; 2) unidir…

Cited by 461PDFcodeScholar
2021

Towards Collision Detection, Localization and Force Estimation for a Soft Cable-driven Robot Manipulator

ICRA 2021poster

Soft robots have been applied widely to various constrained scenarios due to the advantages over traditional rigid manipulators such as softness, deformability and adaptability to constrained surroundings. To make full use of this merit, this paper proposes a method that integrates collision detecti…

Cited by 1SourceScholar
2020

ContourNet: Taking a Further Step Toward Accurate Arbitrary-Shaped Scene Text Detection

CVPR 2020poster

Scene text detection has witnessed rapid development in recent years. However, there still exists two main challenges: 1) many methods suffer from false positives in their text representations; 2) the large scale variance of scene texts makes it hard for network to learn samples. In this paper, we p…

Cited by 273PDFcodeScholar