← Search

Xinyu Wang

81 accepted papers

2026

A Type of Actuator with Large Deformation and Load Capacity: Design and Modeling

ICRA 2026poster

Flexible actuators have garnered extensive attention due to their flexibility and versatility. However, they still exhibit significant limitations in load capacity and structural stiffness. We have developed a multifunctional rigid-flexible coupled actuator with large deformation and high load capac…

Cited by 0Scholar
2026

AgentFold: Long-Horizon Web Agents with Proactive Context Folding

ICLR 2026poster

LLM-based web agents show immense promise for information seeking, yet their effectiveness on long-horizon tasks is hindered by a fundamental trade-off in context management. Prevailing ReAct-based agents suffer from context saturation as they accumulate noisy, raw histories, while methods that fixe…

Cited by 0SourceScholar
2026

Beyond Hard Writes and Rigid Preservation: Soft Recursive Least-Squares for Lifelong LLM Editing

IJCAI 2026

Model editing updates a pre-trained LLM with new facts or rules without retraining while preserving unrelated behavior. In real deployment, edits arrive as long streams, creating a plasticity–stability dilemma: repeated locate-then-edit “hard writes” can accumulate interference over time, while rigi

Cited by 0Scholar
2026

CLAM-Bench: Benchmarking LLM Agents for Library-Scale Cross-Architecture Migration

ICML 2026poster

Cross-architecture migration of high-performance libraries dictates ecosystem readiness on emerging hardware. The challenge is twofold: disentangling library-scale dependencies and performance-critical kernels with ISA-specific SIMD intrinsics, often trading migration speed for peak performance. Whi…

Cited by 0SourceScholar
2026

Demystifying Deep Search: A Holistic Evaluation with Hint-free Multi-Hop Questions and Factorised Metrics

ICLR 2026poster

RAG (Retrieval-Augmented Generation) systems and web agents are increasingly evaluated on multi-hop deep search tasks, yet current practice suffers from two major limitations. First, most benchmarks leak the reasoning path in the question text, allowing models to follow surface cues rather than disc…

Cited by 0SourcecodeScholar
2026

EasyCreator: Empowering 4D Creation through Video Inpainting

ICLR 2026poster

We introduce EasyCreator, a novel 4D video creation framework capable of both generating and editing 4D content from a single monocular video input. By leveraging a powerful video inpainting foundation model as a generative prior, we reformulate 4D video creation as a video inpainting task, enabling…

Cited by 0SourceScholar
2026

Expanding the Capability Frontier of LLM Agents with ZPD-Guided Data Synthesis

ICLR 2026poster

Unlocking advanced reasoning in large language model agents is hindered by a scarcity of training data situated at the very frontier of their capabilities. We address this with a novel data synthesis approach inspired by the educational theory of the Zone of Proximal Development (ZPD), which concept…

Cited by 0SourceScholar
2026

Forecast Then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers

AAAI 2026technical

Diffusion Transformers (DiTs) have demonstrated exceptional performance in high-fidelity image and video generation. To reduce their substantial computational costs, feature caching techniques have been proposed to accelerate inference by reusing hidden representations from previous timesteps. Howev

Cited by 0SourcePDFScholar
2026

From Sequential to Recursive: Enhancing Decision-Focused Learning with Bidirectional Feedback

AAAI 2026technical

Decision-focused learning (DFL) has emerged as a powerful end-to-end alternative to conventional predict-then-optimize (PTO) pipelines by directly optimizing predictive models through downstream decision losses. Existing DFL frameworks are limited by their strictly sequential structure, referred to

Cited by 0SourcePDFScholar
2026

Group Editing: Edit Multiple Images in One Go

CVPR 2026

In this paper, we tackle the problem of performing consistent and unified modifications across a set of related images. This task is particularly challenging because these images may vary significantly in pose, viewpoint, and spatial layout. Achieving coherent edits requires establishing reliable co

Cited by 0SourcecodeScholar
2026

HiCache: A Plug-in Scaled-Hermite Upgrade for Taylor-Style Cache-then-Forecast Diffusion Acceleration

ICLR 2026poster

Diffusion models have achieved remarkable success in content generation but suffer from prohibitive computational costs due to iterative sampling. While recent feature caching methods tend to accelerate inference through temporal extrapolation, these methods still suffer from severe quality loss due…

Cited by 0SourcecodeScholar
2026

InteractComp: Evaluating Search Agents With Ambiguous Queries

ICML 2026poster

Language agents have demonstrated remarkable potential in web search and information retrieval. However, these search agents assume user queries are complete and unambiguous, an assumption that diverges from reality where users begin with incomplete queries requiring clarification through interactio…

Cited by 0SourceScholar
2026

LESA: Learnable Stage-Aware Predictors for Diffusion Model Acceleration

CVPR 2026

Diffusion models have achieved remarkable success in image and video generation tasks. However, the high computational demands of Diffusion Transformers (DiTs) pose a significant challenge to their practical deployment. While feature caching is a promising acceleration strategy, existing methods bas

Cited by 0SourceScholar
2026

Repurposing Synthetic Data for Fine-grained Search Agent Supervision

ICLR 2026poster

LLM-based search agents are increasingly trained on entity-centric synthetic data to solve complex, knowledge-intensive tasks. However, prevailing training methods like Group Relative Policy Optimization (GRPO) discard this rich entity information, relying instead on sparse, outcome-based rewards. T…

Cited by 0SourceScholar
2026

Scaling Agents via Continual Pre-training

ICLR 2026poster

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models consistently underperform in agentic tasks, particularly in open-sourc…

Cited by 0SourcecodeScholar
2026

Ultrasound-CLIP: Semantic-Aware Contrastive Pre-training for Ultrasound Image-Text Understanding

CVPR 2026

Ultrasound imaging is widely used in clinical diagnostics due to its real-time capability and radiation-free nature. However, existing vision-language pre-training models, such as CLIP, are primarily designed for other modalities, and are difficult to directly apply to ultrasound data, which exhibit

Cited by 0SourcecodeScholar
2026

WebSailor-V2: Bridging the Chasm to Proprietary Agents via Synthetic Data and Scalable Reinforcement Learning

ICLR 2026poster

To significantly advance the capabilities of open-source web agents, we present WebSailor-V2, a complete post-training pipeline encompassing data construction, Supervised Fine-Tuning (SFT), and Reinforcement Learning (RL). Our methodology features two key innovations: (1) On the data front, we devel…

Cited by 0SourceScholar
2026

WebShaper: Agentically Data Synthesizing via Information-Seeking Formalization

ICLR 2026poster

The advent of Large Language Model (LLM)-powered agents has revolutionized artificial intelligence by enabling solutions to complex, open-ended tasks through web-based information-seeking (IS) capabilities. The scarcity of high-quality training data has limited the development of IS agents. Existin…

Cited by 0SourcecodeScholar
2026

WebWatcher: Breaking New Frontiers of Vision-Language Deep Research Agent

ICLR 2026poster

Web agents such as deep research have demonstrated superhuman cognitive abilities, capable of solving highly challenging information-seeking problems. However, most research remains largely text-centric, overlooking visual information in the real world. This makes multimodal deep research highly cha…

Cited by 0SourceScholar
2025

A Novel Local Search Algorithm for the Vertex Bisection Minimization Problem

IJCAI 2025

The vertex bisection minimization problem (VBMP) is a fundamental graph partitioning problem with numerous real-world applications. In this study, we propose a (k, l, S)-cluster guided local search algorithm to address this challenge. First, we propose a novel (k,l,S)-cluster enumeration procedure,

2025

Benchmarking Multimodal Retrieval Augmented Generation with Dynamic VQA Dataset and Self-adaptive Planning Agent

ICLR 2025poster

Multimodal Retrieval Augmented Generation (mRAG) plays an important role in mitigating the “hallucination” issue inherent in multimodal large language models (MLLMs). Although promising, existing heuristic mRAGs typically predefined fixed retrieval processes, which causes two issues: (1) Non-adaptiv…

2025

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving

NeurIPS 2025poster

When serving a single base LLM with several different LoRA adapters simultaneously, the adapters cannot simply be merged with the base model’s weights as the adapter swapping would create overhead and requests using different adapters could not be batched. Rather, the LoRA computations have to be se…

Cited by 0SourceScholar
2025

Boosting Data Utilization for Multilingual Dense Retrieval

EMNLP 2025

Multilingual dense retrieval aims to retrieve relevant documents across different languages based on a unified retriever model. The challenge lies in aligning representations of different languages in a shared vector space. The common practice is to fine-tune the dense retriever via contrastive lear

2025

Cross-View Isolated Sign Language Recognition via View Synthesis and Feature Disentanglement

ICCV 2025poster

Cross-view isolated sign language recognition (CV-ISLR) addresses the challenge of identifying isolated signs from viewpoints unseen during training, a problem aggravated by the scarcity of multi-view data in existing benchmarks. To bridge this gap, we introduce a novel two-stage framework comprisin…

Cited by 0SourcePDFScholar
2025

CymbaDiff: Structured Spatial Diffusion for Sketch-based 3D Semantic Urban Scene Generation

NeurIPS 2025poster

Outdoor 3D semantic scene generation produces realistic and semantically rich environments for applications such as urban simulation and autonomous driving. However, advances in this direction are constrained by the absence of publicly available, well-annotated datasets. We introduce SketchSem3D, th…

Cited by 0SourceScholar
2025

DCIM-AVSR: Efficient Audio-Visual Speech Recognition via Dual Conformer Interaction Module

ICASSP 2025accepted

Speech recognition is the technology that enables machines to interpret and process human speech, converting spoken language into text or commands. This technology is essential for applications such as virtual assistants, transcription services, and communication tools. The Audio-Visual Speech Recog…

Cited by 0SourceScholar
2025

DGVO: A Dynamically Constrained Gradient Velocity Obstacle Approach for Mobile Robots in Dynamic Environments

IROS 2025

In this paper, we propose a framework based on velocity obstacles to address dynamic obstacle avoidance problem for constrained mobile robots. The framework establishes a nonlinear mapping from the control domain to the velocity space based on the robot’s kinematic model and input constraints. This

Cited by 0SourceScholar
2025

Detecting Knowledge Boundary of Vision Large Language Models by Sampling-Based Inference

EMNLP 2025

Despite the advancements made in Vision Large Language Models (VLLMs), like text Large Language Models (LLMs), they have limitations in addressing questions that require real-time information or are knowledge-intensive. Indiscriminately adopting Retrieval Augmented Generation (RAG) techniques is an

2025

Evaluating and Mitigating Linguistic Discrimination in Large Language Models: Perspectives on Safety Equity and Knowledge Equity

IJCAI 2025

Large language models (LLMs) typically provide multilingual support and demonstrate remarkable capabilities in solving tasks described in different languages. However, LLMs can exhibit linguistic discrimination due to the uneven distribution of training data across languages. That is, LLMs struggle

2025

Global Attribute-Association Pattern Aggregation for Graph Fraud Detection

AAAI 2025technical

Fraud is increasingly prevalent, and its patterns are frequently changing, posing challenges for fraud detection methods such as random forests and Graph Neural Networks (GNNs), which rely on bin-based and mixture features separately. The former may lose crucial graph-associated features, while the…

2025

Global Tropical Cyclone Intensity Forecasting with Multi-modal Multi-scale Causal Autoregressive Model

ICASSP 2025accepted

Accurate forecasting of tropical cyclone (TC) intensity is crucial for formulating disaster risk reduction strategies. Current methods predominantly rely on limited spatiotemporal information from ERA5 data and neglect the causal relationships between these physical variables, failing to fully captu…

Cited by 0SourceScholar
2025

Have LLMs Reopened the Pandora’s Box of AI-Generated Fake News?

NAACL 2025long

With the rise of AI-generated content spewed at scale from large language models (LLMs), genuine concerns about the spread of fake news have intensified. The perceived ability of LLMs to produce convincing fake news at scale poses new challenges for both human and automated fake news detection syste…

2025

HyperFree: A Channel-adaptive and Tuning-free Foundation Model for Hyperspectral Remote Sensing Imagery

CVPR 2025poster

Advanced interpretation of hyperspectral remote sensing images benefits many precise Earth observation tasks. Recently, visual foundation models have promoted the remote sensing interpretation but concentrating on RGB and multispectral images. Due to the varied hyperspectral channels, existing found…

Cited by 0SourcePDFScholar
2025

Improving Context Fidelity via Native Retrieval-Augmented Reasoning

EMNLP 2025

Large language models (LLMs) often struggle with context fidelity, producing inconsistent answers when responding to questions based on provided information. Existing approaches either rely on expensive supervised fine-tuning to generate evidence post-answer or train models to perform web searches w

2025

In2NeCT: Inter-class and Intra-class Neural Collapse Tuning for Semantic Segmentation of Imbalanced Remote Sensing Images

AAAI 2025technical

Remote sensing images (RSIs) are frequently characterized by multi-scale inter-class objects and inconsistently distributed objects due to scene limitations, which would cause a significant data imbalance challenging the corresponding semantic segmentation. Recent methods have leveraged various deep…

Cited by 0SourcePDFScholar
2025

KBM: Delineating Knowledge Boundary for Adaptive Retrieval in Large Language Models

EMNLP 2025

Large Language Models (LLMs) often struggle with dynamically changing knowledge and handling unknown static information. Retrieval-Augmented Generation (RAG) is employed to tackle these challenges and has a significant impact on improving LLM performance. In fact, we find that not all questions need

2025

Let LLMs Take on the Latest Challenges! A Chinese Dynamic Question Answering Benchmark

COLING 2025main

How to better evaluate the capabilities of Large Language Models (LLMs) is the focal point and hot topic in current LLMs research. Previous work has noted that due to the extremely high cost of iterative updates of LLMs, they are often unable to answer the latest dynamic questions well. To promote t…

2025

Logic-Regularized Verifier Elicits Reasoning from LLMs

ACL 2025long

Verifiers are crucial components for enhancing modern LLMs’ reasoning capability. Typical verifiers require resource-intensive supervised dataset construction, which is costly and faces limitations in data diversity. In this paper, we propose LOVER, an unsupervised verifier regularized by logical ru…

2025

MITracker: Multi-View Integration for Visual Object Tracking

CVPR 2025highlight

Multi-view object tracking (MVOT) offers promising solutions to challenges such as occlusion and target loss, which are common in traditional single-view tracking. However, progress has been limited by the lack of comprehensive multi-view datasets and effective cross-view integration methods. To ove…

Cited by 0SourcePDFScholar
2025

Mamba Modulation: On the Length Generalization of Mamba Models

NeurIPS 2025poster

The quadratic complexity of the attention mechanism in Transformer models has motivated the development of alternative architectures with sub-quadratic scaling, such as state-space models. Among these, Mamba has emerged as a leading architecture, achieving state-of-the-art results across a range of…

Cited by 0SourceScholar
2025

NOVER: Incentive Training for Language Models via Verifier-Free Reinforcement Learning

EMNLP 2025

Recent advances, such as DeepSeek R1-Zero, highlight the effectiveness of incentive training, a reinforcement learning paradigm that computes rewards solely based on the final answer part of a language model’s output, thereby encouraging the generation of intermediate reasoning steps. However, these

2025

NavBench: Probing Multimodal Large Language Models for Embodied Navigation

NeurIPS 2025poster

Multimodal Large Language Models (MLLMs) have demonstrated strong generalization in vision-language tasks, yet their ability to understand and act within embodied environments remains underexplored. We present NavBench, a benchmark to evaluate the embodied navigation capabilities of MLLMs under zero…

Cited by 0SourceScholar
2025

OCRBench v2: An Improved Benchmark for Evaluating Large Multimodal Models on Visual Text Localization and Reasoning

NeurIPS 2025poster

Scoring the Optical Character Recognition (OCR) capabilities of Large Multimodal Models (LMMs) has witnessed growing interest. Existing benchmarks have highlighted the impressive performance of LMMs in text recognition; however, their abilities in certain challenging tasks, such as text localization…

Cited by 0SourcecodeScholar
2025

PECAN: LLM-Guided Dynamic Progress Control with Attention-Guided Hierarchical Weighted Graph for Long-Document QA

ACL 2025finding

Long-document QA presents challenges with large-scale text and long-distance dependencies. Recent advances in Large Language Models (LLMs) enable entire documents to be processed in a single pass. However, their computational cost is significantly high. Retrieval-Augmented Generation (RAG) methods s…

2025

Q-Learning-based Optimal Force-Tracking Control of Grinding Robots in Uncertain Environments

IROS 2025

This paper proposes a novel Q-learning-based dual-loop force tracking control framework for robot grinding tasks in uncertain environments. A complete system state-space model is established, incorporating interaction dynamics and the desired force. By augmenting the system state, a discount cost fu

Cited by 0SourceScholar
2025

STRICT: Stress-Test of Rendering Image Containing Text

EMNLP 2025

While diffusion models have revolutionized text-to-image generation with their ability to synthesize realistic and diverse scenes, they continue to struggle with generating consistent and legible text within images. This shortcoming is commonly attributed to the locality bias inherent in diffusion-b

2025

VQLTI: Long-Term Tropical Cyclone Intensity Forecasting with Physical Constraints

AAAI 2025technical

Tropical cyclone (TC) intensity forecasting is crucial for early disaster warning and emergency decision-making. Numerous researchers have explored deep-learning methods to address computational and post-processing issues in operational forecasting. Regrettably, they exhibit subpar long-term forecas…

2024

CGMGM: A Cross-Gaussian Mixture Generative Model for Few-Shot Semantic Segmentation

AAAI 2024technical

Few-shot semantic segmentation (FSS) aims to segment unseen objects in a query image using a few pixel-wise annotated support images, thus expanding the capabilities of semantic segmentation. The main challenge lies in extracting sufficient information from the limited support images to guide the se…

Cited by 2SourcePDFScholar
2024

DGA-GNN: Dynamic Grouping Aggregation GNN for Fraud Detection

AAAI 2024technical

Fraud detection has increasingly become a prominent research field due to the dramatically increased incidents of fraud. The complex connections involving thousands, or even millions of nodes, present challenges for fraud detection tasks. Many researchers have developed various graph-based methods t…

2024

Deciphering Oracle Bone Language with Diffusion Models

ACL 2024long

Originating from China’s Shang Dynasty approximately 3,000 years ago, the Oracle Bone Script (OBS) is a cornerstone in the annals of linguistic history, predating many established writing systems. Despite the discovery of thousands of inscriptions, a vast expanse of OBS remains undeciphered, casting…

2024

E3V-K5: An Authentic Benchmark for Redefining Video-Based Energy Expenditure Estimation

ECCV 2024poster

"Accurately estimating energy expenditure (EE) is crucial for optimizing athletic training, monitoring daily activity levels, and preventing sports-related injuries. Estimating energy expenditure based on video (E3 V) is an appealing research direction. This paper introduces E3V-K5, an authentic dat…

2024

IaC-Eval: A Code Generation Benchmark for Cloud Infrastructure-as-Code Programs

NeurIPS 2024poster

Infrastructure-as-Code (IaC), an important component of cloud computing, allows the definition of cloud infrastructure in high-level programs. However, developing IaC programs is challenging, complicated by factors that include the burgeoning complexity of the cloud ecosystem (e.g., diversity of clo…

2024

Improving Retrieval Augmented Open-Domain Question-Answering with Vectorized Contexts

ACL 2024findings

In the era of large language models, applying techniques such as Retrieval Augmented Generation can better address Open-Domain Question-Answering problems. Due to constraints including model sizes and computing resources, the length of context is often limited, and it becomes challenging to empower…

2024

LION: Linear Group RNN for 3D Object Detection in Point Clouds

NeurIPS 2024poster

The benefit of transformers in large-scale 3D point cloud perception tasks, such as 3D object detection, is limited by their quadratic computation cost when modeling long-range relationships. In contrast, linear RNNs have low computational complexity and are suitable for long-range modeling. Toward…

2024

Mirror: Multiple-perspective Self-Reflection Method for Knowledge-rich Reasoning

ACL 2024long

While Large language models (LLMs) have the capability to iteratively reflect on their own outputs, recent studies have observed their struggles with knowledge-rich problems without access to external resources. In addition to the inefficiency of LLMs in self-assessment, we also observe that LLMs st…

2024

RaFe: Ranking Feedback Improves Query Rewriting for RAG

EMNLP 2024finding

As Large Language Models (LLMs) and Retrieval Augmentation Generation (RAG) techniques have evolved, query rewriting has been widely incorporated into the RAG system for downstream tasks like open-domain QA to enhance document retrieval by reformulating queries. Many works have attempted to improve…

2024

Rating-Augmented No-Reference Point Cloud Quality Assessment Using Multi-Task Learning

ICASSP 2024accepted

The diversity and multi-dimensionality of point cloud make the no-reference point cloud quality assessment challenging. However, existing learning-based methods pay little attention on the distribution inconsistency of quality scores among different datasets, which would induce training bias during…

Cited by 0SourceScholar
2024

Towards Unified Task Embeddings Across Multiple Models: Bridging the Gap for Prompt-Based Large Language Models and Beyond

ACL 2024findings

Task embedding, a meta-learning technique that captures task-specific information, has gained popularity, especially in areas such as multi-task learning, model editing, and interpretability. However, it faces challenges with the emergence of prompt-guided Large Language Models (LLMs) operating in a…

2024

Unsupervised Object Interaction Learning with Counterfactual Dynamics Models

AAAI 2024technical

We present COIL (Counterfactual Object Interaction Learning), a novel way of learning skills of object interactions on entity-centric environments. The goal is to learn primitive behaviors that can induce interactions without external reward or any supervision. Existing skill discovery methods are l…

Cited by 6SourcePDFScholar
2023

Anomaly Segmentation for High-Resolution Remote Sensing Images Based on Pixel Descriptors

AAAI 2023technical

Anomaly segmentation in high spatial resolution (HSR) remote sensing imagery is aimed at segmenting anomaly patterns of the earth deviating from normal patterns, which plays an important role in various Earth vision applications. However, it is a challenging task due to the complex distribution and…

2023

Class Prior-Free Positive-Unlabeled Learning with Taylor Variational Loss for Hyperspectral Remote Sensing Imagery

ICCV 2023poster

Positive-unlabeled learning (PU learning) in hyperspectral remote sensing imagery (HSI) is aimed at learning a binary classifier from positive and unlabeled data, which has broad prospects in various earth vision applications. However, when PU learning meets limited labeled HSI, the unlabeled data m…

Cited by 15PDFcodeScholar
2023

Document-Level Multi-Event Extraction with Event Proxy Nodes and Hausdorff Distance Minimization

ACL 2023long

Document-level multi-event extraction aims to extract the structural information from a given document automatically. Most recent approaches usually involve two steps: (1) modeling entity interactions; (2) decoding entity interactions into events. However, such approaches ignore a global view of int…

2023

Polyhedron Attention Module: Learning Adaptive-order Interactions

NeurIPS 2023poster

Learning feature interactions can be the key for multivariate predictive modeling. ReLU-activated neural networks create piecewise linear prediction models, and other nonlinear activation functions lead to models with only high-order feature interactions. Recent methods incorporate candidate polynom…

Cited by 0SourcePDFScholar
2022

A-PixelHop: A Green, Robust and Explainable Fake-Image Detector

ICASSP 2022accepted

A novel method for detecting CNN-generated images, called Attentive PixelHop (or A-PixelHop), is proposed in this work. It has three advantages: 1) low computational complexity and a small model size, 2) high detection performance against a wide range of generative models, and 3) mathematical transp…

Cited by 0SourceScholar
2022

Design of a Biomimetic Tactile Sensor for Material Classification

ICRA 2022poster

Tactile sensing typically involves active exploration of unknown surfaces and objects, making it especially effective at processing the characteristics of materials and textures. A key property extracted by human tactile perception in material classification is surface roughness, which relies on mea…

Cited by 26SourceScholar
2022

Design, Fabrication, and Characterization of a Hybrid Bionic Spherical Robotics With Multilegged Feedback Mechanism

RA-L 2022

Spherical robots have many desirable traits when designing mass efficient systems interacted with unstructured terrain. In this letter, we propose a hybrid bionic spherical robot based on the morphological properties of sea urchins and the movement characteristics of tumbleweeds. This robot enables

Cited by 5SourceScholar
2022

ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition

NAACL 2022long

Recently, Multi-modal Named Entity Recognition (MNER) has attracted a lot of attention. Most of the work utilizes image information through region-level visual representations obtained from a pretrained object detector and relies on an attention mechanism to model the interactions between image and…

2022

Named Entity and Relation Extraction with Multi-Modal Retrieval

EMNLP 2022finding

Multi-modal named entity recognition (NER) and relation extraction (RE) aim to leverage relevant image information to improve the performance of NER and RE. Most existing efforts largely focused on directly extracting potentially useful information from images (such as pixel-level features, identifi…

2021

Automated Concatenation of Embeddings for Structured Prediction

ACL 2021long

Pretrained contextualized embeddings are powerful word representations for structured prediction tasks. Recent work found that better word representations can be obtained by concatenating different types of embeddings. However, the selection of embeddings to form the best concatenated representation…

2021

Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

ACL 2021long

Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we propose to find external contexts of a sentence by retrieving and selecting a se…

2021

Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor

ACL 2021long

Knowledge distillation is a critical technique to transfer knowledge between models, typically from a large model (the teacher) to a more fine-grained one (the student). The objective function of knowledge distillation is typically the cross-entropy between the teacher and the student’s output distr…

2020

On the General Value of Evidence, and Bilingual Scene-Text Visual Question Answering

CVPR 2020poster

Visual Question Answering (VQA) methods have made incredible progress, but suffer from a failure to generalize. This is visible in the fact that they are vulnerable to learning coincidental correlations in the data rather than deeper relations between image content and ideas expressed in language. W…

Cited by 126PDFScholar
2015

Shared control for teleoperation enhanced by autonomous obstacle avoidance of robot manipulator

IROS 2015poster

In this paper, a human robot shared control strategy is developed and tested on a Baxter robot. Using the proposed method, the human operator only needs to consider the motion of the end-effector of the manipulator, while the manipulator will avoid obstacle by itself without sacrificing the end effe…

Cited by 31SourceScholar