← Search

Zhao Jin

21 accepted papers

2026

AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimization

AAAI 2026technical

While Multimodal Large Language Models (MLLMs) demonstrate remarkable capabilities across diverse domains, their application to specialized anomaly detection (AD) remains constrained by domain adaptation challenges. Existing Group Relative Policy Optimization (GRPO) based approaches suffer from two

Cited by 0SourcePDFScholar
2026

ArtVIP: Articulated Digital Assets of Visual Realism, Modular Interaction, and Physical Fidelity for Robot Learning

ICLR 2026poster

Robot learning increasingly relies on simulation to advance complex ability such as dexterous manipulations and precise interactions, necessitating high-quality digital assets to bridge the sim-to-real gap. However, existing open-source articulated object datasets for simulation are limited by insuf…

Cited by 0SourceScholar
2026

MCTS-SQL: Light-Weight LLMs Can Master the Text-to-SQL Through Monte Carlo Tree Search

AAAI 2026technical

Text-to-SQL is a fundamental yet challenging task in the NLP area, aiming at translating natural language questions into SQL queries. While recent advances in large language models have greatly improved performance, most existing approaches depend on models with tens of billions of parameters or cos

Cited by 0SourcePDFScholar
2026

Multi-Dimensional Perturbation Strategies for Adversarial Attacks in Multi-Agent Deep Reinforcement Learning

ICRA 2026poster

Research indicates that single-agent reinforcement learning is vulnerable to adversarial attacks, which can lead to decision-making errors. Similarly, multi-agent deep reinforcement learning (MADRL) systems face analogous adversarial threats. However, existing attack methods require substantial inve…

Cited by 0Scholar
2026

Multi-Priority Reactive Motion Control for Safe and Coordinated Dual-Arm Manipulation in Dynamic Environments

RA-L 2026

Reactive motion generation for dual-arm robotic systems is challenging due to their high degrees of freedom, nonlinear characteristics as well as the presence of multiple constraints, including kinematic limits, collision avoidance, dual-arm coordination, and other task-specific requirements. These

Cited by 0SourceScholar
2026

PD$^{2}$GS: Part-Level Decoupling and Continuous Deformation of Articulated Objects via Gaussian Splatting

ICLR 2026poster

Articulated objects are ubiquitous and important in robotics, AR/VR, and digital twins. Most self-supervised methods for articulated object modeling reconstruct discrete interaction states and relate them via cross-state geometric consistency, yielding representational fragmentation and drift that h…

Cited by 0SourceScholar
2026

S$^2$-MLLM: Boosting Spatial Reasoning Capability of MLLMs for 3D Visual Grounding with Structural Guidance

CVPR 2026

3D Visual Grounding (3DVG) focuses on locating objects in 3D scenes based on natural language descriptions, serving as a fundamental task for embodied AI and robotics. Recent advances in Multi-modal Large Language Models (MLLMs) have motivated research into extending them to 3DVG. However, MLLMs pri

Cited by 0SourcecodeScholar
2026

Singular Proxies for Adaptive Caching in Diffusion Language Models

ICML 2026poster

While Diffusion Language Models (DLMs) offer a flexible, arbitrary-order alternative to the autoregressive paradigm, their non-causal nature precludes standard KV caching, forcing costly hidden state recomputation at every decoding step. Existing caching approaches reduce this cost by selective hidd…

Cited by 0SourceScholar
2025

AsymRnR: Video Diffusion Transformers Acceleration with Asymmetric Reduction and Restoration

ICML 2025poster

Diffusion Transformers (DiTs) have proven effective in generating high-quality videos but are hindered by high computational costs. Existing video diffusion sampling acceleration methods often rely on costly fine-tuning or exhibit limited generalization capabilities. We propose Asymmetric Reduction…

Cited by 1SourcePDFScholar
2025

RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulation

RSS 2025poster

Developing robust and general-purpose manipulation policies is a key goal in robotics. To achieve effective generalization, it is essential to construct comprehensive datasets that encompass a large number of demonstration trajectories and diverse tasks. Unlike vision or language data, which can be…

Cited by 20PDFScholar
2025

SPAZER: Spatial-Semantic Progressive Reasoning Agent for Zero-shot 3D Visual Grounding

NeurIPS 2025poster

3D Visual Grounding (3DVG) aims to localize target objects within a 3D scene based on natural language queries. To alleviate the reliance on costly 3D training data, recent studies have explored zero-shot 3DVG by leveraging the extensive knowledge and powerful reasoning capabilities of pre-trained L…

Cited by 0SourceScholar
2025

VORTA: Efficient Video Diffusion via Routing Sparse Attention

NeurIPS 2025poster

Video diffusion transformers have achieved remarkable progress in high-quality video generation, but remain computationally expensive due to the quadratic complexity of attention over high-dimensional video sequences. Recent acceleration methods enhance the efficiency by exploiting the local sparsit…

Cited by 0SourcecodeScholar
2025

Where is this coming from? Making groundedness count in the evaluation of Document VQA models

NAACL 2025findings

Document Visual Question Answering (VQA) models have evolved at an impressive rate over the past few years, coming close to or matching human performance on some benchmarks. We argue that common evaluation metrics used by popular benchmarks do not account for the semantic and multimodal groundedness…

Cited by 0SourcePDFScholar
2024

AliGATr: Graph-based layout generation for form understanding

EMNLP 2024finding

Forms constitute a large portion of layout-rich documents that convey information through key-value pairs. Form understanding involves two main tasks, namely, the identification of keys and values (a.k.a Key Information Extraction or KIE) and the association of keys to corresponding values (a.k.a. R…

Cited by 1SourcePDFScholar
2024

SM3: Self-supervised Multi-task Modeling with Multi-view 2D Images for Articulated Objects

ICRA 2024poster

Reconstructing real-world objects and estimating their movable joint structures are pivotal technologies within the field of robotics. Previous research has predominantly focused on supervised approaches, relying on annotated datasets to model articulated objects within limited categories. However,…

Cited by 1SourceScholar
2023

Context-Aware Alignment and Mutual Masking for 3D-Language Pre-Training

CVPR 2023highlight

3D visual language reasoning plays an important role in effective human-computer interaction. The current approaches for 3D visual reasoning are task-specific, and lack pre-training methods to learn generic representations that can transfer across various tasks. Despite the encouraging progress in v…

2023

Geometry and Uncertainty-Aware 3D Point Cloud Class-Incremental Semantic Segmentation

CVPR 2023poster

Despite the significant recent progress made on 3D point cloud semantic segmentation, the current methods require training data for all classes at once, and are not suitable for real-life scenarios where new categories are being continuously discovered. Substantial memory storage and expensive re-tr…

2023

Zero-Shot Point Cloud Segmentation by Semantic-Visual Aware Synthesis

ICCV 2023poster

This paper proposes a feature synthesis approach for zero-shot semantic segmentation of 3D point clouds, enabling generalization to previously unseen categories. Given only the class-level semantic information for unseen objects, we strive to enhance the correspondence, alignment and consistency bet…

Cited by 9PDFcodeScholar
2022

Deformation and Correspondence Aware Unsupervised Synthetic-to-Real Scene Flow Estimation for Point Clouds

CVPR 2022poster

Point cloud scene flow estimation is of practical importance for dynamic scene navigation in autonomous driving. Since scene flow labels are hard to obtain, current methods train their models on synthetic data and transfer them to real scenes. However, large disparities between existing synthetic da…

Cited by 37PDFcodeScholar
2022

Masked Measurement Prediction: Learning to Jointly Predict Quantities and Units from Textual Context

NAACL 2022findings

Physical measurements constitute a large portion of numbers in academic papers, engineering reports, and web tables. Current benchmarks fall short of properly evaluating numeracy of pretrained language models on measurements, hindering research on developing new methods and applying them to numerica…