← Search

Shiqi Jiang

12 accepted papers

2026

AdaNav: Adaptive Reasoning with Uncertainty for Vision-Language Navigation

ICML 2026poster

Vision-Language Navigation (VLN) requires agents to follow natural language instructions by grounding them in sequential visual observations over long horizons. Explicit reasoning could enhance temporal consistency and perception–action alignment, but reasoning at fixed steps often leads to suboptim…

Cited by 0SourceScholar
2026

Concept Heterogeneity-aware Representation Steering

ICML 2026poster

Representation steering offers a lightweight mechanism for controlling the behavior of large language models (LLMs) by intervening on internal activations at inference time. Most existing methods rely on a single global steering direction, typically obtained via difference-in-means over contrastive …

Cited by 0SourceScholar
2026

Expert Merging in Sparse Mixture of Experts with Nash Bargaining

ICLR 2026poster

Existing expert merging strategies for Sparse Mixture of Experts (SMoE) typically rely on input-dependent or input-independent averaging of expert parameters, but often lack a principled weighting mechanism. In this work, we reinterpret expert merging through the lens of game theory, revealing coope…

Cited by 0SourcecodeScholar
2026

MPJudge: Towards Perceptual Assessment of Music-Induced Paintings

AAAI 2026technical

Music-induced painting is a unique artistic practice, where visual artworks are created under the influence of music. Evaluating whether a painting faithfully reflects the music that inspired it poses a challenging perceptual assessment task. Existing methods primarily rely on emotion recognition mo

Cited by 0SourcePDFScholar
2026

OmniVLA: Physically-Grounded Multimodal VLA with Unified Multi-Sensor Perception for Robotic Manipulation

ICRA 2026poster

Vision-language-action (VLA) models have shown strong generalization in robotic manipulation through large-scale vision-language pretraining. However, most existing models rely solely on RGB cameras, limiting their perception and, consequently, manipulation capabilities. We present OmniVLA, an omni-…

2026

ProRe: A Proactive Reward System for GUI Agents via Reasoner–Actor Collaboration

ICLR 2026poster

Reward is critical to the evaluation and training of large language models (LLMs). However, existing rule-based or model-based reward methods struggle to generalize to GUI agents, where access to ground-truth trajectories or application databases is often unavailable, and static trajectory-based LLM…

Cited by 0SourcecodeScholar
2026

Video-in-the-Loop: Span-Grounded Long Video QA with Interleaved Reasoning

ICML 2026poster

We present $\textit{Video-in-the-Loop}$ (ViTL), a two-stage long-video QA framework that preserves a fixed token budget by first $\textit{localizing}$ question-relevant interval(s) with a low-fps skim and then $\textit{answering}$ via span-aware reallocation of visual tokens at higher effective fram…

Cited by 3SourceScholar
2025

Robust Message Embedding via Attention Flow-Based Steganography

CVPR 2025poster

Image steganography can hide information in a host image and obtain a stego image that is perceptually indistinguishable from the original one. This technique has tremendous potential in scenarios like copyright protection and information retrospection. Some previous studies have proposed to enhance…

2025

StreamMind: Unlocking Full Frame Rate Streaming Video Dialogue through Event-Gated Cognition

ICCV 2025poster

With the rise of real-world human-AI interaction applications, such as AI assistants, the need for Streaming Video Dialogue is critical. To address this need, we introduce StreamMind, a video LLM framework that achieves ultra-FPS streaming video processing (100 fps on a single A100) and enables proa…

Cited by 0SourcePDFScholar
2025

TextCenGen: Attention-Guided Text-Centric Background Adaptation for Text-to-Image Generation

ICML 2025poster

Text-to-image (T2I) generation has made remarkable progress in producing high-quality images, but a fundamental challenge remains: creating backgrounds that naturally accommodate text placement without compromising image quality. This capability is non-trivial for real-world applications like graph…

2024

AACP: Aesthetics Assessment of Children’s Paintings Based on Self-Supervised Learning

AAAI 2024technical

The Aesthetics Assessment of Children's Paintings (AACP) is an important branch of the image aesthetics assessment (IAA), playing a significant role in children's education. This task presents unique challenges, such as limited available data and the requirement for evaluation metrics from multiple…

Cited by 1SourcePDFScholar
2024

LLM-based Multi-Level Knowledge Generation for Few-shot Knowledge Graph Completion

IJCAI 2024poster

Knowledge Graphs (KGs) are pivotal in various NLP applications but often grapple with incompleteness, especially due to the long-tail problem where infrequent, unpopular relationships drastically reduce the KG completion performance. In this paper, we focus on Few-shot Knowledge Graph Completion (FK…

Cited by 6SourcePDFScholar