← Search

Sheng Zhou

32 accepted papers

2026

History-Aware Reasoning for GUI Agents

AAAI 2026technical

Advances in Multimodal Large Language Models have significantly enhanced Graphical User Interface (GUI) automation. Equipping GUI agents with reliable episodic reasoning capabilities is essential for bridging the gap between users’ concise task descriptions and the complexities of real-world executi

Cited by 0SourcePDFScholar
2026

Intrinsic Gradient Suppression for Label-Noise Prompt Tuning in Vision–Language Models

ICML 2026poster

Contrastive vision-language models like CLIP exhibit remarkable zero-shot generalization. However, prompt tuning remains highly sensitive to label noise, as mislabeled samples generate disproportionately large gradients that can overwhelm pre-trained priors. We argue that because CLIP already provid…

Cited by 0SourceScholar
2026

OpenIKLR: Bridging the Reasoning Gap in Open-World Scenarios via Iterative Premise Completion

ICML 2026poster

Large Language Models (LLMs) demonstrate remarkable performance across various natural language processing tasks but struggle with complex logical reasoning, particularly in real-world settings. Existing research is largely confined to the closed-world assumption, which posits that all premises requ…

Cited by 0SourceScholar
2026

ProBench: Benchmarking GUI Agents with Accurate Process Information

AAAI 2026technical

With the deep integration of artificial intelligence and interactive technology, Graphical User Interface (GUI) Agent, as the carrier connecting goal-oriented natural language and real-world devices, has received widespread attention from the community. Contemporary benchmarks aim to evaluate the co

Cited by 0SourcePDFScholar
2026

REAL: Resolving Knowledge Conflicts in Knowledge-Intensive Visual Question Answering via Reasoning-Pivot Alignment

ICML 2026poster

Knowledge-intensive Visual Question Answering (KI-VQA) frequently suffers from severe knowledge conflicts caused by the inherent limitations of open-domain retrieval. However, existing paradigms face critical limitations, including the lack of generalizable conflict detection and intra-model constra…

Cited by 0SourceScholar
2026

RealUnify: Do Unified Models Truly Benefit from Unification? A Comprehensive Benchmark

CVPR 2026

The integration of visual understanding and generation into unified multimodal models represents a significant stride toward general-purpose AI. However, a fundamental question remains unanswered by existing benchmarks: does this architectural unification actually enable synergetic interaction betwe

Cited by 0SourcecodeScholar
2026

Towards Scalable Web Accessibility Audit with MLLMs as Copilots

AAAI 2026technical

Ensuring web accessibility is crucial for advancing social welfare, justice, and equality in digital spaces, yet the vast majority of website user interfaces remain non-compliant, due in part to the resource-intensive and unscalable nature of current auditing practices. While WCAG-EM offers a struct

Cited by 0SourcePDFScholar
2026

UniMM-V2X: MoE-Enhanced Multi-Level Fusion for End-to-End Cooperative Autonomous Driving

AAAI 2026technical

Autonomous driving holds transformative potential but remains fundamentally constrained by the limited perception and isolated decision-making with standalone intelligence. While recent multi-agent approaches introduce cooperation, they often focus merely on perception-level tasks, overlooking the a

Cited by 0SourcePDFScholar
2025

Advancing Loss Functions in Recommender Systems: A Comparative Study with a Rényi Divergence-Based Solution

AAAI 2025technical

Loss functions play a pivotal role in optimizing recommendation models. Among various loss functions, Softmax Loss (SL) and Cosine Contrastive Loss (CCL) are particularly effective. Their theoretical connections and differences warrant in-depth exploration. This work conducts comprehensive analyses…

2025

DiffCP: Ultra-Low Bit Collaborative Perception via Diffusion Model

ICRA 2025

Collaborative perception (CP) is emerging as a promising solution to the inherent limitations of stand-alone intelligence. However, current wireless communication systems are unable to support feature-level and raw-level collaborative algorithms due to their enormous bandwidth demands. In this paper

Cited by 8SourceScholar
2025

Divide and Conquer: Coordinating Multiplex Mixture of Graph Learners to Handle Multi-Omics Analysis

IJCAI 2025

Graph learning has shown significant advantages in organizing and leveraging complex data, making it promising for numerous real-world applications with heterogeneous information, particularly multi-omics data analysis. Despite its potential in such scenarios, existing methods are still in their inf

Cited by 0SourcePDFScholar
2025

EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answering

CVPR 2025poster

We introduce EgoTextVQA, a novel and rigorously constructed benchmark for egocentric QA assistance involving scene text. EgoTextVQA contains 1.5K ego-view videos and 7K scene-text aware questions that reflect real user needs in outdoor driving and indoor house-keeping activities. The questions are d…

2025

M4Bench: A Benchmark of Multi-domain Multi-granularity Multi-image Understanding for Multi-modal Large Language Models

IJCAI 2025

The increasing demands in analyzing complex associated scenes pose necessities to researching multi-image understanding abilities. Compared with understanding individual images, both the alignments and differences between images are essential aspects of understanding the intricate relationships for

2025

MP-GUI: Modality Perception with MLLMs for GUI Understanding

CVPR 2025poster

Graphical user interface (GUI) has become integral to modern society, making it crucial to be understood for human-centric systems. However, unlike natural images or documents, GUIs comprise artificially designed graphical elements arranged to convey specific semantic meanings. Current multi-modal l…

2025

Making Classic GNNs Strong Baselines Across Varying Homophily: A Smoothness–Generalization Perspective

NeurIPS 2025poster

Graph Neural Networks (GNNs) have achieved great success but are often considered to be challenged by varying levels of homophily in graphs. Recent empirical studies have surprisingly shown that homophilic GNNs can perform well across datasets of different homophily levels with proper hyperparameter…

Cited by 0SourcecodeScholar
2025

Towards a Unified Framework of Clustering-based Anomaly Detection

ICML 2025poster

Unsupervised Anomaly Detection (UAD) plays a crucial role in identifying abnormal patterns within data without labeled examples, holding significant practical implications across various domains. Although the individual contributions of representation learning and clustering to anomaly detection are…

Cited by 0SourcePDFScholar
2025

Understanding and Enhancing Message Passing on Heterophilic Graphs via Compatibility Matrix

NeurIPS 2025poster

Graph Neural Networks (GNNs) excel in graph mining tasks thanks to their message-passing mechanism, which aligns with the homophily assumption. However, connected nodes can also exhibit inconsistent behaviors, termed heterophilic patterns, sparking interest in heterophilic GNNs (HTGNNs). Although th…

Cited by 0SourceScholar
2025

WHALES: A Multi-Agent Scheduling Dataset for Enhanced Cooperation in Autonomous Driving

IROS 2025

Cooperative perception research is hindered by the limited availability of datasets that capture the complexity of real-world Vehicle-to-Everything (V2X) interactions, particularly under dynamic communication constraints. To address this gap, we introduce WHALES (Wireless enHanced Autonomous vehicle

Cited by 3SourcecodeScholar
2024

Exploiting Symmetric Temporally Sparse BPTT for Efficient RNN Training

AAAI 2024technical

Recurrent Neural Networks (RNNs) are useful in temporal sequence tasks. However, training RNNs involves dense matrix multiplications which require hardware that can support a large number of arithmetic operations and memory accesses. Implementing online training of RNNs on the edge calls for optimiz…

Cited by 2SourcePDFScholar
2024

GC-Bench: An Open and Unified Benchmark for Graph Condensation

NeurIPS 2024poster

Graph condensation (GC) has recently garnered considerable attention due to its ability to reduce large-scale graph datasets while preserving their essential properties. The core concept of GC is to create a smaller, more manageable graph that retains the characteristics of the original graph. Despi…

2024

Inversive-Reasoning Augmentation for Natural Language Inference

ICASSP 2024accepted

Natural language inference (NLI) aims to infer the relationship between two texts: premise and hypothesis. However, many existing methods overlook the problem of overestimation of model performance due to superficial correlation biases in NLI datasets. We study this problem and find that most curren…

Cited by 0SourceScholar
2024

MMAD:Multi-modal Movie Audio Description

COLING 2024main

Audio Description (AD) aims to generate narrations of information that is not accessible through unimodal hearing in movies to aid the visually impaired in following film narratives. Current solutions rely heavily on manual work, resulting in high costs and limited scalability. While automatic metho…

2024

NoisyGL: A Comprehensive Benchmark for Graph Neural Networks under Label Noise

NeurIPS 2024poster

Graph Neural Networks (GNNs) exhibit strong potential in node classification task through a message-passing mechanism. However, their performance often hinges on high-quality node labels, which are challenging to obtain in real-world scenarios due to unreliable sources or adversarial attacks. Conseq…

2024

PSL: Rethinking and Improving Softmax Loss from Pairwise Perspective for Recommendation

NeurIPS 2024poster

Softmax Loss (SL) is widely applied in recommender systems (RS) and has demonstrated effectiveness. This work analyzes SL from a pairwise perspective, revealing two significant limitations: 1) the relationship between SL and conventional ranking metrics like DCG is not sufficiently tight; 2) SL is h…

2024

Rethinking Propagation for Unsupervised Graph Domain Adaptation

AAAI 2024technical

Unsupervised Graph Domain Adaptation (UGDA) aims to transfer knowledge from a labelled source graph to an unlabelled target graph in order to address the distribution shifts between graph domains. Previous works have primarily focused on aligning data from the source and target graph in the represen…

2024

Revisiting, Benchmarking and Understanding Unsupervised Graph Domain Adaptation

NeurIPS 2024poster

Unsupervised Graph Domain Adaptation (UGDA) involves the transfer of knowledge from a label-rich source graph to an unlabeled target graph under domain discrepancies. Despite the proliferation of methods designed for this emerging task, the lack of standard experimental settings and fair performance…

2023

OpenGSL: A Comprehensive Benchmark for Graph Structure Learning

NeurIPS 2023poster

Graph Neural Networks (GNNs) have emerged as the *de facto* standard for representation learning on graphs, owing to their ability to effectively integrate graph topology and node attributes. However, the inherent suboptimal nature of node connections, resulting from the complex and contingent forma…

2023

Robust Sequence Networked Submodular Maximization

AAAI 2023technical

In this paper, we study the Robust optimization for sequence Networked submodular maximization (RoseNets) problem. We interweave the robust optimization with the sequence networked submodular maximization. The elements are connected by a directed acyclic graph and the objective function is not subm…

Cited by 0SourcePDFScholar
2022

Hilbert Distillation for Cross-Dimensionality Networks

NeurIPS 2022accept

3D convolutional neural networks have revealed superior performance in processing volumetric data such as video and medical imaging. However, the competitive performance by leveraging 3D networks results in huge computational costs, which are far beyond that of 2D networks. In this paper, we propose…

2022

Learning Spatial-Preserved Skeleton Representations for Few-Shot Action Recognition

ECCV 2022poster

"Few-shot action recognition aims to recognize few-labeled novel action classes and attracts growing attentions due to practical significance. Human skeletons provide explainable and data-efficient representation for this problem by explicitly modeling spatial-temporal relations among skeleton joint…

2022

RMGN: A Regional Mask Guided Network for Parser-free Virtual Try-on

IJCAI 2022poster

Virtual try-on (VTON) aims at fitting target clothes to reference person images, which is widely adopted in e-commerce. Existing VTON approaches can be narrowly categorized into Parser-Based (PB) and Parser-Free (PF) by whether relying on the parser information to mask the persons’clothes and synthe…

2021

Distilling Holistic Knowledge With Graph Neural Networks

ICCV 2021poster

Knowledge Distillation (KD) aims at transferring knowledge from a larger well-optimized teacher network to a smaller learnable student network. Existing KD methods have mainly considered two types of knowledge, namely the individual knowledge and the relational knowledge. However, these two types of…

Cited by 80PDFcodeScholar