← Search

Wenguan Wang

110 accepted papers

2026

Beyond Frequency: Scoring-Driven Debiasing for Object Detection via Blueprint-Prompted Image Synthesis

ICLR 2026poster

This paper presents a generation-based debiasing framework for object detection. Prior debiasing methods are often limited by the representation diversity of samples, while naive generative augmentation often preserves the biases it aims to solve. Moreover, our analysis reveals that simply generatin…

Cited by 0SourcecodeScholar
2026

Clinically-Grounded Counterfactual Reasoning for Medical Video Diagnosis

CVPR 2026

Clinical video diagnosis, in which physicians assess dynamic tissue responses across procedural stages, is critical for detecting diseases such as cervical and colorectal cancers. Recent spatiotemporal models map visual progressions directly to diagnostic outputs, yet overlook two hallmarks of exper

Cited by 0SourceScholar
2026

Deep Ensemble Clustering for Visual Representation Learning

ICML 2026poster

Recent advances in visual representation learning have seen the rise of clustering-based vision backbones, which adopt clustering as a core paradigm for feature extraction. However, existing clustering-based backbones typically rely on a single clustering algorithm, whose inherent inductive bias lim…

Cited by 0SourceScholar
2026

History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language Navigation

AAAI 2026technical

Aerial Vision-and-Language Navigation (AVLN) requires Unmanned Aerial Vehicle (UAV) agents to localize targets in large-scale urban environments based on linguistic instructions. While successful navigation demands both global environmental reasoning and local scene comprehension, existing UAV agent

Cited by 0SourcePDFScholar
2026

Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation

CVPR 2026

In this paper, we propose Iris, a deterministic framework for Monocular Depth Estimation (MDE) that integrates real-world priors into the diffusion model. Conventional feed-forward methods rely on massive training data, yet still miss details. Previous diffusion-based methods leverage rich generativ

Cited by 0SourcecodeScholar
2026

Learning 3D Representations for Spatial Intelligence from Unposed Multi-View Images

CVPR 2026

Robust 3D representation learning forms the perceptual foundation of spatial intelligence, enabling downstream tasks in scene understanding and embodied AI. However, learning such representations directly from unposed multi-view images remains challenging. Recent self-supervised methods attempt to u

Cited by 0SourceScholar
2026

Moving Beyond Diffusion: Hierarchy-to-Hierarchy Autoregression for fMRI-to-Image Reconstruction

ICLR 2026poster

Reconstructing visual stimuli from fMRI signals is a central challenge bridging machine learning and neuroscience. Recent diffusion-based methods typically map fMRI activity to a single neural embedding, using it as static guidance throughout the entire generation process. However, this fixed guidan…

Cited by 0SourcecodeScholar
2026

SAMT: Generating Structured Avatar Meshes and Textures from a Single Image

ICML 2026poster

Despite rapid progress in 3D generative models, producing production-grade 3D face assets from a single image remains challenging. To reconstruct facial micro-structures and fine-grained multiview-consistent textures, this work presents a two-stage framework named SAMT for monocular 3D avatar genera…

Cited by 0SourceScholar
2026

Uncertainty-Aware 3D Reconstruction for Dynamic Underwater Scenes

ICLR 2026poster

Underwater 3D reconstruction remains challenging due to the intricate interplay between light scattering and environment dynamics. While existing methods yield plausible reconstruction with rigid scene assumptions, they struggle to capture temporal dynamics and remain sensitive to observation noise.…

Cited by 0SourceScholar
2026

Uncertainty-Aware Gaussian Map for Vision-Language Navigation

ICLR 2026poster

Vision-Language Navigation (VLN) requires an agent to navigate 3D environments following natural language instructions. During navigation, existing agents commonly encounter perceptual uncertainty, such as insufficient evidence for reliable grounding or ambiguity in interpreting spatial cues, yet th…

Cited by 0SourceScholar
2025

3D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation

ICCV 2025poster

Vision-language navigation (VLN) requires an agent to traverse complex 3D environments based on natural language instructions, necessitating a thorough scene understanding. While existing works equip agents with various scene representations to enhance spatial awareness, they often neglect the compl…

2025

A Conditional Probability Framework for Compositional Zero-shot Learning

ICCV 2025poster

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen combinations of known objects and attributes by leveraging knowledge from previously seen compositions. Traditional approaches primarily focus on disentangling attributes and objects, treating them as independent entities during learni…

Cited by 0SourcePDFScholar
2025

Cycle-Consistent Learning for Joint Layout-to-Image Generation and Object Detection

ICCV 2025poster

In this paper, we propose a generation-detection cycle consistent (GDCC) learning framework that jointly optimizes both layout-to-image (L2I) generation and object detection (OD) tasks in an end-to-end manner. The key of GDCC lies in the inherent duality between the two tasks, where L2I takes all ob…

2025

Do as We Do, Not as You Think: the Conformity of Large Language Models

ICLR 2025oral

Recent advancements in large language models (LLMs) revolutionize the field of intelligent agents, enabling collaborative multi-agent systems capable of tackling complex problems across various domains. However, the potential of conformity within these systems, analogous to phenomena like conformity…

2025

Dual Reciprocal Learning of Language-based Human Motion Understanding and Generation

ICCV 2025poster

Language-based human motion understanding focuses on describing human motions using natural language descriptions. Conversely, human motion generation aims to generate human motions from textual inputs. Despite significant progress in both fields, further advancements are hindered by two primary cha…

2025

Gaussian-based World Model: Gaussian Priors for Voxel-Based Occupancy Prediction and Future Motion Prediction

ICCV 2025poster

In autonomous driving, accurately predicting occupancy and motion is crucial for safe navigation within dynamic environments. However, existing methods often suffer from difficulties in handling complex scenes and uncertainty arising from sensor data. To address these issues, we propose a new Gaussi…

2025

Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generation

ICLR 2025poster

DETR introduces a simplified one-stage framework for scene graph generation (SGG) but faces challenges of sparse supervision and false negative samples. The former occurs because each image typically contains fewer than 10 relation annotations, while DETR-based SGG models employ over 100 relation qu…

Cited by 4SourcePDFScholar
2025

LOGICZSL: Exploring Logic-induced Representation for Compositional Zero-shot Learning

CVPR 2025poster

Compositional zero-shot learning (CZSL) aims to recognize unseen attribute-object compositions by learning the primitive concepts (*i.e.*, attribute and object) from the training set. While recent works achieve impressive results in CZSL by leveraging large vision-language models like CLIP, they ign…

2025

Learning Clustering-based Prototypes for Compositional Zero-Shot Learning

ICLR 2025poster

Learning primitive (i.e., attribute and object) concepts from seen compositions is the primary challenge of Compositional Zero-Shot Learning (CZSL). Existing CZSL solutions typically rely on oversimplified data assumptions, e.g., modeling each primitive with a single centroid primitive presentation,…

2025

Multi-view Reconstruction via SfM-guided Monocular Depth Estimation

CVPR 2025poster

This paper aims to reconstruct the scene geometry from multi-view images with strong robustness and high quality. Previous learning-based methods incorporate neural networks into the multi-view stereo matching and have shown impressive reconstruction results. However, due to the reliance on matching…

2025

OmniGaze: Reward-inspired Generalizable Gaze Estimation in the Wild

NeurIPS 2025poster

Current 3D gaze estimation methods struggle to generalize across diverse data domains, primarily due to $\textbf{i)}$ $\textit{the scarcity of annotated datasets}$, and $\textbf{ii)}$ $\textit{the insufficient diversity of labeled data}$. In this work, we present OmniGaze, a semi-supervised framewor…

Cited by 0SourceScholar
2025

Scene Map-based Prompt Tuning for Navigation Instruction Generation

CVPR 2025poster

Navigation instruction generation (NIG), which provides interactive feedback and guidance to humans along a trajectory, is vital for developing embodied agents capable of human-machine communication and collaboration through natural language. Early data-driven methods directly map sequences of past…

2025

TAGA: Self-supervised Learning for Template-free Animatable Gaussian Articulated Model

CVPR 2025poster

Decoupling from customized parametric templates represents a crucial step toward the creation of fully flexible, animatable articulated models. While existing template-free methods can achieve high-fidelity reconstruction in observed views, they struggle to recover plausible canonical models, result…

2025

Towards Human-like Virtual Beings: Simulating Human Behavior in 3D Scenes

ICCV 2025poster

Building autonomous agents that can replicate human behavior in the realistic 3D world is a key step toward artificial general intelligence. This requires agents to be holistic goal achievers and to naturally adapt to environmental dynamics. In this work, we introduce ACTOR, an agent capable of perf…

2025

UNIALIGN: Scaling Multimodal Alignment within One Unified Model

CVPR 2025poster

We present UNIALIGN, a unified model to align an arbitrary number of modalities (\text e.g. , image, text, audio, 3D point cloud, etc.) through one encoder and a single training phase. Existing solutions typically employ distinct encoders for each modality, resulting in increased parameters as the…

2024

Clustering Propagation for Universal Medical Image Segmentation

CVPR 2024poster

Prominent solutions for medical image segmentation are typically tailored for automatic or interactive setups posing challenges in facilitating progress achieved in one task to another. This also necessitates separate models for each task duplicating both training time and parameters. To address abo…

2024

DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models (Exemplified as A Video Agent)

ICML 2024poster

Recent LLM-driven visual agents mainly focus on solving image-based tasks, which limits their ability to understand dynamic scenes, making it far from real-life applications like guiding students in laboratory experiments and identifying their mistakes. Hence, this paper explores DoraemonGPT, a comp…

2024

Facing the Elephant in the Room: Visual Prompt Tuning or Full finetuning?

ICLR 2024poster

As the scale of vision models continues to grow, the emergence of Visual Prompt Tuning (VPT) as a parameter-efficient transfer learning technique has gained attention due to its superior performance compared to traditional full-finetuning. However, the conditions favoring VPT (the "when") and the un…

2024

Human-Object Interaction Detection Collaborated with Large Relation-driven Diffusion Models

NeurIPS 2024poster

Prevalent human-object interaction (HOI) detection approaches typically leverage large-scale visual-linguistic models to help recognize events involving humans and objects. Though promising, models trained via contrastive learning on text-image pairs often neglect mid/low-level visual cues and strug…

Cited by 7SourcePDFScholar
2024

IS-Fusion: Instance-Scene Collaborative Fusion for Multimodal 3D Object Detection

CVPR 2024highlight

Bird's eye view (BEV) representation has emerged as a dominant solution for describing 3D space in autonomous driving scenarios. However objects in the BEV representation typically exhibit small sizes and the associated point cloud context is inherently sparse which leads to great challenges for rel…

2024

Interpretable3D: An Ad-Hoc Interpretable Classifier for 3D Point Clouds

AAAI 2024technical

3D decision-critical tasks urgently require research on explanations to ensure system reliability and transparency. Extensive explanatory research has been conducted on 2D images, but there is a lack in the 3D field. Furthermore, the existing explanations for 3D models are post-hoc and can be mislea…

2024

LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels

CVPR 2024poster

Autonomous systems need to process large-scale sparse and irregular point clouds with limited compute resources. Consequently it is essential to develop LiDAR perception methods that are both efficient and effective. Although naively enlarging 3D kernel size can enhance performance it will also lead…

2024

MS2SL: Multimodal Spoken Data-Driven Continuous Sign Language Production

ACL 2024findings

Sign language understanding has made significant strides; however, there is still no viable solution for generating sign sequences directlyfrom entire spoken content, e.g., text or speech. In this paper, we propose a unified framework for continuous sign language production, easing communication bet…

Cited by 3SourcePDFScholar
2024

Poly Kernel Inception Network for Remote Sensing Detection

CVPR 2024poster

Object detection in remote sensing images (RSIs) often suffers from several increasing challenges including the large variation in object scales and the diverse-ranging context. Prior methods tried to address these challenges by expanding the spatial receptive field of the backbone either through la…

2024

Psychometry: An Omnifit Model for Image Reconstruction from Human Brain Activity

CVPR 2024poster

Reconstructing the viewed images from human brain activity bridges human and computer vision through the Brain-Computer Interface. The inherent variability in brain function between individuals leads existing literature to focus on acquiring separate models for each individual using their respective…

Cited by 17SourcePDFScholar
2024

Shape2Scene: 3D Scene Representation Learning Through Pre-training on Shape Data

ECCV 2024poster

"Current 3D self-supervised learning methods of 3D scenes face a data desert issue, resulting from the time-consuming and expensive collecting process of 3D scene data. Conversely, 3D shape datasets are easier to collect. Despite this, existing pre-training strategies on shape data offer limited pot…

2023

Boosting Video Object Segmentation via Space-Time Correspondence Learning

CVPR 2023poster

Current top-leading solutions for video object segmentation (VOS) typically follow a matching-based regime: for each query frame, the segmentation mask is inferred according to its correspondence to previously processed and the first annotated frames. They simply exploit the supervisory signals from…

2023

ClusterFomer: Clustering As A Universal Visual Learner

NeurIPS 2023poster

This paper presents ClusterFormer, a universal vision model that is based on the Clustering paradigm with TransFormer. It comprises two novel designs: 1) recurrent cross-attention clustering, which reformulates the cross-attention mechanism in Transformer and enables recursive updates of cluster cen…

2023

Clustering based Point Cloud Representation Learning for 3D Analysis

ICCV 2023poster

Point cloud analysis (such as 3D segmentation and detection) is a challenging task, because of not only the irregular geometries of many millions of unordered points, but also the great variations caused by depth, viewpoint, occlusion, etc. Current studies put much focus on the adaption of neural ne…

Cited by 35PDFcodeScholar
2023

DREAMWALKER: Mental Planning for Continuous Vision-Language Navigation

ICCV 2023poster

VLN-CE is a recently released embodied task, where AI agents need to navigate a freely traversable environment to reach a distant target location, given language instructions. It poses great challenges due to the huge space of possible strategies. Driven by the belief that the ability to anticipate…

Cited by 38PDFcodeScholar
2023

E^2VPT: An Effective and Efficient Approach for Visual Prompt Tuning

ICCV 2023poster

As the size of transformer-based models continues to grow, fine-tuning these large-scale pre-trained vision models for new tasks has become increasingly parameter-intensive. Parameter-efficient learning has been developed to reduce the number of tunable parameters during fine-tuning. Although these…

Cited by 89PDFcodeScholar
2023

LANA: A Language-Capable Navigator for Instruction Following and Generation

CVPR 2023poster

Recently, visual-language navigation (VLN) -- entailing robot agents to follow navigation instructions -- has shown great advance. However, existing literature put most emphasis on interpreting instructions into actions, only delivering "dumb" wayfinding agents. In this article, we devise LANA, a la…

2023

Large-Scale Person Detection and Localization Using Overhead Fisheye Cameras

ICCV 2023oral

Location determination finds wide applications in daily life. Instead of existing efforts devoted to localizing tourist photos captured by perspective cameras, in this article, we focus on developing person positioning solutions using overhead fisheye cameras. Such solutions are advantageous in larg…

Cited by 25PDFScholar
2023

Logic-induced Diagnostic Reasoning for Semi-supervised Semantic Segmentation

ICCV 2023poster

Recent advances in semi-supervised semantic segmentation have been heavily reliant on pseudo labeling to compensate for limited labeled data, disregarding the valuable relational knowledge among semantic concepts. To bridge this gap, we devise LogicDiag, a brand new neural-logic semi-supervised lear…

Cited by 42PDFcodeScholar
2023

Omnidirectional Information Gathering for Knowledge Transfer-Based Audio-Visual Navigation

ICCV 2023poster

Audio-visual navigation is an audio-targeted wayfinding task where a robot agent is entailed to travel a never-before-seen 3D environment towards the sounding source. In this article, we present ORAN, an omnidirectional audio-visual navigator based on cross-task navigation skill transfer. In particu…

Cited by 8PDFcodeScholar
2023

Unified Mask Embedding and Correspondence Learning for Self-Supervised Video Segmentation

CVPR 2023poster

The objective of this paper is self-supervised learning of video object segmentation. We develop a unified framework which simultaneously models cross-frame dense correspondence for locally discriminative feature learning and embeds object-level context for target-mask decoding. As a result, it is a…

2022

Counterfactual Cycle-Consistent Learning for Instruction Following and Generation in Vision-Language Navigation

CVPR 2022poster

Since the rise of vision-language navigation (VLN), great progress has been made in instruction following -- building a follower to navigate environments under the guidance of instructions. However, far less attention has been paid to the inverse task: instruction generation -- learning a speaker to…

Cited by 62PDFcodeScholar
2022

GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Models

NeurIPS 2022accept

Prevalent semantic segmentation solutions are, in essence, a dense discriminative classifier of p(class|pixel feature). Though straightforward, this de facto paradigm neglects the underlying data distribution p(pixel feature|class), and struggles to identify out-of-distribution data. Going beyond th…

2022

Learning Equivariant Segmentation with Instance-Unique Querying

NeurIPS 2022accept

Prevalent state-of-the-art instance segmentation methods fall into a query-based scheme, in which instance masks are derived by querying the image feature using a set of instance-aware embeddings. In this work, we devise a new training framework that boosts query-based models through discriminative…

2022

Locality-Aware Inter- and Intra-Video Reconstruction for Self-Supervised Correspondence Learning

CVPR 2022poster

Our target is to learn visual correspondence from unlabeled videos. We develop LIIR, a locality-aware inter-and intra-video reconstruction framework that fills in three missing pieces, i.e., instance discrimination, location awareness, and spatial compactness, of self-supervised correspondence learn…

Cited by 54PDFcodeScholar
2022

ProposalContrast: Unsupervised Pre-training for LiDAR-Based 3D Object Detection

ECCV 2022poster

"Existing approaches for unsupervised point cloud pre-training are constrained to either scene-level or point/voxel-level instance discrimination. Scene-level methods tend to lose local details that are crucial for recognizing the road objects, while point/voxel-level methods inherently suffer from…

2022

Reference-Based Image Super-Resolution with Deformable Attention Transformer

ECCV 2022poster

"Reference-based image super-resolution (RefSR) aims to exploit auxiliary reference (Ref) images to super-resolve low-resolution (LR) images. Recently, RefSR has been attracting great attention as it provides an alternative way to surpass single image SR. However, addressing the RefSR problem has tw…

2022

Semi-Supervised 3D Object Detection with Proficient Teachers

ECCV 2022poster

"Dominated point cloud-based 3D object detectors in autonomous driving scenarios rely heavily on the huge amount of accurately labeled samples, however, 3D annotation in the point cloud is extremely tedious, expensive and time-consuming. To reduce the dependence on large supervision, semi-supervised…

2022

Towards Interpretable Video Super-Resolution via Alternating Optimization

ECCV 2022poster

"In this paper, we study a practical space-time video super-resolution (STVSR) problem which aims at generating a high-framerate high-resolution sharp video from a low-framerate low-resolution blurry video. Such problem often occurs when recording a fast dynamic event with a low-framerate and low-re…

2021

Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentation

CVPR 2021poster

Language-queried video actor segmentation aims to predict the pixel-level mask of the actor which performs the actions described by a natural language query in the target frames. Existing methods adopt 3D CNNs over the video clip as a general encoder to extract a mixed spatio-temporal feature for th…

Cited by 58PDFScholar
2021

Differentiable Multi-Granularity Human Representation Learning for Instance-Aware Human Semantic Parsing

CVPR 2021poster

To address the challenging task of instance-aware human part parsing, a new bottom-up regime is proposed to learn category-level human semantic segmentation as well as multi-person pose estimation in a joint and end-to-end manner. It is a compact, efficient and powerful framework that exploits struc…

Cited by 93PDFcodeScholar
2021

Exploring Cross-Image Pixel Contrast for Semantic Segmentation

ICCV 2021poster

Current semantic segmentation methods focus only on mining "local" context, i.e., dependencies between pixels within individual images, by context-aggregation modules (e.g., dilated convolution, neural attention) or structure-aware optimization criteria (e.g., IoU-like loss). However, they ignore "g…

Cited by 624PDFcodeScholar
2021

Structured Scene Memory for Vision-Language Navigation

CVPR 2021poster

Recently, numerous algorithms have been developed to tackle the problem of vision-language navigation (VLN), i.e., entailing an agent to navigate 3D environments through following linguistic instructions. However, current VLN agents simply store their past experiences/observations as latent states i…

Cited by 136PDFcodeScholar
2020

A Unified Object Motion and Affinity Model for Online Multi-Object Tracking

CVPR 2020poster

Current popular online multi-object tracking (MOT) solutions apply single object trackers (SOTs) to capture object motions, while often requiring an extra affinity network to associate objects, especially for the occluded ones. This brings extra computational overhead due to repetitive feature extra…

Cited by 139PDFcodeScholar
2020

Active Visual Information Gathering for Vision-Language Navigation

ECCV 2020poster

Vision-language navigation (VLN) is the task of entailing an agent to carry out navigational instructions inside photo-realistic environments. One of the key challenges in VLN is how to conduct a robust navigation by mitigating the uncertainty caused by ambiguous instructions and insufficient observ…

2020

Hierarchical Human Parsing With Typed Part-Relation Reasoning

CVPR 2020poster

Human parsing is for pixel-wise human semantic understanding. As human bodies are underlying hierarchically structured, how to model human structures is the central theme in this task. Focusing on this, we seek to simultaneously exploit the representational capacity of deep graph networks and the hi…

Cited by 136PDFcodeScholar
2020

Learning Video Object Segmentation From Unlabeled Videos

CVPR 2020poster

We propose a new method for video object segmentation (VOS) that addresses object pattern learning from unlabeled videos, unlike most existing methods which rely heavily on extensive annotated data. We introduce a unified unsupervised/weakly supervised learning framework, called MuG, that comprehens…

Cited by 192PDFcodeScholar
2020

Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation

ECCV 2020poster

This paper studies the problem of learning semantic segmentation from image-level supervision only. Current popular solutions leverage object localization maps from classifiers as supervision signals, and struggle to make the localization maps capture more complete object content. Rather than previo…

2020

Video Object Segmentation with Episodic Graph Memory Networks

ECCV 2020poster

How to make a segmentation model efficiently adapt to a specific video as well as online target appearance variations is a fun- damental issue in the field of video object segmentation. In this work, a graph memory network is developed to address the novel idea of “learning to update the segmentatio…

2020

Weakly Supervised 3D Object Detection from Lidar Point Cloud

ECCV 2020poster

It is laborious to manually label point cloud data for training high-quality 3D object detectors. This work proposes a weakly supervised approach for 3D object detection, only requiring a small set of weakly annotated scenes, associated with a few precisely labeled object instances. This is achieved…

2019

An Iterative and Cooperative Top-Down and Bottom-Up Inference Network for Salient Object Detection

CVPR 2019poster

This paper presents a salient object detection method that integrates both top-down and bottom-up saliency inference in an iterative and cooperative manner. The top-down process is used for coarse-to-fine saliency estimation, where high-level saliency is gradually integrated with finer lower-layer f…

Cited by 259PDFScholar
2019

Learning Compositional Neural Information Fusion for Human Parsing

ICCV 2019poster

This work proposes to combine neural networks with the compositional hierarchy of human bodies for efficient and complete human parsing. We formulate the approach as a neural information fusion framework. Our model assembles the information from three inference processes over the hierarchy: direct i…

Cited by 160PDFcodeScholar
2019

Learning Unsupervised Video Object Segmentation Through Visual Attention

CVPR 2019poster

This paper conducts a systematic study on the role of visual attention in Unsupervised Video Object Segmentation (UVOS) tasks. By elaborately annotating three popular video segmentation datasets (DAVIS, Youtube-Objects and SegTrack V2) with dynamic eye-tracking data in the UVOS setting, for the firs…

Cited by 277PDFcodeScholar
2019

Optimizing the F-Measure for Threshold-Free Salient Object Detection

ICCV 2019poster

Current CNN-based solutions to salient object detection (SOD) mainly rely on the optimization of cross-entropy loss (CELoss). Then the quality of detected saliency maps is often evaluated in terms of F-measure. In this paper, we investigate an interesting issue: can we consistently use the F-measure…

Cited by 90PDFScholar
2019

Reasoning Visual Dialogs With Structural and Partial Observations

CVPR 2019oral

We propose a novel model to address the task of Visual Dialog which exhibits complex dialog structures. To obtain a reasonable answer based on the current question and the dialog history, the underlying semantic dependencies between dialog entities are essential. In this paper, we explicitly formali…

Cited by 143PDFcodeScholar
2019

Salient Object Detection With Pyramid Attention and Salient Edges

CVPR 2019poster

This paper presents a new method for detecting salient objects in images using convolutional neural networks (CNNs). The proposed network, named PAGE-Net, offers two key contributions. The first is the exploitation of an essential pyramid attention structure for salient object detection. This enable…

Cited by 602PDFScholar
2019

See More, Know More: Unsupervised Video Object Segmentation With Co-Attention Siamese Networks

CVPR 2019poster

We introduce a novel network, called as CO-attention Siamese Network (COSNet), to address the unsupervised video object segmentation task from a holistic view. We emphasize the importance of inherent correlation among video frames and incorporate a global co-attention mechanism to improve further th…

Cited by 598PDFcodeScholar
2019

Shifting More Attention to Video Salient Object Detection

CVPR 2019oral

The last decade has witnessed a growing interest in video salient object detection (VSOD). However, the research community long-term lacked a well-established VSOD dataset representative of real dynamic scenes with high-quality annotations. To address this issue, we elaborately collected a visual-at…

Cited by 561PDFcodeScholar
2019

Understanding Human Gaze Communication by Spatio-Temporal Graph Reasoning

ICCV 2019poster

This paper addresses a new problem of understanding human gaze communication in social videos from both atomic-level and event-level, which is significant for studying human social interactions. To tackle this novel and challenging problem, we contribute a large-scale video dataset, VACATION, which…

Cited by 145PDFcodeScholar
2019

Zero-Shot Video Object Segmentation via Attentive Graph Neural Networks

ICCV 2019oral

This work proposes a novel attentive graph neural network (AGNN) for zero-shot video object segmentation (ZVOS). The suggested AGNN recasts this task as a process of iterative information fusion over video graphs. Specifically, AGNN builds a fully connected graph to efficiently represent frames as n…

Cited by 353PDFcodeScholar
2018

Attentive Fashion Grammar Network for Fashion Landmark Detection and Clothing Category Classification

CVPR 2018poster

This paper proposes a knowledge-guided fashion network to solve the problem of visual fashion analysis, e.g., fashion landmark localization and clothing category classification. The suggested fashion model is leveraged with high-level human knowledge in this domain. We propose two important fashion…

Cited by 307SourcePDFScholar
2018

Hyperparameter Optimization for Tracking With Continuous Deep Q-Learning

CVPR 2018poster

Hyperparameters are numerical presets whose values are assigned prior to the commencement of the learning process. Selecting appropriate hyperparameters is critical for the accuracy of tracking algorithms, yet it is difficult to determine their optimal values, in particular, adaptive ones for each s…

Cited by 198SourcePDFScholar
2018

Learning Descriptor Networks for 3D Shape Synthesis and Analysis

CVPR 2018poster

This paper proposes a 3D shape descriptor network, which is a deep convolutional energy-based model, for modeling volumetric shape patterns. The maximum likelihood training of the model follows an "analysis by synthesis" scheme and can be interpreted as a mode seeking and mode shifting process. The…

2018

Learning Human-Object Interactions by Graph Parsing Neural Networks

ECCV 2018poster

This paper addresses the task of detecting and recognizing human-object interactions (HOI) in images and videos. We introduce the Graph Parsing Neural Network (GPNN), a framework that incorporates structural knowledge while being differentiable end-to-end. For a given scene, GPNN infers a parse grap…

2018

Pyramid Dilated Deeper ConvLSTM for Video Salient Object Detection

ECCV 2018poster

This paper proposes a fast video salient object detection model, based on a novel recurrent network architecture, named Pyramid Dilated Bidirectional ConvLSTM (PDB-ConvLSTM). A Pyramid Dilated Convolution (PDC) module is first designed for simultaneously extracting spatial features at multiple scale…

Cited by 593SourcePDFScholar
2018

Revisiting Video Saliency: A Large-Scale Benchmark and a New Model

CVPR 2018poster

In this work, we contribute to video saliency research in two ways. First, we introduce a new benchmark for predicting human eye movements during dynamic scene free-viewing, which is long-time urged in this field. Our dataset, named DHF1K~(Dynamic Human Fixation), consists of 1K high-quality, elabor…

2018

Salient Object Detection Driven by Fixation Prediction

CVPR 2018poster

Research in visual saliency has been focused on two major types of models namely fixation prediction and salient object detection. The relationship between the two, however, has been less explored. In this paper, we propose to employ the former model type to identify and segment salient objects in s…