← Search

Xinyu Gong

12 accepted papers

2024

Grounded-Instruct-Pix2Pix: Improving Instruction Based Image Editing with Automatic Target Grounding

ICASSP 2024accepted

Text-guided Image Editing has recently attracted significant attention due to advances in the denoising diffusion models field. Current methods make it possible to execute complex image editing operations with simple text prompts. But despite impressive results, they often fail to restrict the edit…

Cited by 0SourceScholar
2023

MMG-Ego4D: Multimodal Generalization in Egocentric Action Recognition

CVPR 2023poster

In this paper, we study a novel problem in egocentric action recognition, which we term as "Multimodal Generalization" (MMG). MMG aims to study how systems can generalize when data from certain modalities is limited or even completely missing. We thoroughly investigate MMG in the context of standard…

2023

NeRF-SOS: Any-View Self-supervised Object Segmentation on Complex Scenes

ICLR 2023poster

Neural volumetric representations have shown the potential that Multi-layer Perceptrons (MLPs) can be optimized with multi-view calibrated images to represent scene geometry and appearance without explicit 3D supervision. Object segmentation can enrich many downstream applications based on the learn…

2022

Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis

NeurIPS 2022accept

Advanced deep neural networks (DNNs), designed by either human or AutoML algorithms, are growing increasingly complex. Diverse operations are connected by complicated connectivity patterns, e.g., various types of skip connections. Those topological compositions are empirically effective and observed…

Cited by 11SourcePDFScholar
2022

Unified Implicit Neural Stylization

ECCV 2022poster

"Representing visual signals by implicit neural representation (INR) has prevailed among many vision tasks. Its potential for editing/processing given signals remains less explored. This work explores a new intriguing direction: training a stylized implicit representation, using a generalized approa…

2021

Neural Architecture Search on ImageNet in Four GPU Hours: A Theoretically Inspired Perspective

ICLR 2021poster

Neural Architecture Search (NAS) has been explosively studied to automate the discovery of top-performer neural networks. Current works require heavy training of supernet or intensive architecture evaluations, thus suffering from heavy resource consumption and often incurring search bias due to trun…

2021

Searching for Two-Stream Models in Multivariate Space for Video Recognition

ICCV 2021poster

Conventional video models rely on a single stream to capture the complex spatial-temporal features. Recent work on two-stream video models, such as SlowFast network and AssembleNet, prescribe separate streams to learn complementary features, and achieve stronger performance. However, manually design…

Cited by 11PDFScholar
2020

FasterSeg: Searching for Faster Real-time Semantic Segmentation

ICLR 2020poster

We present FasterSeg, an automatically designed semantic segmentation network with not only state-of-the-art performance but also faster speed than current methods. Utilizing neural architecture search (NAS), FasterSeg is discovered from a novel and broader search space integrating multi-resolution…

Cited by 255SourcecodeScholar
2020

NADS: Neural Architecture Distribution Search for Uncertainty Awareness

ICML 2020poster

Machine learning (ML) systems often encounter Out-of-Distribution (OoD) errors when dealing with testing data coming from a distribution different from training data. It becomes important for ML systems in critical applications to accurately quantify its predictive uncertainty and screen out these a…

Cited by 26SourcePDFScholar
2019

AutoGAN: Neural Architecture Search for Generative Adversarial Networks

ICCV 2019poster

Neural architecture search (NAS) has witnessed prevailing success in image classification and (very recently) segmentation tasks. In this paper, we present the first preliminary study on introducing the NAS algorithm to generative adversarial networks (GANs), dubbed AutoGAN. The marriage of NAS and…

Cited by 386PDFcodeScholar
2019

Conditional Adversarial Generative Flow for Controllable Image Synthesis

CVPR 2019poster

Flow-based generative models show great potential in image synthesis due to its reversible pipeline and exact log-likelihood target, yet it suffers from weak ability for conditional image synthesis, especially for multi-label or unaware conditions. This is because the potential distribution of image…

Cited by 58PDFScholar