← Search

Ye Yu

14 accepted papers

2026

Agent Primitives: Reuseable Latent Building Blocks for Multi-Agent Systems

ICML 2026poster

While existing multi-agent systems (MAS) can handle complex problems by enabling collaboration among multiple agents, they are often highly task-specific, relying on manually crafted agent roles and interaction prompts, which leads to increased architectural complexity and limited reusability across…

Cited by 0SourceScholar
2026

SIPDO: Closed-Loop Prompt Optimization via Synthetic Data Feedback

ICLR 2026poster

Prompt quality plays a critical role in the performance of large language models (LLMs), motivating a growing body of work on prompt optimization. Most existing methods optimize prompts over a fixed dataset, assuming static input distributions and offering limited support for iterative improvement.…

Cited by 0SourceScholar
2024

LMT-GP: Combined Latent Mean-Teacher and Gaussian Process for Semi-supervised Low-light Image Enhancement

ECCV 2024poster

"While recent low-light image enhancement (LLIE) methods have made significant advancements, they still face challenges in terms of low visual quality and weak generalization ability when applied to complex scenarios. To address these issues, we propose a semi-supervised method based on latent mean-…

2023

PivoTAL: Prior-Driven Supervision for Weakly-Supervised Temporal Action Localization

CVPR 2023poster

Weakly-supervised Temporal Action Localization (WTAL) attempts to localize the actions in untrimmed videos using only video-level supervision. Most recent works approach WTAL from a localization-by-classification perspective where these methods try to classify each video frame followed by a manually…

Cited by 42SourcePDFScholar
2023

ProTeGe: Untrimmed Pretraining for Video Temporal Grounding by Video Temporal Grounding

CVPR 2023poster

Video temporal grounding (VTG) is the task of localizing a given natural language text query in an arbitrarily long untrimmed video. While the task involves untrimmed videos, all existing VTG methods leverage features from video backbones pretrained on trimmed videos. This is largely due to the lack…

Cited by 15SourcePDFScholar
2023

Rule By Example: Harnessing Logical Rules for Explainable Hate Speech Detection

ACL 2023long

Classic approaches to content moderation typically apply a rule-based heuristic approach to flag content. While rules are easily customizable and intuitive for humans to interpret, they are inherently fragile and lack the flexibility or robustness needed to moderate the vast amount of undesirable co…

2022

BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation

ECCV 2022poster

"Video Object Segmentation (VOS) is fundamental to video understanding. Transformer-based methods show significant performance improvement on semi-supervised VOS. However, existing work faces challenges segmenting visually similar objects in close proximity of each other. In this paper, we propose a…

Cited by 31SourcePDFScholar
2022

GateHUB: Gated History Unit With Background Suppression for Online Action Detection

CVPR 2022poster

Online action detection is the task of predicting the action as soon as it happens in a streaming video. A major challenge is that the model does not have access to the future and has to solely rely on the history, i.e., the frames observed so far, to make predictions. It is therefore important to a…

Cited by 55PDFcodeScholar
2021

Revisiting Dynamic Convolution via Matrix Decomposition

ICLR 2021poster

Recent research in dynamic convolution shows substantial performance boost for efficient CNNs, due to the adaptive aggregation of K static convolution kernels. It has two limitations: (a) it increases the number of convolutional weights by K-times, and (b) the joint optimization of dynamic attention…

2021

Stronger NAS with Weaker Predictors

NeurIPS 2021poster

Neural Architecture Search (NAS) often trains and evaluates a large number of architectures. Recent predictor-based NAS approaches attempt to alleviate such heavy computation costs with two key steps: sampling some architecture-performance pairs and fitting a proxy accuracy predictor. Given limited…

2021

Unsupervised Few-Shot Action Recognition via Action-Appearance Aligned Meta-Adaptation

ICCV 2021poster

We present MetaUVFS as the first Unsupervised Meta-learning algorithm for Video Few-Shot action recognition. MetaUVFS leverages over 550K unlabeled videos to train a two-stream 2D and 3D CNN architecture via contrastive learning to capture the appearance-specific spatial and action-specific spatio-t…

Cited by 27PDFScholar
2020

Self-supervised Outdoor Scene Relighting

ECCV 2020poster

Outdoor scene relighting is a challenging problem that requires good understanding of the scene geometry, illumination and albedo. Current techniques are completely supervised, requiring high quality synthetic renderings to train a solution. Such renderings are synthesized using priors learned from…

Cited by 62SourcePDFScholar