← Search

Shaokai Ye

9 accepted papers

2026

LLaVAction: evaluating and training multi-modal large language models for action understanding

ICLR 2026poster

Understanding human behavior requires measuring behavioral actions. Due to its complexity, behavior is best mapped onto a rich, semantic structure such as language. Emerging multimodal large language models (MLLMs) are promising candidates, but their fine-grained action understanding ability has not…

Cited by 0SourcecodeScholar
2023

AmadeusGPT: a natural language interface for interactive animal behavioral analysis

NeurIPS 2023poster

The process of quantifying and analyzing animal behavior involves translating the naturally occurring descriptive language of their actions into machine-readable code. Yet, codifying behavior analysis is often challenging without deep understanding of animal behavior and technical machine learning k…

2022

Enhance the Visual Representation via Discrete Adversarial Training

NeurIPS 2022accept

Adversarial Training (AT), which is commonly accepted as one of the most effective approaches defending against adversarial examples, can largely harm the standard performance, thus has limited usefulness on industrial-scale production and applications. Surprisingly, this phenomenon is totally oppos…

2021

Adversarial Laser Beam: Effective Physical-World Attack to DNNs in a Blink

CVPR 2021poster

Though it is well known that the performance of deep neural networks (DNNs) degrades under certain light conditions, there exists no study on the threats of light beams emitted from some physical source as adversarial attacker on DNNs in a real-world scenario. In this work, we show by simply using a…

Cited by 173PDFcodeScholar
2021

QAIR: Practical Query-Efficient Black-Box Attacks for Image Retrieval

CVPR 2021poster

We study the query-based attack against image retrieval to evaluate its robustness against adversarial examples under the black-box setting, where the adversary only has query access to the top-k ranked unlabeled images from the database. Compared with query attacks in image classification, which pr…

Cited by 64PDFcodeScholar
2020

Light-weight Calibrator: A Separable Component for Unsupervised Domain Adaptation

CVPR 2020poster

Existing domain adaptation methods aim at learning features that can be generalized among domains. These methods commonly require to update source classifier to adapt to the target domain and do not properly handle the trade-off between the source domain and the target domain. In this work, instead…

Cited by 36PDFcodeScholar
2019

Adversarial Robustness vs. Model Compression, or Both?

ICCV 2019poster

It is well known that deep neural networks (DNNs) are vulnerable to adversarial attacks, which are implemented by adding crafted perturbations onto benign examples. Min-max robust optimization based adversarial training can provide a notion of security against adversarial attacks. However, adversari…

Cited by 181PDFcodeScholar
2018

A Systematic DNN Weight Pruning Framework using Alternating Direction Method of Multipliers

ECCV 2018poster

Weight pruning methods for deep neural networks (DNNs) have been investigated recently, but prior work in this area is mainly heuristic, iterative pruning, thereby lacking guarantees on the weight reduction ratio and convergence time. To mitigate these limitations, we present a systematic weight pru…