← Search

Pengkai Zhu

6 accepted papers

2024

DEED: Dynamic Early Exit on Decoder for Accelerating Encoder-Decoder Transformer Models

NAACL 2024findings

Encoder-decoder transformer models have achieved great success on various vision-language (VL) and language tasks, but they suffer from high inference latency. Typically, the decoder takes up most of the latency because of the auto-regressive decoding. To accelerate the inference, we propose an appr…

2024

Enhancing Vision-Language Pre-training with Rich Supervisions

CVPR 2024highlight

We propose Strongly Supervised pre-training with ScreenShots (S4) - a novel pre-training paradigm for Vision-Language Models using data from large-scale web screenshot rendering. Using web screenshots unlocks a treasure trove of visual and textual cues that are not present in using image-text pairs.…

Cited by 10SourcePDFScholar
2019

Cost aware Inference for IoT Devices

AISTATS 2019poster

Networked embedded devices (IoTs) of limited CPU, memory and power resources are revolutionizing data gathering, remote monitoring and planning in many consumer and business applications. Nevertheless, resource limitations place a significant burden on their service life and operation, warranting co…

Cited by 15SourcePDFScholar
2019

Learning Classifiers for Target Domain with Limited or No Labels

ICML 2019oral

In computer vision applications, such as domain adaptation (DA), few shot learning (FSL) and zero-shot learning (ZSL), we encounter new objects and environments, for which insufficient examples exist to allow for training “models from scratch,” and methods that adapt existing models, trained on the…

Cited by 15SourcePDFScholar