← Search

Fuwen Tan

8 accepted papers

2025

Progressive Mixed-Precision Decoding for Efficient LLM Inference

ICLR 2025poster

In spite of the great potential of large language models (LLMs) across various tasks, their deployment on resource-constrained devices remains challenging due to their excessive computational and memory demands. Quantization has emerged as an effective solution by storing weights in reduced precisio…

Cited by 2SourcePDFScholar
2024

MobileQuant: Mobile-friendly Quantization for On-device Language Models

EMNLP 2024finding

Large language models (LLMs) have revolutionized language processing, delivering outstanding results across multiple applications. However, deploying LLMs on edge devices poses several challenges with respect to memory, energy, and compute costs, limiting their widespread use in devices such as mobi…

2023

Effective Self-supervised Pre-training on Low-compute Networks without Distillation

ICLR 2023poster

Despite the impressive progress of self-supervised learning (SSL), its applicability to low-compute networks has received limited attention. Reported performance has trailed behind standard supervised pre-training by a large margin, barring self-supervised learning from making an impact on models th…

2022

EdgeViTs: Competing Light-Weight CNNs on Mobile Devices with Vision Transformers

ECCV 2022poster

"Self-attention based models such as vision transformers (ViTs) have emerged as a very competitive architecture alternative to convolutional neural networks (CNNs) in computer vision. Despite increasingly stronger variants with ever-higher recognition accuracies, due to the quadratic complexity of s…

2021

Curriculum Labeling: Revisiting Pseudo-Labeling for Semi-Supervised Learning

AAAI 2021technical

In this paper we revisit the idea of pseudo-labeling in the context of semi-supervised learning where a learning algorithm has access to a small set of labeled samples and a large set of unlabeled samples. Pseudo-labeling works by applying pseudo-labels to samples in the unlabeled set by using a mod…

2019

Drill-down: Interactive Retrieval of Complex Scenes using Natural Language Queries

NeurIPS 2019poster

This paper explores the task of interactive image retrieval using natural language queries, where a user progressively provides input queries to refine a set of retrieval results. Moreover, our work explores this problem in the context of complex image scenes containing multiple objects. We propose…