← Search

Zheng Tang

11 accepted papers

2026

ToMoE: Converting Dense Large Language Models to Mixture-of-Experts through Dynamic Structural Pruning

ICML 2026poster

Large Language Models (LLMs) demonstrate remarkable capabilities but face deployment challenges due to their high computational demands. Traditional pruning methods reduce these costs by permanently removing parameters, which inevitably leads to performance degradation. To mitigate this issue, we pr…

Cited by 0SourcecodeScholar
2024

AlpaGasus: Training a Better Alpaca with Fewer Data

ICLR 2024poster

Large language models~(LLMs) strengthen instruction-following capability through instruction-finetuning (IFT) on supervised instruction/response data. However, widely used IFT datasets (e.g., Alpaca's 52k data) surprisingly contain many low-quality instances with incorrect or irrelevant responses, w…

2024

Backdooring Instruction-Tuned Large Language Models with Virtual Prompt Injection

NAACL 2024long

Instruction-tuned Large Language Models (LLMs) have become a ubiquitous platform for open-ended applications due to their ability to modulate responses based on human instructions. The widespread use of LLMs holds significant potential for shaping public perception, yet also risks being maliciously…

2024

DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models

NeurIPS 2024poster

Large Language Models (LLMs) have achieved remarkable success in various natural language processing tasks, including language modeling, understanding, and generation. However, the increased memory and computational costs associated with these models pose significant challenges for deployment on res…

2024

Instruction-following Evaluation through Verbalizer Manipulation

NAACL 2024findings

While instruction-tuned models have shown remarkable success in various natural language processing tasks, accurately evaluating their ability to follow instructions remains challenging. Existing benchmarks primarily focus on common instructions that align well with what the model learned during tra…

2024

UAV First-Person Viewers Are Radiance Field Learners

ECCV 2024poster

"First-Person-View (FPV) holds immense potential for revolutionizing the trajectory of Unmanned Aerial Vehicles (UAVs), offering an exhilarating avenue for navigating complex building structures. Yet, traditional Neural Radiance Field (NeRF) methods face challenges such as sampling single points per…

Cited by 0SourcePDFScholar
2021

How May I Help You? Using Neural Text Simplification to Improve Downstream NLP Tasks

EMNLP 2021finding

The general goal of text simplification (TS) is to reduce text complexity for human consumption. In this paper, we investigate another potential use of neural TS: assisting machines performing natural language processing (NLP) tasks. We evaluate the use of neural TS in two ways: simplifying input te…

2019

CityFlow: A City-Scale Benchmark for Multi-Target Multi-Camera Vehicle Tracking and Re-Identification

CVPR 2019oral

Urban traffic optimization using traffic cameras as sensors is driving the need to advance state-of-the-art multi-target multi-camera (MTMC) tracking. This work introduces CityFlow, a city-scale traffic camera dataset consisting of more than 3 hours of synchronized HD videos from 40 cameras across 1…

Cited by 511PDFcodeScholar
2019

PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data

ICCV 2019poster

In comparison with person re-identification (ReID), which has been widely studied in the research community, vehicle ReID has received less attention. Vehicle ReID is challenging due to 1) high intra-class variability (caused by the dependency of shape and appearance on viewpoint), and 2) small inte…

Cited by 147PDFcodeScholar
2016

Multiple-kernel adaptive segmentation and tracking (MAST) for robust object tracking

ICASSP 2016accepted

In a video surveillance system with static cameras, object segmentation often fails when part of the object has similar color with the background, resulting in poor performance of the subsequent object tracking. Multiple kernels have been utilized in object tracking to deal with occlusion, but the p…

Cited by 0SourceScholar