← Search

Zhengsu Chen

5 accepted papers

2026

Learn from Your Mistakes: Tree-like Self-Play on Vulnerability Nodes for Secure Code LLMs

ICML 2026poster

While Large Language Models (LLMs) excel in code generation, they remain prone to replicating subtle yet critical vulnerabilities endemic to their training data. Current alignment techniques, such as Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL), typically apply coarse-grained optimiz…

Cited by 0SourceScholar
2024

QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Models

ICLR 2024poster

Recently years have witnessed a rapid development of large language models (LLMs). Despite the strong ability in many language-understanding tasks, the heavy computational burden largely restricts the application of LLMs especially when one needs to deploy them onto edge devices. In this paper, we p…

2021

Visformer: The Vision-Friendly Transformer

ICCV 2021poster

The past year has witnessed the rapid development of applying the Transformer module to vision problems. While some researchers have demonstrated that Transformer-based models enjoy a favorable ability of fitting data, there are still growing number of evidences showing that these models suffer over…

Cited by 274PDFcodeScholar
2020

Network Adjustment: Channel Search Guided by FLOPs Utilization Ratio

CVPR 2020poster

Automatic designing computationally efficient neural networks has received much attention in recent years. Existing approaches either utilize network pruning or leverage the network architecture search methods. This paper presents a new framework named network adjustment, which considers network acc…

Cited by 15PDFcodeScholar
2020

SelectScale: Mining More Patterns from Images via Selective and Soft Dropout

IJCAI 2020poster

Convolutional neural networks (CNNs) have achieved remarkable success in image recognition. Although the internal patterns of the input images are effectively learned by the CNNs, these patterns only constitute a small proportion of useful patterns contained in the input images. This can be attribut…

Cited by 0SourcePDFScholar