← Search

Zhengyue Zhao

5 accepted papers

2026

ARMOR: Aligning Secure and Safe Large Language Models via Meticulous Reasoning

ICLR 2026poster

Large Language Models have shown impressive generative capabilities across diverse tasks, but their safety remains a critical concern. Existing post-training alignment methods, such as SFT and RLHF, reduce harmful outputs yet leave LLMs vulnerable to jailbreak attacks, especially advanced optimizati…

Cited by 8SourceScholar
2026

Safety Alignment of Large Language Models via Contrasting Safe and Harmful Distributions

AAAI 2026technical

With the widespread application of Large Language Models (LLMs), it has become a significant concern to ensure their safety and prevent harmful responses. While current safe-alignment methods based on instruction fine-tuning and Reinforcement Learning from Human Feedback (RLHF) can effectively reduc

Cited by 0SourcePDFScholar
2025

Can Watermarks be Used to Detect LLM IP Infringement For Free?

ICLR 2025poster

The powerful capabilities of LLMs stem from their rich training data and high-quality labeled datasets, making the training of strong LLMs a resource-intensive process, which elevates the importance of IP protection for such LLMs. Compared to gathering high-quality labeled data, directly sampling ou…

Cited by 1SourcePDFScholar
2024

Automated CPU Design by Learning from Input-Output Examples

IJCAI 2024poster

Designing a central processing unit (CPU) requires intensive manual work of talented experts to implement the circuit logic from design specifications. Although considerable progress has been made in electronic design automation (EDA) to relieve human efforts, all existing EDA tools require hand-cra…

Cited by 0SourcePDFScholar
2024

Can Protective Perturbation Safeguard Personal Data from Being Exploited by Stable Diffusion?

CVPR 2024poster

Stable Diffusion has established itself as a foundation model in generative AI artistic applications receiving widespread research and application. Some recent fine-tuning methods have made it feasible for individuals to implant personalized concepts onto the basic Stable Diffusion model with minima…