← Search

Dong Qian

2 accepted papers

2025

WyckoffDiff -- A Generative Diffusion Model for Crystal Symmetry

ICML 2025poster

Crystalline materials often exhibit a high level of symmetry. However, most generative models do not account for symmetry, but rather model each atom without any constraints on its position or element. We propose a generative model, Wyckoff Diffusion (WyckoffDiff), which generates symmetry-based des…

2024

Fast Randomized Low-Rank Adaptation of Pre-trained Language Models with PAC Regularization

ACL 2024findings

Low-rank adaptation (LoRA) achieves parameter efficient fine-tuning for large language models (LLMs) by decomposing the model weight update into a pair of low-rank projection matrices. Yet, the memory overhead restricts it to scale up when the model size increases. We propose Randomized LoRA (RLoRA)…

Cited by 0SourcePDFScholar