← Search

Haotian Xue

8 accepted papers

2024

Diffusion Policy Attacker: Crafting Adversarial Attacks for Diffusion-based Policies

NeurIPS 2024poster

Diffusion models have emerged as a promising approach for behavior cloning (BC), leveraging their exceptional ability to model multi-modal distributions. Diffusion policies (DP) have elevated BC performance to new heights, demonstrating robust efficacy across diverse tasks, coupled with their inhere…

Cited by 6SourcePDFScholar
2024

QueST: Self-Supervised Skill Abstractions for Learning Continuous Control

NeurIPS 2024poster

Generalization capabilities, or rather a lack thereof, is one of the most important unsolved problems in the field of robot learning, and while several large scale efforts have set out to tackle this problem, unsolved it remains. In this paper, we hypothesize that learning temporal action abstractio…

2024

RefDrop: Controllable Consistency in Image or Video Generation via Reference Feature Guidance

NeurIPS 2024poster

There is a rapidly growing interest in controlling consistency across multiple generated images using diffusion models. Among various methods, recent works have found that simply manipulating attention modules by concatenating features from multiple reference images provides an efficient approach to…

Cited by 1SourcePDFScholar
2024

Toward effective protection against diffusion-based mimicry through score distillation

ICLR 2024poster

While generative diffusion models excel in producing high-quality images, they can also be misused to mimic authorized images, posing a significant threat to AI systems. Efforts have been made to add calibrated perturbations to protect images from diffusion-based mimicry pipelines. However, most of…

2023

3D-IntPhys: Towards More Generalized 3D-grounded Visual Intuitive Physics under Challenging Scenes

NeurIPS 2023poster

Given a visual scene, humans have strong intuitions about how a scene can evolve over time under given actions. The intuition, often termed visual intuitive physics, is a critical ability that allows us to make effective plans to manipulate the scene to achieve desired outcomes without relying on ex…

Cited by 8SourcePDFScholar
2023

Diffusion-Based Adversarial Sample Generation for Improved Stealthiness and Controllability

NeurIPS 2023poster

Neural networks are known to be susceptible to adversarial samples: small variations of natural examples crafted to deliberately mislead the models. While they can be easily generated using gradient-based techniques in digital and physical scenarios, they often differ greatly from the actual data di…

2022

Syntax-guided Localized Self-attention by Constituency Syntactic Distance

EMNLP 2022finding

Recent works have revealed that Transformers are implicitly learning the syntactic information in its lower layers from data, albeit is highly dependent on the quality and scale of the training data. However, learning syntactic information from data is not necessary if we can leverage an external sy…