← Search

Hyeonjeong Ha

9 accepted papers

2026

BEAT: Visual Backdoor Attacks on VLM-based Embodied Agents via Contrastive Trigger Learning

ICLR 2026poster

Recent advances in Vision-Language Models (VLMs) have propelled embodied agents by enabling direct perception, reasoning, and planning task-oriented actions from visual inputs. However, such vision-driven embodied agents open a new attack surface: visual backdoor attacks, where the agent behaves no…

Cited by 0SourcecodeScholar
2026

Constructive Distortion: Improving MLLMs with Attention-Guided Image Warping

ICLR 2026poster

Multimodal large language models (MLLMs) often miss small details and spatial relations in cluttered scenes, leading to errors in fine-grained perceptual grounding. We introduce AttWarp, a lightweight method that allocates more resolution to query-relevant content while compressing less informative…

Cited by 0SourceScholar
2026

Energy-Based Transformers are Scalable Learners and Thinkers

ICLR 2026oral

Inference-time computation, analogous to human System 2 Thinking, has recently become popular for improving model performance. However, most existing approaches suffer from several limitations: they are modality-specific (e.g., working only in text), problem-specific (e.g., verifiable domains like m…

Cited by 0SourcecodeScholar
2026

Perception-Aware Policy Optimization for Multimodal Reasoning

ICLR 2026poster

Reinforcement Learning with Verifiable Rewards (RLVR) has proven to be a highly effective strategy for empowering Large Language Models (LLMs) with long chain-of-thought reasoning abilities. However, its design and optimizations remain tailored to purely textual domains, resulting in suboptimal perf…

Cited by 0SourcecodeScholar
2025

PARTONOMY: Large Multimodal Models with Part-Level Visual Understanding

NeurIPS 2025spotlight

Real-world objects are composed of distinctive, object-specific parts. Identifying these parts is key to performing fine-grained, compositional reasoning—yet, large multimodal models (LMMs) struggle to perform this seemingly straightforward task. In this work, we introduce PARTONOMY, an LMM benchmar…

Cited by 0SourceScholar
2025

SYNTHIA: Novel Concept Design with Affordance Composition

ACL 2025long

Text-to-image (T2I) models enable rapid concept design, making them widely used in AI-driven design. While recent studies focus on generating semantic and stylistic variations of given design concepts, –the integration of multiple affordances into a single coherent concept–remains largely overlooked…

2023

Effective Targeted Attacks for Adversarial Self-Supervised Learning

NeurIPS 2023poster

Recently, unsupervised adversarial training (AT) has been highlighted as a means of achieving robustness in models without any label information. Previous studies in unsupervised AT have mostly focused on implementing self-supervised learning (SSL) frameworks, which maximize the instance-wise classi…

Cited by 4SourcePDFScholar
2023

Generalizable Lightweight Proxy for Robust NAS against Diverse Perturbations

NeurIPS 2023poster

Recent neural architecture search (NAS) frameworks have been successful in finding optimal architectures for given conditions (e.g., performance or latency). However, they search for optimal architectures in terms of their performance on clean images only, while robustness against various types of p…