← Search

Sung-Ju Lee

11 accepted papers

2026

Beyond Hearing: Learning Task-agnostic ExG Representations from Earphones via Physiology-informed Tokenization

ICLR 2026poster

Electrophysiological (ExG) signals offer valuable insights into human physiology, yet building foundation models that generalize across everyday tasks remains challenging due to two key limitations: (i) insufficient data diversity, as most ExG recordings are collected in controlled labs with bulky,…

Cited by 0SourceScholar
2025

QuRe: Query-Relevant Retrieval through Hard Negative Sampling in Composed Image Retrieval

ICML 2025poster

Composed Image Retrieval (CIR) retrieves relevant images based on a reference image and accompanying text describing desired modifications. However, existing CIR methods only focus on retrieving the target image and disregard the relevance of other images. This limitation arises because most methods…

2025

SNAP: Low-Latency Test-Time Adaptation with Sparse Updates

NeurIPS 2025poster

Test-Time Adaptation (TTA) adjusts models using unlabeled test data to handle dynamic distribution shifts. However, existing methods rely on frequent adaptation and high computational cost, making them unsuitable for resource-constrained edge environments. To address this, we propose SNAP, a sparse…

Cited by 0SourcecodeScholar
2025

SoundCollage: Automated Discovery of New Classes in Audio Datasets

ICASSP 2025accepted

Developing new machine learning applications often requires the collection of new datasets. However, existing datasets may already contain relevant information to train models for new purposes. We propose SoundCollage: a framework to discover new classes within audio datasets by incorporating (1) an…

Cited by 0SourceScholar
2025

Test-Time Adaptation with Binary Feedback

ICML 2025poster

Deep learning models perform poorly when domain shifts exist between training and test data. Test-time adaptation (TTA) is a paradigm to mitigate this issue by adapting pre-trained models using only unlabeled test samples. However, existing TTA methods can fail under severe domain shifts, while rece…

2024

(FL)$^2$: Overcoming Few Labels in Federated Semi-Supervised Learning

NeurIPS 2024poster

Federated Learning (FL) is a distributed machine learning framework that trains accurate global models while preserving clients' privacy-sensitive data. However, most FL approaches assume that clients possess labeled data, which is often not the case in practice. Federated Semi-Supervised Learning (…

2024

AETTA: Label-Free Accuracy Estimation for Test-Time Adaptation

CVPR 2024poster

Test-time adaptation (TTA) has emerged as a viable solution to adapt pre-trained models to domain shifts using unlabeled test data. However TTA faces challenges of adaptation failures due to its reliance on blind adaptation to unknown test samples in dynamic scenarios. Traditional methods for out-of…

2024

By My Eyes: Grounding Multimodal Large Language Models with Sensor Data via Visual Prompting

EMNLP 2024main

Large language models (LLMs) have demonstrated exceptional abilities across various domains. However, utilizing LLMs for ubiquitous sensing applications remains challenging as existing text-prompt methods show significant performance degradation when handling long sensor data sequences. In this pape…

2023

FedTherapist: Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning

EMNLP 2023short main

Psychiatrists diagnose mental disorders via the linguistic use of patients. Still, due to data privacy, existing passive mental health monitoring systems use alternative features such as activity, app usage, and location via mobile devices. We propose FedTherapist, a mobile mental health monitoring…

Cited by 0SourceScholar
2023

SoTTA: Robust Test-Time Adaptation on Noisy Data Streams

NeurIPS 2023poster

Test-time adaptation (TTA) aims to address distributional shifts between training and testing data using only unlabeled test data streams for continual model adaptation. However, most TTA methods assume benign test streams, while test samples could be unexpectedly diverse in the wild. For instance,…

2022

NOTE: Robust Continual Test-time Adaptation Against Temporal Correlation

NeurIPS 2022accept

Test-time adaptation (TTA) is an emerging paradigm that addresses distributional shifts between training and testing phases without additional data acquisition or labeling cost; only unlabeled test data streams are used for continual model adaptation. Previous TTA schemes assume that the test sample…