← Search

Soo Kyung Kim

7 accepted papers

2026

A More Word-like Image Tokenization for MLLMs

CVPR 2026

Modern multimodal large language models (MLLMs) typically keep the language model fixed and train a visual projector that maps the pixels into a sequence of tokens in its embedding space, so that images can be presented in essentially the same form as text. However, the language model has been optim

Cited by 0SourcecodeScholar
2026

QUATRO: Query-Adaptive Trust Region Policy Optimization for LLM Fine-tuning

ICML 2026poster

GRPO-style reinforcement learning (RL)-based LLM fine-tuning algorithms have recently gained popularity. Relying on heuristic trust-region approximations, however, they can lead to brittle optimization behavior, as global importance-ratio clipping and group-wise normalization fail to regulate sample…

Cited by 0SourceScholar
2026

Sparsity-promoting Fine-tuning for Equivariant Materials Foundation Model

ICLR 2026poster

Pre-trained materials foundation models, or machine learning interatomic potentials, leverage general physicochemical knowledge to effectively approximate potential energy surfaces. However, they often require domain-specific calibration due to physicochemical diversity and mismatches between practi…

Cited by 0SourceScholar
2025

GOODLIAR: A Reinforcement Learning-Based Deceptive Agent for Disrupting LLM Beliefs on Foundational Principles

ACL 2025finding

Large Language Models (LLMs) often succumb to adversarial prompts, a phenomenon popularly known as “jailbreaking.” While jailbreaking primarily targets short-term noncompliance with predefined policies, we argue that a deeper vulnerability lies in altering an LLM’s fundamental axiomatic beliefs, suc…

2025

PatientSim: A Persona-Driven Simulator for Realistic Doctor-Patient Interactions

NeurIPS 2025spotlight

Doctor-patient consultations require multi-turn, context-aware communication tailored to diverse patient personas. Training or evaluating doctor LLMs in such settings requires realistic patient interaction systems. However, existing simulators often fail to reflect the full range of personas seen in…

Cited by 0SourcecodeScholar
2023

Towards Physically Reliable Molecular Representation Learning

UAI 2023poster

Estimating the energetic properties of molecular systems is a critical task in material design. Machine learning has shown remarkable promise on this task over classical force fields, but a fully data-driven approach suffers from limited labeled data; not just the amount of available data lacks, but…

Cited by 2SourcePDFScholar
2021

Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradients

ICLR 2021oral

Discovering the underlying mathematical expressions describing a dataset is a core challenge for artificial intelligence. This is the problem of $\textit{symbolic regression}$. Despite recent advances in training neural networks to solve complex tasks, deep learning approaches to symbolic regression…