← Search

Jun Sakuma

13 accepted papers

2026

Rewriting Pre-Training Data Boosts LLM Performance in Math and Code

ICLR 2026poster

The performance of large language models (LLMs) in program synthesis and mathematical reasoning is fundamentally limited by the quality of their pre-training corpora. We introduce two openly licensed pre-training datasets, released under the Llama 3.3 Community License, that significantly enhance…

Cited by 0SourcecodeScholar
2026

Toward Safer Diffusion Language Models: Discovery and Mitigation of Priming Vulnerability

ICLR 2026poster

Diffusion language models (DLMs) generate tokens in parallel through iterative denoising, which can reduce latency and enable bidirectional conditioning. However, the safety risks posed by jailbreak attacks that exploit this inference mechanism are not well understood. In this paper, we reveal that…

Cited by 0SourcecodeScholar
2025

Disrupting Model Merging: A Parameter-Level Defense Without Sacrificing Accuracy

ICCV 2025poster

Model merging is a technique that combines multiple finetuned models into a single model without additional training, allowing a free-rider to cheaply inherit specialized capabilities. This study investigates methodologies to suppress unwanted model merging by free-riders. Existing methods such as m…

2025

Harnessing the Power of Vicinity-Informed Analysis for Classification under Covariate Shift

AISTATS 2025poster

Transfer learning enhances prediction accuracy on a target distribution by leveraging data from a source distribution, demonstrating significant benefits in various applications. This paper introduces a novel dissimilarity measure that utilizes vicinity information, i.e., the local structure of data…

Cited by 0SourceScholar
2023

Statistically Significant Concept-based Explanation of Image Classifiers via Model Knockoffs

IJCAI 2023poster

A concept-based classifier can explain the decision process of a deep learning model by human understandable concepts in image classification problems. However, sometimes concept-based explanations may cause false positives, which misregards unrelated concepts as important for the prediction task. O…

Cited by 2SourcePDFScholar
2022

Max-Min Off-Policy Actor-Critic Method Focusing on Worst-Case Robustness to Model Misspecification

NeurIPS 2022accept

In the field of reinforcement learning, because of the high cost and risk of policy training in the real world, policies are trained in a simulation environment and transferred to the corresponding real-world environment. However, the simulation environment does not perfectly mimic the real-world en…

2022

Unsupervised Causal Binary Concepts Discovery with VAE for Black-Box Model Explanation

AAAI 2022technical

We aim to explain a black-box classifier with the form: "data X is classified as class Y because X has A, B and does not have C" in which A, B, and C are high-level concepts. The challenge is that we have to discover in an unsupervised manner a set of concepts, i.e., A, B and C, that is useful for e…

Cited by 10SourcePDFScholar
2021

AdvantageNAS: Efficient Neural Architecture Search with Credit Assignment

AAAI 2021technical

Neural architecture search (NAS) is an approach for automatically designing a neural network architecture without human effort or expert knowledge. However, the high computational cost of NAS limits its use in commercial applications. Two recent NAS paradigms, namely one-shot and sparse propagation,…