← Search

Shanghua Gao

10 accepted papers

2025

Composable Interventions for Language Models

ICLR 2025poster

Test-time interventions for language models can enhance factual accuracy, mitigate harmful outputs, and improve model efficiency without costly retraining. But despite a flood of new methods, different types of interventions are largely developing independently. In practice, multiple interventions m…

2025

DQVis Dataset: Natural Language to Biomedical Visualization

NeurIPS 2025poster

Biomedical research data portals are essential resources for scientific inquiry, and interactive exploratory visualizations are an integral component for querying such data repositories. Increasingly, machine learning is being integrated into visualization systems to create natural language interfac…

Cited by 0SourcecodeScholar
2025

KGARevion: An AI Agent for Knowledge-Intensive Biomedical QA

ICLR 2025poster

Biomedical reasoning integrates structured, codified knowledge with tacit, experience-driven insights. Depending on the context, quantity, and nature of available evidence, researchers and clinicians use diverse strategies, including rule-based, prototype-based, and case-based reasoning. Effective m…

Cited by 0SourcePDFScholar
2025

Multimodal Medical Code Tokenizer

ICML 2025poster

Foundation models trained on patient electronic health records (EHRs) require tokenizing medical data into sequences of discrete vocabulary items. Existing tokenizers treat medical codes from EHRs as isolated textual tokens. However, each medical code is defined by its textual description, its posit…

Cited by 4SourcePDFScholar
2025

Representation Entanglement for Generation: Training Diffusion Transformers Is Much Easier Than You Think

NeurIPS 2025oral

REPA and its variants effectively mitigate training challenges in diffusion models by incorporating external visual representations from pretrained models, through alignment between the noisy hidden projections of denoising networks and foundational clean image representations. We argue that the ext…

Cited by 0SourcecodeScholar
2024

Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation

CVPR 2024poster

Chain-of-Thought (CoT) guides large language models (LLMs) to reason step-by-step and can motivate their logical reasoning ability. While effective for logical tasks CoT is not conducive to creative problem-solving which often requires out-of-box thoughts and is crucial for innovation advancements.…

2024

UniTS: A Unified Multi-Task Time Series Model

NeurIPS 2024poster

Although pre-trained transformers and reprogrammed text-based LLMs have shown strong performance on time series tasks, the best-performing architectures vary widely across tasks, with most models narrowly focused on specific areas, such as time series forecasting. Unifying predictive and generative…

2023

Masked Diffusion Transformer is a Strong Image Synthesizer

ICCV 2023poster

Despite its success in image synthesis, we observe that diffusion probabilistic models (DPMs) often lack contextual reasoning ability to learn the relations among object parts in an image, leading to a slow learning process. To solve this issue, we propose a Masked Diffusion Transformer (MDT) that i…

Cited by 130PDFcodeScholar
2020

Split to Be Slim: An Overlooked Redundancy in Vanilla Convolution

IJCAI 2020poster

Many effective solutions have been proposed to reduce the redundancy of models for inference acceleration. Nevertheless, common approaches mostly focus on eliminating less important filters or constructing efficient operations, while ignoring the pattern redundancy in feature maps. We reveal that ma…

2019

Optimizing the F-Measure for Threshold-Free Salient Object Detection

ICCV 2019poster

Current CNN-based solutions to salient object detection (SOD) mainly rely on the optimization of cross-entropy loss (CELoss). Then the quality of detected saliency maps is often evaluated in terms of F-measure. In this paper, we investigate an interesting issue: can we consistently use the F-measure…

Cited by 90PDFScholar