← Search

Jinhe Bi

14 accepted papers

2026

ASCD: Attention-Steerable Contrastive Decoding for Reducing Hallucination in MLLM

AAAI 2026technical

Multimodal large language models (MLLMs) frequently hallucinate by over-committing to spurious visual cues. Prior remedies–Visual and Instruction Contrastive Decoding (VCD, ICD)–mitigate this issue, yet the mechanism remains opaque. We first empirically show that their improvements systematically co

Cited by 41SourcePDFScholar
2026

Beyond Magic Words: Sharpness-Aware Prompt Evolving for Robust Large Language Models with TARE

ICLR 2026poster

The performance of Large Language Models (LLMs) hinges on carefully engineered prompts. However, prevailing prompt optimization methods, ranging from heuristic edits and reinforcement learning to evolutionary search, primarily target point-wise accuracy. They seldom enforce paraphrase invariance or…

Cited by 0SourceScholar
2026

DAWN: Distributed LLM Multi-Agent Workflow Synthesis

AAAI 2026technical

Large language models (LLMs) have recently empowered multi-agent systems (MAS) to achieve remarkable advances in collaborative reasoning and complex task automation. The effectiveness of these systems fundamentally depends on the design of adaptive communication graphs—the underlying workflows that

Cited by 0SourcePDFScholar
2026

EchoRL: Reinforcement Learning via Rollout Echoing

ICML 2026poster

Reinforcement Learning with Verifiable Rewards is an effective route for post-training to strengthen the reasoning capability of large language models. However, as training proceeds, the learning signal can collapse thus makes the training gain become marginal and ineffective. Specifically, a growin…

Cited by 0SourceScholar
2026

KORE: Enhancing Knowledge Injection for Large Multimodal Models via Knowledge-Oriented Controls

ICML 2026poster

Large Multimodal Models encode extensive factual knowledge in their pre-trained weights. However, its knowledge remains static and limited, unable to keep pace with real-world developments, which hinders continuous knowledge acquisition. Effective knowledge injection thus becomes critical, involving…

Cited by 0SourceScholar
2026

PsyPARSE: Retrieval-Augmented Slow Thinking for Personalized Empathetic Counseling

AAAI 2026technical

The escalating global demand for mental health services highlights the potential of Large Language Models (LLMs) in psychological counseling. However, current LLM-based approaches, particularly fine-tuned models, are constrained by data distribution biases, leading to limited therapeutic diversity a

Cited by 0SourcePDFScholar
2026

The Geometry of Reasoning: Self-Evaluation via Layerwise Trajectory Evolution

ICML 2026poster

Large Reasoning Models (LRMs) enhance performance by generating explicit Chain-of-Thought (CoT) trajectories, yet enabling them to self-evaluate correctness without external supervision remains a critical challenge. Existing methods often rely on ground-truth labels or shallow output probabilities, …

Cited by 0SourceScholar
2025

Backdoor Cleaning without External Guidance in MLLM Fine-tuning

NeurIPS 2025poster

Multimodal Large Language Models (MLLMs) are increasingly deployed in fine-tuning-as-a-service (FTaaS) settings, where user-submitted datasets adapt general-purpose models to downstream tasks. This flexibility, however, introduces serious security risks, as malicious fine-tuning can implant backdoor…

Cited by 0SourcecodeScholar
2025

FedBiP: Heterogeneous One-Shot Federated Learning with Personalized Latent Diffusion Models

CVPR 2025poster

One-Shot Federated Learning (OSFL), a special decentralized machine learning paradigm, has recently gained significant attention. OSFL requires only a single round of client data or model upload, which reduces communication costs and mitigates privacy threats compared to traditional FL. Despite thes…

2025

HYPERION: Fine-Grained Hypersphere Alignment for Robust Federated Graph Learning

NeurIPS 2025spotlight

Robust Federated Graph Learning (FGL) provides an effective decentralized framework for training Graph Neural Networks (GNNs) in noisy-label environments. However, the subtlety of noise during training presents formidable obstacles for developing robust FGL systems. Previous robust FL approaches nei…

Cited by 0SourceScholar
2025

LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering

ACL 2025long

Multimodal Large Language Models (MLLMs) enhance visual tasks by integrating visual representations into large language models (LLMs). The textual modality, inherited from LLMs, enables instruction following and in-context learning, while the visual modality boosts downstream task performance throug…