← Search

Jie Peng

34 accepted papers

2026

(Be Cautious!) Bio-Foundation Models Are Not Yet Robust to Biologically Plausible Perturbations and ML Transformations

ICML 2026poster

Though biological foundation models (Bio-FMs) have delivered strong performance across biomedical tasks, their robustness to small-but-real perturbations is underexplored. In this work, we ask: Are Bio-FMs robust for real-world use? What perturbations compromise their reliability? Our pilot study su…

Cited by 0SourceScholar
2026

Bridging Language and Physics: Automated Design of Continuum Robots with Large Language Models

RSS 2026poster

Large language models (LLMs) have recently emerged as a promising tool for automating robot design from high-level specifications, yet they remain ineffective for robots operating under complex physical interactions. This limitation stems from the gap between language-based reasoning and the physica…

Cited by 0SourceScholar
2026

GDGB: A Benchmark for Generative Dynamic Text-Attributed Graph Learning

ICLR 2026poster

Dynamic Text-Attributed Graphs (DyTAGs), which intricately integrate structural, temporal, and textual attributes, are crucial for modeling complex real-world systems. However, most existing DyTAG datasets exhibit poor textual quality, which severely limits their utility for generative DyTAG tasks r…

Cited by 0SourcecodeScholar
2026

Graph-of-Agents: A Graph-based Framework for Multi-Agent LLM Collaboration

ICLR 2026poster

With an ever-growing zoo of LLMs and benchmarks, the need to orchestrate multiple models for improved task performance has never been more pressing. While frameworks like Mixture-of-Agents (MoA) attempt to coordinate LLMs, they often fall short in terms of (1) selecting relevant agents, (2) facilita…

Cited by 0SourceScholar
2026

Mind-Omni: A Unified Multi-Task Framework for Brain-Vision-Language Modeling via Discrete Diffusion

ICML 2026spotlight

Modeling the interplay between external stimuli and internal neural representations is a pivotal research area for Brain-Computer Interfaces (BCIs). A major limitation of prior work is the prevailing paradigm of specialized, single-task models, which curtails versatility and neglects inter-task syne…

Cited by 0SourceScholar
2026

Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models

CVPR 2026

The recent success of reinforcement learning (RL) in large reasoning models has inspired the growing adoption of RL for post-training Multimodal Large Language Models (MLLMs) to enhance their visual reasoning capabilities. Although many studies have reported improved performance, it remains unclear

Cited by 0SourceScholar
2026

Vulnerability-Aware Robust Multimodal Adversarial Training

AAAI 2026technical

Multimodal learning has shown significant superiority on various tasks by integrating multiple modalities. However, the interdependencies among modalities increase the susceptibility of multimodal models to adversarial attacks. Existing methods mainly focus on attacks on specific modalities or indis

Cited by 0SourcePDFScholar
2025

$\texttt{I$^2$MoE}$: Interpretable Multimodal Interaction-aware Mixture-of-Experts

ICML 2025poster

Modality fusion is a cornerstone of multimodal learning, enabling information integration from diverse data sources. However, existing approaches are limited by $\textbf{(a)}$ their focus on modality correspondences, which neglects heterogeneous interactions between modalities, and $\textbf{(b)}$ th…

2025

CAFE-AD: Cross-Scenario Adaptive Feature Enhancement for Trajectory Planning in Autonomous Driving

ICRA 2025

Imitation learning based planning tasks on the nuPlan dataset have gained great interest due to their potential to generate human-like driving behaviors. However, open-loop training on the nuPlan dataset tends to cause causal confusion during closed-loop testing, and the dataset also presents a long

Cited by 2SourcecodeScholar
2025

Circumventing Backdoor Space via Weight Symmetry

ICML 2025poster

Deep neural networks are vulnerable to backdoor attacks, where malicious behaviors are implanted during training. While existing defenses can effectively purify compromised models, they typically require labeled data or specific training procedures, making them difficult to apply beyond supervised l…

2025

EmoGrowth: Incremental Multi-label Emotion Decoding with Augmented Emotional Relation Graph

ICML 2025poster

Emotion recognition systems face significant challenges in real-world applications, where novel emotion categories continually emerge and multiple emotions often co-occur. This paper introduces multi-label fine-grained class incremental emotion decoding, which aims to develop models capable of incre…

2025

GRNFormer: A Biologically-Guided Framework for Integrating Gene Regulatory Networks into RNA Foundation Models

ACL 2025finding

Foundation models for single-cell RNA sequencing (scRNA-seq) have shown promising capabilities in capturing gene expression patterns. However, current approaches face critical limitations: they ignore biological prior knowledge encoded in gene regulatory relationships and fail to leverage multi-omic…

Cited by 0SourcePDFScholar
2025

Glider: Global and Local Instruction-Driven Expert Router

EMNLP 2025

The development of performant pre-trained models has driven the advancement of routing-based expert models tailored to specific tasks. However, these methods often favor generalization over performance on held-in tasks. This limitation adversely impacts practical applicability, as real-world deploym

2025

Layer-Level Self-Exposure and Patch: Affirmative Token Mitigation for Jailbreak Attack Defense

NAACL 2025long

As large language models (LLMs) are increasingly deployed in diverse applications, including chatbot assistants and code generation, aligning their behavior with safety and ethical standards has become paramount. However, jailbreak attacks, which exploit vulnerabilities to elicit unintended or harmf…

2025

Modalities Contribute Unequally: Enhancing Medical Multi-modal Learning through Adaptive Modality Token Re-balancing

ICML 2025poster

Medical multi-modal learning requires an effective fusion capability of various heterogeneous modalities. One vital challenge is how to effectively fuse modalities when their data quality varies across different modalities and patients. For example, in the TCGA benchmark, the performance of the same…

Cited by 0SourcePDFScholar
2025

Mozart: Modularized and Efficient MoE Training on 3.5D Wafer-Scale Chiplet Architectures

NeurIPS 2025spotlight

Mixture-of-Experts (MoE) architecture offers enhanced efficiency for Large Language Models (LLMs) with modularized computation, yet its inherent sparsity poses significant hardware deployment challenges, including memory locality issues, communication overhead, and inefficient computing resource uti…

Cited by 0SourceScholar
2025

NaviDiffuser: Tackling Multi-Objective Robot Navigation by Weight Range Guided Diffusion Model

IROS 2025

The data-driven paradigm has shown great potential in solving many decision-making tasks. In the robot navigation realm, it also sparked a new trend. People believe powerful data-driven methods can learn efficient and general navigation policies from a vast offline dataset. However, robot navigation

Cited by 0SourceScholar
2025

Occult: Optimizing Collaborative Communications across Experts for Accelerated Parallel MoE Training and Inference

ICML 2025poster

Mixture-of-experts (MoE) architectures could achieve impressive computational efficiency with expert parallelism, which relies heavily on all-to-all communication across devices. Unfortunately, such communication overhead typically constitutes a significant portion of the total runtime, hampering th…

Cited by 0SourcePDFScholar
2025

TGB-Seq Benchmark: Challenging Temporal GNNs with Complex Sequential Dynamics

ICLR 2025poster

Future link prediction is a fundamental challenge in various real-world dynamic systems. To address this, numerous temporal graph neural networks (temporal GNNs) and benchmark datasets have been developed. However, these datasets often feature excessive repeated edges and lack complex sequential dyn…

2025

Tuning-Free Accountable Intervention for LLM Deployment – a Metacognitive Approach

AAAI 2025technical

Large Language Models (LLMs) have brought significant advances across various NLP tasks through few-shot or zero-shot prompting, bypassing the need for parameter tuning. However, the "black-box" nature behind their massive parameter sizes increases the "hallucination" concerns, especially in high-st…

2025

UQ-Merge: Uncertainty Guided Multimodal Large Language Model Merging

ACL 2025finding

Multimodal Large Language Models (MLLMs) have gained increasing popularity as a promising framework for leveraging the strong language reasoning capabilities in the vision-language domain. Given a wide range of MLLMs, model merging potentially offers a cheap way to aggregate their diverse knowledge…

2024

Enhancing Distributional Stability among Sub-populations

AISTATS 2024poster

Enhancing the stability of machine learning algorithms under distributional shifts is at the heart of the Out-of-Distribution (OOD) Generalization problem. Derived from causal learning, recent works of invariant learning pursue strict invariance with multiple training environments. Although intuitiv…

2024

Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts

NeurIPS 2024spotlight

Multimodal learning has gained increasing importance across various fields, offering the ability to integrate data from diverse sources such as images, text, and personalized records, which are frequently observed in medical domains. However, in scenarios where some modalities are missing, many exis…

2024

LDP: A Local Diffusion Planner for Efficient Robot Navigation and Collision Avoidance

IROS 2024poster

The conditional diffusion model has been demonstrated as an efficient tool for learning robot policies, owing to its advancement to accurately model the conditional distribution of policies. The intricate nature of real-world scenarios, characterized by dynamic obstacles and maze-like structures, un…

Cited by 13SourceScholar
2024

Mean Aggregator Is More Robust than Robust Aggregators under Label Poisoning Attacks

IJCAI 2024poster

Robustness to malicious attacks is of paramount importance for distributed learning. Existing works often consider the classical Byzantine attacks model, which assumes that some workers can send arbitrarily malicious messages to the server and disturb the aggregation steps of the distributed learnin…

2024

Mew: Multiplexed Immunofluorescence Image Analysis through an Efficient Multiplex Network

ECCV 2024poster

"Recent advancements in graph-based approaches for multiplexed immunofluorescence (mIF) images have significantly propelled the field forward, offering deeper insights into patient-level phenotyping. However, current graph-based methodologies encounter two primary challenges: 172 Cellular Heterogene…

2024

PathRL: An End-to-End Path Generation Method for Collision Avoidance via Deep Reinforcement Learning

ICRA 2024poster

Robot navigation using deep reinforcement learning (DRL) has shown great potential in improving the performance of mobile robots. Nevertheless, most existing DRL-based navigation methods primarily focus on training a policy that directly commands the robot with low-level controls, like linear and an…

Cited by 8SourceScholar
2024

Profiling Power Consumption in Low-Speed Autonomous Guided Vehicles

RA-L 2024

The increasing demand for automation has led to a rise in the use of low-speed Autonomous guided vehicles (AGVs). However, AGVs rely on batteries for their power source, which limits their operational time and affects their overall performance. To optimize their energy usage and enhance their batter

Cited by 7SourceScholar
2023

Reinforcement Learning for Robot Navigation with Adaptive Forward Simulation Time (AFST) in a Semi-Markov Model

IROS 2023poster

Deep reinforcement learning (DRL) algorithms have proven effective in robot navigation, especially in unknown environments, by directly mapping perception inputs into robot control commands. However, most existing methods ignore the local minimum problem in navigation and thereby cannot handle compl…

Cited by 0SourcecodeScholar
2022

PFilter: Building Persistent Maps through Feature Filtering for Fast and Accurate LiDAR-based SLAM

IROS 2022poster

Simultaneous localization and mapping (SLAM) based on laser sensors has been widely adopted by mobile robots and autonomous vehicles. These SLAM systems are required to support accurate localization with limited computational resources. In particular, point cloud registration, i.e., the process of m…

Cited by 21SourceScholar
2022

Variance Reduction-Boosted Byzantine Robustness in Decentralized Stochastic Optimization

ICASSP 2022accepted

We consider the Byzantine-robust decentralized stochastic optimization problem, where every agent periodically communicates with its neighbors to exchange the local models, and then updates its own local model by stochastic gradient descent. However, an unknown number of the agents are Byzantine, an…

Cited by 0SourceScholar
2021

Towards an Online RRT-based Path Planning Algorithm for Ackermann-steering Vehicles

ICRA 2021poster

It is challenging to develop an online path planning algorithm for Ackermann-steering vehicles to find collision-free and kinematically-feasible paths, that is efficient for dense environments, adaptable to various environments, and suitable for environments with narrow passages. In this paper, we p…

Cited by 10SourcecodeScholar