← Search

Runsheng Wang

14 accepted papers

2026

Attention Sink Forges Native MoE in Attention Layers: Sink-Aware Training to Address Head Collapse

ICML 2026poster

Large Language Models (LLMs) often assign disproportionate attention to the first token, a phenomenon known as the attention sink. Several recent approaches aim to address this issue, including Sink Attention in GPT-OSS and Gated Attention in Qwen3-Next. However, a comprehensive analysis of the rela…

Cited by 0SourceScholar
2026

CircuitNet 3.0: A Multi-Modal Dataset with Task-Oriented Augmentation for AI-Driven Circuit Design

ICLR 2026poster

Integrated circuit (IC) designs require transforming high-level specifications into physical layouts, demanding extensive expertise and specialized tools, as well as months of time and numerous iterations. While Machine Learning (ML) has shown promise in various research domains, the lack of large-s…

Cited by 0SourcecodeScholar
2026

FusionCell: Cross-Attentive Fusion of Layout Geometry and Netlist Topology for Standard-Cell Performance Prediction

ICML 2026poster

Standard cells form the building blocks of digital circuits, so their delay and power critically influence chip-level performance; yet characterization (can be understood as evaluation of cell delay and power) still relies on slow simulation sweeps, and many fast predictors ignore layout geometry, m…

Cited by 0SourceScholar
2025

ChatEMG: Synthetic Data Generation to Control a Robotic Hand Orthosis for Stroke

RA-L 2025

Intent inferral on a hand orthosis for stroke patients is challenging due to the difficulty of data collection. Additionally, EMG signals exhibit significant variations across different conditions, sessions, and subjects, making it hard for classifiers to generalize. Traditional approaches require a

Cited by 7SourceScholar
2025

DeepLayout: Learning Neural Representations of Circuit Placement Layout

ICML 2025poster

Recent advancements have integrated various deep-learning methodologies into physical design, aiming for workflows acceleration and surpasses human-devised solutions. However, prior research has primarily concentrated on developing task-specific networks, which necessitate a significant investment o…

Cited by 0SourcePDFScholar
2025

MPCache: MPC-Friendly KV Cache Eviction for Efficient Private LLM Inference

NeurIPS 2025poster

Private large language model (LLM) inference based on secure multi-party computation (MPC) achieves formal data privacy protection but suffers from significant latency overhead, especially for long input sequences. While key-value (KV) cache eviction and sparse attention algorithms have been propose…

Cited by 0SourceScholar
2024

An Investigation of Multi-feature Extraction and Super-resolution with Fast Microphone Arrays

ICRA 2024poster

In this work, we use MEMS microphones as vibration sensors to simultaneously classify texture and estimate contact position and velocity. Vibration sensors are an important facet of both human and robotic tactile sensing, providing fast detection of contact and onset of slip. Microphones are an attr…

Cited by 4SourceScholar
2024

CircuitNet 2.0: An Advanced Dataset for Promoting Machine Learning Innovations in Realistic Chip Design Environment

ICLR 2024poster

Integrated circuits or chips are key to enable computing in modern industry. Designing a chip relies on human experts to produce chip data through professional electronic design automation (EDA) software and complicated procedures. Nowadays, prompted by the wide variety of machine learning (ML) data…

Cited by 15SourcePDFScholar
2024

Cross-modal Generation and Alignment via Attribute-guided Prompt for Unsupervised Text-based Person Retrieval

IJCAI 2024poster

Text-based Person Search aims to retrieve a specified person using a given text query. Current methods predominantly rely on paired labeled image-text data to train the cross-modality retrieval model, necessitating laborious and time-consuming labeling. In response to this challenge, we present the…

Cited by 1SourcePDFScholar
2024

PrivCirNet: Efficient Private Inference via Block Circulant Transformation

NeurIPS 2024poster

Homomorphic encryption (HE)-based deep neural network (DNN) inference protects data and model privacy but suffers from significant computation overhead. We observe transforming the DNN weights into circulant matrices converts general matrix-vector multiplications into HE-friendly 1-dimensional convo…

2024

Uncertainty-Guided Person Search Model with Auxiliary Shallow Feature Exploration

ICASSP 2024accepted

Person search is a unified system aimed at jointly localizing and identifying a person of interest from a gallery of whole scene images. Due to the inherent properties of the person search, it faces significant challenges of large-scale variations, inaccurate detection boxes, and crowded scenes. To…

Cited by 0SourceScholar
2023

CoPriv: Network/Protocol Co-Optimization for Communication-Efficient Private Inference

NeurIPS 2023poster

Deep neural network (DNN) inference based on secure 2-party computation (2PC) can offer cryptographically-secure privacy protection but suffers from orders of magnitude latency overhead due to enormous communication. Previous works heavily rely on a proxy metric of ReLU counts to approximate the com…

Cited by 6SourcePDFScholar
2023

Controllable Clothoid Path Generation for Autonomous Vehicles

RA-L 2023

This letter proposes a novel and simple smooth path generation algorithm for autonomous vehicles. The proposed method can rapidly generate feasible and curvature continuous paths connecting any two given states with null curvature. The generated path comprises straight lines, circular arcs and cloth

Cited by 7SourceScholar
2023

MPCViT: Searching for Accurate and Efficient MPC-Friendly Vision Transformer with Heterogeneous Attention

ICCV 2023poster

Secure multi-party computation (MPC) enables computation directly on encrypted data and protects both data and model privacy in deep learning inference. However, existing neural network architectures, including Vision Transformers (ViTs), are not designed or optimized for MPC and incur significant l…

Cited by 23PDFcodeScholar