← Search

Shenghao Yang

10 accepted papers

2026

CATCH: A Controllable Theme Detection Framework with Contextualized Clustering and Hierarchical Generation

AAAI 2026technical

Theme detection is a fundamental task in user-centric dialogue systems, aiming to identify the latent topic of each utterance without relying on predefined schemas. Unlike intent induction, which operates within fixed label spaces, theme detection requires cross-dialogue consistency and alignment wi

Cited by 0SourcePDFScholar
2026

PRISM: Distribution-free Adaptive Computation of Matrix Functions for Accelerating Neural Network Training

ICML 2026poster

Matrix functions such as square root, inverse roots, and orthogonalization play a central role in preconditioned gradient methods for neural network training. This has motivated the development of iterative algorithms that avoid explicit eigendecompositions and rely primarily on matrix multiplicatio…

Cited by 0SourceScholar
2025

Know You First and Be You Better: Modeling Human-Like User Simulators via Implicit Profiles

ACL 2025long

User simulators are crucial for replicating human interactions with dialogue systems, supporting both collaborative training and automatic evaluation, especially for large language models (LLMs). However, current role-playing methods face challenges such as a lack of utterance-level authenticity and…

2025

Positional Attention: Expressivity and Learnability of Algorithmic Computation

ICML 2025poster

There is a growing interest in the ability of neural networks to execute algorithmic tasks (e.g., arithmetic, summary statistics, and sorting). The goal of this work is to better understand the role of attention in Transformers for algorithmic execution. Its importance for algorithmic execution has…

2024

Polynomial Width is Sufficient for Set Representation with High-dimensional Features

ICLR 2024poster

Set representation has become ubiquitous in deep learning for modeling the inductive bias of neural networks that are insensitive to the input order. DeepSets is the most widely used neural network architecture for set representation. It involves embedding each set element into a latent space with d…

Cited by 6SourcePDFScholar
2023

Equivariant Hypergraph Diffusion Neural Operators

ICLR 2023poster

Hypergraph neural networks (HNNs) using neural networks to encode hypergraphs provide a promising way to model higher-order relations in data and further solve relevant prediction tasks built upon such higher-order relations. However, higher-order relations in practice contain complex patterns and a…

2023

Weighted Flow Diffusion for Local Graph Clustering with Node Attributes: an Algorithm and Statistical Guarantees

ICML 2023oral

Local graph clustering methods aim to detect small clusters in very large graphs without the need to process the whole graph. They are fundamental and scalable tools for a wide range of tasks such as local community detection, node ranking and node embedding. While prior work on local graph clusteri…