← Search

Hao Ni

8 accepted papers

2026

Experience Transfer for Multimodal LLM Agents in Minecraft Game

CVPR 2026

Multimodal LLM agents operating in complex game environments must continually reuse past experience to solve new tasks efficiently. In this work, we propose Echo, a transfer-oriented memory framework that enables agents to derive actionable knowledge from prior interactions rather than treating memo

Cited by 0SourceScholar
2024

High Rank Path Development: an approach to learning the filtration of stochastic processes

NeurIPS 2024poster

Since the weak convergence for stochastic processes does not account for the growth of information over time which is represented by the underlying filtration, a slightly erroneous stochastic model in weak topology may cause huge loss in multi-periods decision making problems. To address such discon…

2024

Minimally-Supervised Speech Synthesis with Conditional Diffusion Model and Language Model: A Comparative Study of Semantic Coding

ICASSP 2024accepted

Recently, there has been a growing interest in text-to-speech (TTS) methods that can be trained with minimal supervision by combining two types of discrete speech representations and using two sequence-to-sequence tasks to decouple TTS. However, existing methods suffer from three problems: the high-…

Cited by 0SourceScholar
2023

Deep Latent Regularity Network for Modeling Stochastic Partial Differential Equations

AAAI 2023technical

Stochastic partial differential equations (SPDEs) are crucial for modelling dynamics with randomness in many areas including economics, physics, and atmospheric sciences. Recently, using deep learning approaches to learn the PDE solution for accelerating PDE simulation becomes increasingly popular.…

Cited by 2SourcePDFScholar
2023

PCF-GAN: generating sequential data via the characteristic function of measures on the path space

NeurIPS 2023poster

Generating high-fidelity time series data using generative adversarial networks (GANs) remains a challenging task, as it is difficult to capture the temporal dependence of joint probability distributions induced by time-series data. Towards this goal, a key step is the development of an effective di…

2023

Part-Aware Transformer for Generalizable Person Re-identification

ICCV 2023poster

Domain generalization person re-identification (DG ReID) aims to train a model on source domains and generalize well on unseen domains. Vision Transformer usually yields better generalization ability than common CNN networks under distribution shifts. However, Transformer-based ReID models inevitabl…

Cited by 77PDFcodeScholar
2022

Meta Distribution Alignment for Generalizable Person Re-Identification

CVPR 2022poster

Domain Generalizable (DG) person ReID is a challenging task which trains a model on source domains yet generalizes well on target domains. Existing methods use source domains to learn domain-invariant features, and assume those features are also irrelevant with target domains. However, they do not c…

Cited by 80PDFcodeScholar