← Search

Xiaotian Hao

12 accepted papers

2024

Designing Biological Sequences without Prior Knowledge Using Evolutionary Reinforcement Learning

AAAI 2024technical

Designing novel biological sequences with desired properties is a significant challenge in biological science because of the extra large search space. The traditional design process usually involves multiple rounds of costly wet lab evaluations. To reduce the need for expensive wet lab experiments,…

2024

Hybrid CtrlFormer: Learning Adaptive Search Space Partition for Hybrid Action Control via Transformer-based Monte Carlo Tree Search

UAI 2024poster

Hybrid action control tasks are common in the real world, which require controlling some discrete and continuous actions simultaneously. To solve these tasks, existing Deep Reinforcement learning (DRL) methods either directly build a separate policy for each type of action or simplify the hybrid act…

2024

Multiagent Gumbel MuZero: Efficient Planning in Combinatorial Action Spaces

AAAI 2024technical

AlphaZero and MuZero have achieved state-of-the-art (SOTA) performance in a wide range of domains, including board games and robotics, with discrete and continuous action spaces. However, to obtain an improved policy, they often require an excessively large number of simulations, especially for doma…

2024

PORTAL: Automatic Curricula Generation for Multiagent Reinforcement Learning

AAAI 2024technical

Despite many breakthroughs in recent years, it is still hard for MultiAgent Reinforcement Learning (MARL) algorithms to directly solve complex tasks in MultiAgent Systems (MASs) from scratch. In this work, we study how to use Automatic Curriculum Learning (ACL) to reduce the number of environmental…

Cited by 8SourcePDFScholar
2024

Unlock the Intermittent Control Ability of Model Free Reinforcement Learning

NeurIPS 2024poster

Intermittent control problems are common in real world. The interactions between the decision maker and the executor can be discontinuous (intermittent) due to various types of interruptions, e.g. unstable communication channel. Due to intermittent interaction, agents are unable to acquire the state…

Cited by 0SourcePDFScholar
2023

Boosting Multiagent Reinforcement Learning via Permutation Invariant and Permutation Equivariant Networks

ICLR 2023poster

The state space in Multiagent Reinforcement Learning (MARL) grows exponentially with the agent number. Such a curse of dimensionality results in poor scalability and low sample efficiency, inhibiting MARL for decades. To break this curse, we propose a unified agent permutation framework that exploit…

Cited by 30SourcePDFScholar
2022

PMIC: Improving Multi-Agent Reinforcement Learning with Progressive Mutual Information Collaboration

ICML 2022spotlight

Learning to collaborate is critical in Multi-Agent Reinforcement Learning (MARL). Previous works promote collaboration by maximizing the correlation of agents’ behaviors, which is typically characterized by Mutual Information (MI) in different forms. However, we reveal sub-optimal collaborative beha…

2022

Transformer-based Working Memory for Multiagent Reinforcement Learning with Action Parsing

NeurIPS 2022accept

Learning in real-world multiagent tasks is challenging due to the usual partial observability of each agent. Previous efforts alleviate the partial observability by historical hidden states with Recurrent Neural Networks, however, they do not consider the multiagent characters that either the multia…

Cited by 20SourcePDFScholar
2021

A Hierarchical Reinforcement Learning Based Optimization Framework for Large-scale Dynamic Pickup and Delivery Problems

NeurIPS 2021poster

The Dynamic Pickup and Delivery Problem (DPDP) is an essential problem in the logistics domain, which is NP-hard. The objective is to dynamically schedule vehicles among multiple sites to serve the online generated orders such that the overall transportation cost could be minimized. The critical cha…

Cited by 87SourcePDFScholar
2020

Action Semantics Network: Considering the Effects of Actions in Multiagent Systems

ICLR 2020poster

In multiagent systems (MASs), each agent makes individual decisions but all of them contribute globally to the system evolution. Learning in MASs is difficult since each agent's selection of actions must take place in the presence of other co-learning agents. Moreover, the environmental stochasticit…

Cited by 48SourcecodeScholar
2020

Dynamic Knapsack Optimization Towards Efficient Multi-Channel Sequential Advertising

ICML 2020poster

In E-commerce, advertising is essential for merchants to reach their target users. The typical objective is to maximize the advertiser’s cumulative revenue over a period of time under a budget constraint. In real applications, an advertisement (ad) usually needs to be exposed to the same user multip…

Cited by 29SourcePDFScholar
2020

Learning to Accelerate Heuristic Searching for Large-Scale Maximum Weighted b-Matching Problems in Online Advertising

IJCAI 2020poster

Bipartite b-matching is fundamental in algorithm design, and has been widely applied into diverse applications, such as economic markets, labor markets, etc. These practical problems usually exhibit two distinct features: large-scale and dynamic, which requires the matching algorithm to be repeatedl…

Cited by 0SourcePDFScholar