← Search

Haiyin Piao

9 accepted papers

2025

Transformer-Based Multi-Agent Reinforcement Learning Method With Credit-Oriented Strategy Differentiation

IROS 2025

The problem of Multi-Agent Reinforcement Learning (MARL) shows a high level of both complexity in the environment and coordination between agents. In order to scale the algorithm to large-scale agent scenarios, neural networks designed for MARL are typically implemented with parameter sharing. These

Cited by 0SourcecodeScholar
2024

Deep Ad-hoc Sub-Team Partition Learning for Multi-Agent Air Combat Cooperation

IROS 2024poster

In the future, unmanned autonomous air combat will encounter large-scale confrontation scenarios, where agents must consider complex time-varying relationships among aircraft when making decisions. Previous works have already introduced Multi-Agent Reinforcement Learning (MARL) into air combat and s…

Cited by 2SourceScholar
2024

Event-intensity Stereo with Cross-modal Fusion and Contrast

IROS 2024poster

For binocular stereo, traditional cameras excel in capturing fine details and texture information but are limited in terms of dynamic range and their ability to handle rapid motion. On the contrary, event cameras provide pixel-level intensity changes with low latency and a wide dynamic range, albeit…

Cited by 0SourceScholar
2024

OVD-Explorer: Optimism Should Not Be the Sole Pursuit of Exploration in Noisy Environments

AAAI 2024technical

In reinforcement learning, the optimism in the face of uncertainty (OFU) is a mainstream principle for directing exploration towards less explored areas, characterized by higher uncertainty. However, in the presence of environmental stochasticity (noise), purely optimistic exploration may lead to ex…

2024

Phasic Diversity Optimization for Population-Based Reinforcement Learning

ICRA 2024poster

Reviewing the previous work of diversity Reinforcement Learning, diversity is often obtained via an augmented loss function, which requires a balance between reward and diversity. Generally, diversity optimization algorithms use Multi-armed Bandits algorithms to select the coefficient in the pre-def…

Cited by 0SourceScholar
2023

The Sufficiency of Off-Policyness and Soft Clipping: PPO Is Still Insufficient according to an Off-Policy Measure

AAAI 2023technical

The popular Proximal Policy Optimization (PPO) algorithm approximates the solution in a clipped policy space. Does there exist better policies outside of this space? By using a novel surrogate objective that employs the sigmoid function (which provides an interesting way of exploration), we found th…

2022

Distributional Reward Estimation for Effective Multi-agent Deep Reinforcement Learning

NeurIPS 2022accept

Multi-agent reinforcement learning has drawn increasing attention in practice, e.g., robotics and automatic driving, as it can explore optimal policies using samples generated by interacting with the environment. However, high reward uncertainty still remains a problem when we want to train a satisf…

2021

A Vision-based Irregular Obstacle Avoidance Framework via Deep Reinforcement Learning

IROS 2021poster

Deep reinforcement learning has achieved great success in laser-based collision avoidance work because the laser can sense accurate depth information without too much redundant data, which can maintain the robustness of the algorithm when it is migrated from the simulation environment to the real wo…

Cited by 20SourceScholar
2021

Coordinated Proximal Policy Optimization

NeurIPS 2021poster

We present Coordinated Proximal Policy Optimization (CoPPO), an algorithm that extends the original Proximal Policy Optimization (PPO) to the multi-agent setting. The key idea lies in the coordinated adaptation of step size during the policy update process among multiple agents. We prove the monoton…