← Search

Marco Caccamo

8 accepted papers

2024

Equivariant Ensembles and Regularization for Reinforcement Learning in Map-based Path Planning

IROS 2024

In reinforcement learning (RL), exploiting environmental symmetries can significantly enhance efficiency, robustness, and performance. However, ensuring that the deep RL policy and value networks are respectively equivariant and invariant to exploit these symmetries is a substantial challenge. Relat

Cited by 4SourcecodeScholar
2024

Physics-Regulated Deep Reinforcement Learning: Invariant Embeddings

ICLR 2024spotlight

This paper proposes the Phy-DRL: a physics-regulated deep reinforcement learning (DRL) framework for safety-critical autonomous systems. The Phy-DRL has three distinguished invariant-embedding designs: i) residual action policy (i.e., integrating data-driven-DRL action policy and physics-model-based…

2024

RaceMOP: Mapless Online Path Planning for Multi-Agent Autonomous Racing using Residual Policy Learning

IROS 2024poster

The interactive decision-making in multi-agent autonomous racing offers insights valuable beyond the domain of self-driving cars. Mapless online path planning is particularly of practical appeal but poses a challenge for safely overtaking opponents due to the limited planning horizon. To address thi…

Cited by 5SourcecodeScholar
2023

Flexible Gear Assembly with Visual Servoing and Force Feedback

IROS 2023poster

This paper presents a vision-guided two-stage approach with force feedback to achieve high-precision and flexible gear assembly. The proposed approach integrates YOLO to coarsely localize the target workpiece in a searching phase and deep reinforcement learning (DRL) to complete the insertion. Speci…

Cited by 5SourceScholar
2023

Towards Safe AI: Sandboxing DNNs-Based Controllers in Stochastic Games

AAAI 2023technical

Nowadays, AI-based techniques, such as deep neural networks (DNNs), are widely deployed in autonomous systems for complex mission requirements (e.g., motion planning in robotics). However, DNNs-based controllers are typically very complex, and it is very hard to formally verify their correctness, po…

2022

Cloud-Edge Training Architecture for Sim-to-Real Deep Reinforcement Learning

IROS 2022poster

Deep reinforcement learning (DRL) is a promising approach to solve complex control tasks by learning policies through interactions with the environment. However, the training of DRL policies requires large amounts of training experiences, making it impractical to learn the policy directly on physica…

Cited by 8SourceScholar
2020

UAV Coverage Path Planning under Varying Power Constraints using Deep Reinforcement Learning

IROS 2020poster

Coverage path planning (CPP) is the task of designing a trajectory that enables a mobile agent to travel over every point of an area of interest. We propose a new method to control an unmanned aerial vehicle (UAV) carrying a camera on a CPP mission with random start positions and multiple options fo…

Cited by 129SourcecodeScholar
2019

Trajectory Estimation for Geo-Fencing Applications on Small-Size Fixed-Wing UAVs

IROS 2019poster

The steadily increasing popularity of Unmanned Aerial Vehicles (UAVs) is creating new opportunities in diverse fields of technology and business. However, this increase of popularity also raises safety concerns. To tackle the primary concern of keeping the UAV inside a designated region, a novel tra…

Cited by 4SourceScholar