← Search

Ameya Pore

6 accepted papers

2024

DEAR: Disentangled Environment and Agent Representations for Reinforcement Learning without Reconstruction

IROS 2024poster

Reinforcement Learning (RL) algorithms can learn robotic control tasks from visual observations, but they often require a large amount of data, especially when the visual scene is complex and unstructured. In this paper, we explore how the agent’s knowledge of its shape can improve the sample effici…

Cited by 1SourcecodeScholar
2023

Constrained Reinforcement Learning and Formal Verification for Safe Colonoscopy Navigation

IROS 2023poster

The field of robotic Flexible Endoscopes (FEs) has progressed significantly, offering a promising solution to reduce patient discomfort. However, the limited autonomy of most robotic FEs results in non-intuitive and challenging manoeuvres, constraining their application in clinical settings. While p…

Cited by 9SourceScholar
2022

Colonoscopy Navigation using End-to-End Deep Visuomotor Control: A User Study

IROS 2022poster

Flexible Endoscopes (FEs) for colonoscopy present several limitations due to their inherent complexity, resulting in patient discomfort and lack of intuitiveness for clinicians. Robotic FEs with autonomous control represent a viable solution to reduce the workload of endoscopists and the training ti…

Cited by 16SourcecodeScholar
2021

Safe Reinforcement Learning using Formal Verification for Tissue Retraction in Autonomous Robotic-Assisted Surgery

IROS 2021poster

Deep Reinforcement Learning (DRL) is a viable solution for automating repetitive surgical subtasks due to its ability to learn complex behaviours in a dynamic environment. This task automation could lead to reduced surgeon’s cognitive workload, increased precision in critical aspects of the surgery,…

Cited by 59SourcecodeScholar
2020

On Simple Reactive Neural Networks for Behaviour-Based Reinforcement Learning

ICRA 2020poster

We present a behaviour-based reinforcement learning approach, inspired by Brook's subsumption architecture, in which simple fully connected networks are trained as reactive behaviours. Our working assumption is that a pick and place robotic task can be simplified by leveraging domain knowledge of a…

Cited by 25SourcecodeScholar
2020

Soft Tissue Simulation Environment to Learn Manipulation Tasks in Autonomous Robotic Surgery

IROS 2020poster

Reinforcement Learning (RL) methods have demonstrated promising results for the automation of subtasks in surgical robotic systems. Since many trial and error attempts are required to learn the optimal control policy, RL agent training can be performed in simulation and the learned behavior can be t…

Cited by 65SourceScholar