← Search

Harit Pandya

14 accepted papers

2024

ReCoRe: Regularized Contrastive Representation Learning of World Model

CVPR 2024poster

While recent model-free Reinforcement Learning (RL) methods have demonstrated human-level effectiveness in gaming environments their success in everyday tasks like visual navigation has been limited particularly under significant appearance variations. This limitation arises from (i) poor sample eff…

Cited by 10SourcePDFScholar
2022

CoMBiNED: Multi-Constrained Model Based Planning for Navigation in Dynamic Environments

IROS 2022poster

Recent deep reinforcement learning (DRL) approaches have achieved high success rate in map-less dynamic obstacle avoidance tasks. However, navigation in unseen dynamic scenarios without a pre-built map in the presence of dynamic obstacles still remains an open challenge. Since, learning accurate mod…

Cited by 0SourceScholar
2022

Push-to-See: Learning Non-Prehensile Manipulation to Enhance Instance Segmentation via Deep Q-Learning

ICRA 2022poster

Efficient robotic manipulation of objects for sorting and searching often rely upon how well the objects are perceived and the available grasp poses. The challenge arises when the objects are irregular, have similar visual features (e.g., textureless objects) and the scene is densely cluttered. In s…

Cited by 15SourceScholar
2021

RTVS: A Lightweight Differentiable MPC Framework for Real-Time Visual Servoing

IROS 2021poster

Recent data-driven approaches to visual servoing have shown improved performances over classical methods due to precise feature matching and depth estimation. Some recent servoing approaches use a model predictive control (MPC) framework which generalise well to novel environments and are capable of…

Cited by 6SourceScholar
2020

Action-Conditional Recurrent Kalman Networks For Forward and Inverse Dynamics Learning

CoRL 2020

Estimating accurate forward and inverse dynamics models is a crucial component of model-based control for sophisticated robots such as robots driven by hydraulics, artificial muscles, or robots dealing with different contact situations. Analytic models to such processes are often unavailable or inac

2020

DFVS: Deep Flow Guided Scene Agnostic Image Based Visual Servoing

ICRA 2020poster

Existing deep learning based visual servoing approaches regress the relative camera pose between a pair of images. Therefore, they require a huge amount of training data and sometimes fine-tuning for adaptation to a novel scene. Furthermore, current approaches do not consider underlying geometry of…

Cited by 23SourceScholar
2020

DeepMPCVS: Deep Model Predictive Control for Visual Servoing

CoRL 2020

The simplicity of the visual servoing approach makes it an attractive option for tasks dealing with vision-based control of robots in many real-world applications. However, attaining precise alignment for unseen environments pose a challenge to existing visual servoing approaches. While classical ap

2019

Recurrent Kalman Networks: Factorized Inference in High-Dimensional Deep Feature Spaces

ICML 2019oral

In order to integrate uncertainty estimates into deep time-series modelling, Kalman Filters (KFs) (Kalman et al., 1960) have been integrated with deep learning models, however, such approaches typically rely on approximate inference tech- niques such as variational inference which makes learning mor…

2018

Combining Method of Alternating Projections and Augmented Lagrangian for Task Constrained Trajectory Optimization

IROS 2018poster

Motion planning for manipulators under task space constraints is difficult as it constrains the joint configurations to always lie on an implicitly defined manifold. It is possible to view task constrained motion planning as an optimization problem with non-linear equality constraints, which can be…

Cited by 8SourceScholar
2017

Exploring convolutional networks for end-to-end visual servoing

ICRA 2017poster

Present image based visual servoing approaches rely on extracting hand crafted visual features from an image. Choosing the right set of features is important as it directly affects the performance of any approach. Motivated by recent breakthroughs in performance of data driven methods on recognition…

Cited by 104SourceScholar
2017

Pose induction for visual servoing to a novel object instance

IROS 2017poster

Present visual servoing approaches are instance specific i.e. they control camera motion between two views of the same object. However, in practical scenarios where a robot is required to handle various instances of a category, classical visual servoing techniques are less suitable. We formulate acr…

Cited by 9SourceScholar