82 accepted papers
Vision-Language-Action (VLA) models have demonstrated significant potential in real-world robotic manipulation. However, pre-trained VLA policies still suffer from substantial performance degradation during downstream deployment. Although fine-tuning can mitigate this issue, its reliance on costly d
Recent work has demonstrated the potential of diffusion models in robot bimanual skill learning. However, existing methods ignore the learning of posture-dependent task features, which are crucial for adapting dual-arm configurations to meet specific force and velocity requirements in dexterous bima
Industrial exoskeletons are a potential solution for reducing work-related musculoskeletal disorders during carrying or lifting tasks. Having sensors, electrical/pneumatic actuators, and control systems, active exoskeletons present a more versatile control system because it is possible to select dif…
This letter presents the prototype of a human-sized, untethered athletic hopping and balancing underactuated monopedal robot designed to withstand crash landings. Experimental results in 2D of the robot balancing on an unstable contact point, hopping vertically, landing back, and balancing within a
This letter presents a controller for robots that balance in a vertical plane on a rolling contact on a flat horizontal surface. It is an extension of Featherstone's balance controller to the case of robots that balance on rounded feet or wheels. Simulation results demonstrate the ability of the new
We propose a control pipeline for SAG (Searching, Approaching, and Grasping) of objects, based on a decoupled arm kinematic chain and impedance control, which integrates image-based visual servoing (IBVS). The kinematic decoupling allows for fast end-effector motions and recovery that leads to robus…
Quadruped robots are machines intended for challenging and harsh environments. Despite the progress in locomotion strategy, safely recovering from unexpected falls or planned drops is still an open problem. It is further made more difficult when high horizontal velocities are involved. In this lette
Quadrupedal manipulators require to be compliant when dealing with external forces during autonomous manipulation, tele-operation or physical human-robot interaction. This paper presents a whole-body controller that allows for the implementation of a Cartesian impedance control to coordinate trackin…
Studies on back-support exoskeletons focus mostly on the evaluation of single devices. Also, these studies suggest that passive exoskeletons might be preferred when performing static tasks, whereas active ones, could show their advantage in dynamic tasks. To verify this hypothesis and provide a comp
In industrial environments, the control of arm assistive exoskeletons presents significant challenges due to complex dynamic movements. We propose a high-level controller for the Shoulder-sideWINDER that assists dynamic arm movement during a variety of tasks, based on mechanical characteristics of a
Occupational back-support exoskeletons see their potential application in many industrial sectors to mitigate low back pain risk for workers performing demanding tasks. This work aims to design and evaluate a control strategy that improves the efficacy of an active exoskeleton by exploiting the raw
Nowadays, robotic research focuses more and more on attaining energy-efficient and safe solutions. They are key-aspects of industrial robots, such as inspection and maintenance robots. The introduction of a mechanism that passively compensates the joint torque caused by the weight of the robot may o
Humans in contrast to robots are excellent in performing fine manipulation tasks owing to their remarkable dexterity and sensorimotor organization. Enabling robots to acquire such capabilities, necessitates a framework that not only replicates the human behaviour but also integrates the multi-sensor…
In recent years, a myriad of advanced results have been reported in the community of imitation learning, ranging from parametric to non-parametric, probabilistic to non-probabilistic and Bayesian to frequentist approaches. Meanwhile, ample applications (e.g., grasping tasks and humanrobot collaborat…
Hybrid legged-wheeled robots such as the CEN-TAURO, are capable of varying their footprint polygon to carry out various agile motions. This property can be advantageous for wheeled-only planning in cluttered spaces, which is our focus. In this paper, we present an improved algorithm that builds upon…
The ability of legged systems to traverse highly- constrained environments depends by and large on the performance of their motion and balance controllers. This paper presents a controller that excels in a scenario that most state- of-the-art balance controllers have not yet addressed: line walking,…
We present a novel control strategy for dynamic legged locomotion in complex scenarios that considers information about the morphology of the terrain in contexts when only on-board mapping and computation are available. The strategy is built on top of two main elements: first a contact sequence task…
Cable-driven joints proved to be an effective solution in a wide variety of applications ranging from medical to industrial fields where light structures, interaction with unstructured and constrained environments and precise motion are required. These requirements are achieved by moving the actuato…
Peripheral intravenous catheterization (PIVC) is pervasively needed in hospitals. However, given the levels of precision and controllability needed for PIVC, this operation suffers from very low success rates. For young patients, about half of the first insertions fail. Robotic systems have great po
Legged robots can outperform wheeled machines for most navigation tasks across unknown and rough terrains. For such tasks, visual feedback is a fundamental asset to provide robots with terrain awareness. However, robust dynamic locomotion on difficult terrains with real-time performance guarantees r
In the context of imitation learning, several approaches have been developed so as to transfer human skills to robots, with demonstrations often represented in Cartesian or joint space. While learning Cartesian positions suffices for many applications, the end-effector orientation is required in man…
A common strategy to deal with the expensive reinforcement learning (RL) of complex tasks is to decompose them into a collection of subtasks that are usually simpler to learn as well as reusable for new problems. However, when a robot learns the policies for these subtasks, common approaches treat e…
Unstructured environments impose several challenges when robots are required to perform different tasks and adapt to unseen situations. In this context, a relevant problem arises: how can robots learn to perform various tasks and adapt to different conditions? A potential solution is to endow robots…
On the quest for building autonomous robots, several robot learning frameworks with different functionalities have recently been developed. Yet, frameworks that combine diverse learning paradigms (such as imitation and reinforcement learning) into a common place are scarce. Existing ones tend to be
During the past few years, probabilistic approaches to imitation learning have earned a relevant place in the robotics literature. One of their most prominent features is that, in addition to extracting a mean trajectory from task demonstrations, they provide a variance estimation. The intuitive mea…
Hybrid legged-wheeled robots are able to adapt their leg configuration and height to vary their footprint polygons and go over obstacles or traverse narrow spaces. In this paper, we present a variable configuration wheeled motion planner based on the A* algorithm. It takes advantage of the agility o…
A torque-controlled back-support exoskeleton to assist manual handling is presented. Its objective is to provide a significant portion of the forces necessary to carry out the physical task, thereby reducing the compressive loads on the lumbar spine and the associated risk of injury. The design rati
Motivated by the desire to have robots physically present in human environments, in recent years we have witnessed an emergence of different approaches for learning active compliance. Some of the most compelling solutions exploit a minimal intervention control principle, correcting deviations from a…
Motion planning in multicontact scenarios has recently gathered interest within the legged robotics community, however actuator force/torque limits are rarely considered. We believe that these limits gain paramount importance when the complexity of the terrains to be traversed increases. We build on
One of the critical aspects in the design of an assistive wearable robot is the energy efficiency of the actuation system, since it significantly affects the weight and consequently the comfort of the system. Several strategies have been used in previous research, mostly based on energy harvesting,
Robotics teleoperation has been extensively studied and considered in the past in several task scenarios where direct human intervention is not possible due to the hazardous environments. In such applications, both communication degradation and reduced perception of the remote environment are practi…
Bipedal robots have gained a lot of locomotion capabilities the past few years, especially in the control level. Navigation over complex and unstructured environments using exteroceptive perception, is still an active research topic. In this paper, we present a footstep planning system to produce fo…
Programming by demonstration has recently gained much attention due to its user-friendly and natural way to transfer human skills to robots. In order to facilitate the learning of multiple demonstrations and meanwhile generalize to new situations, a task-parameterized Gaussian mixture model (TP-GMM)…
In the context of learning from demonstration, human examples are usually imitated in either Cartesian or joint space. However, this treatment might result in undesired movement trajectories in either space. This is particularly important for motion skills such as striking, which typically imposes m…
In this work we introduced a prioritized Cartesian impedance control under the framework of the Quadratic Programming (QP) optimization. In particular, we present a formulation which is simpler than full inverse dynamics, avoids any matrix pseudo-inversion, inverse kinematics computation and conside…
This paper proposes a novel fall control technique based on energy concepts, which can be applied online to mitigate the impact forces incurred during the falling over of humanoids. The technique reduces the total energy using a nonlinear control tool, called energy shaping (ES), and further distrib…
When learning skills from demonstrations, one is often required to think in advance about the appropriate task representation (usually in either operational or configuration space). We here propose a probabilistic approach for simultaneously learning and synthesizing torque control commands which ta…
Traditional motion planning approaches for multilegged locomotion divide the problem into several stages, such as contact search and trajectory generation. However, reasoning about contacts and motions simultaneously is crucial for the generation of complex whole-body behaviors. Currently, coupling
As many imitation learning algorithms focus on pure trajectory generation in either Cartesian space or joint space, the problem of considering competing trajectory constraints from both spaces still presents several challenges. In particular, when perturbations are applied to the robot, the underlyi…
We present a new method to translate videos to commands for robotic manipulation using Deep Recurrent Neural Networks (RNN). Our framework first extracts deep features from the input video frames with a deep Convolutional Neural Networks (CNN). Two RNN layers with an encoder-decoder architecture are…
In this letter, we propose a novel method that enables the robot to autonomously devise an appropriate control strategy from human demonstrations without a prior knowledge of the demonstrated task. The method is primarily based on observing the patterns and consistency in the observed dataset. This
Despite the growing focus on the design of compliant mechanisms for robotics actuators that manifest several advantages in terms of robustness and interaction-related characteristics, the incorporation of elasticity in the actuation drive renders under-damped vibration modes and reduces the bandwidt…
In imitation learning, multivariate Gaussians are widely used to encode robot behaviors. Such approaches do not provide the ability to properly represent end-effector orientation, as the distance metric in the space of orientations is not Euclidean. In this paper, we present an extension of common i
Posture body variation is one of the ways in which humans skillfully and naturally augment their motion and strength capabilities along specific task-space directions in order to successfully perform complex manipulation tasks. Posture variation also has a significant role in robot manipulation, whe…
In the context of robotic control, synergies can form elementary units of behavior. By specifying task-dependent coordination behaviors at a low control level, one can achieve task-specific disturbance rejection. In this work we present an approach to learn the parameters of such low-level controlle…
We present a new method to detect object affordances in real-world scenes using deep Convolutional Neural Networks (CNN), an object detector and dense Conditional Random Fields (CRF). Our system first trains an object detector to generate bounding box candidates from the images. A deep CNN is then u…
Series-elastic actuators are quickly becoming the core component of robots operating in real-world environments, allowing for robust, safe, torque-controlled robots. This letter investigates the influence of the selected stiffness and control parameters. By consolidating several analyses, it is show
The identification of inertial parameters is crucial to achieve high-performance model-based control of legged robots. The inertial parameters of the legs are typically not altered during expeditions and therefore are best identified offline. On the other hand, the trunk parameters depend on the mod…
Reliable state estimation is crucial for stable planning and control of legged locomotion. A fundamental component of a state estimator in legged platforms is Leg Odometry, which only requires information about kinematics and contacts. Many legged robots use dedicated sensors on each foot to detect
We present a trajectory optimization framework for legged locomotion on rough terrain. We jointly optimize the center of mass motion and the foothold locations, while considering terrain conditions. We use a terrain costmap to quantify the desirability of a foothold location. We increase the gait's…
We propose a reactive locomotion strategy, called height reflex, that is useful to address big elevation changes in the terrain (e.g. when a quadruped robot has to step down from a high platform). In these cases the swing leg can lose mobility creating issues in the subsequent steps. The height refl…
Autonomous legged robots will be required to handle a wide range of tasks in complex environments. While a lot of research has focused on developing their abilities for periodic locomotion tasks, less effort has been invested in devising generalized strategies for dynamic, non-periodic movements. Mo…
The work presented herein, attempts to address the problem of designing stepping recovery controllers for compliantly actuated humanoid robots. Based on the decomposition of the stepping procedure into three distinct phases, which are characterized by unique combinations of configurations and impeda…
This contribution compares two approaches for applying disturbance observers (DOBs) to the torque control problem of series elastic actuators (SEAs). It is demonstrated that they are in fact equivalent for linear models in terms of their ability to reject disturbances and enforce nominal model dynam…
The development of energy efficient actuation represents one of the biggest challenges in robotics research today. This letter presents the generalisation of design and control concepts for a recently introduced asymmetric compliant actuator, as well as its extension to multi-DoF articulated robotic
The general approach to humanoid feet design considers the use of rectangular plate sole structures that are relatively stiff and compatible for flat terrain locomotion. Although this can be adequate the inability of these stiff feet to cope with small terrain irregularities, it makes them inappropr
We present a novel and real-time method to detect object affordances from RGB-D images. Our method trains a deep Convolutional Neural Network (CNN) to learn deep features from the input data in an end-to-end manner. The CNN has an encoder-decoder architecture in order to obtain smooth label predicti…
Exoskeletons offer an intuitive method for actuating multiple DOF of the body; this makes them attractive for applications where generation and coupling of artificial forces to the limbs is needed. Force feedback hand exoskeletons have been continuously considered for whole hand haptic interaction i…
Most animal and human locomotion behaviors for solving complex tasks involve dynamic motions and rich contact interaction. In fact, complex maneuvers need to consider dynamic movement and contact events at the same time. We present a hierarchical trajectory optimization approach for planning dynamic
This paper describes a new task-oriented grasping method to reorient a rigid object to its nominal pose, which is defined as the configuration that it needs to be grasped from, in order to successfully execute a particular manipulation task. Our method combines two key insights: (1) a visual 6 Degre…
This paper focuses on the development of a dynamic model-free whole-body controller for a humanoid robot with high kinematic redundancy. The proposed controller is based on force-level operational-space control framework, which computes joint torques for the required forces of prioritized multiple t
In this work a novel synergy-based bilateral tele-manipulation strategy is introduced. The proposed algorithm has been primarily developed to remotely control the Pisa/IIT SoftHand (SH) using a 3-finger hand exoskeleton as master device. With a single actuator and a sensory system limited to a posit
A common disadvantage of multi-legged robots is that they often lack the manipulation capability. To overcome this limitation, an arm can be added to the body of the multi-legged robot, to perform manipulation tasks and provide assistance for locomotion. First, we proposed an attachment configuratio
Programming by Demonstration (PbD) offers a user-friendly way to transfer skills from human to robot. Typically, demonstration data do not contain the control inputs required to reproduce the demonstrated skill. These can be obtained from a low-level controller that tracks the modeled movement. We p
The deployment of robots to assist in environments hostile for humans during emergency scenarios require robots to demonstrate enhanced physical performance, that includes adequate power, adaptability and robustness to physical interactions and efficient operation. This work presents the design and
The work presents the development and evaluation of a novel foot sole for humanoid robots. For humanoid locomotion the foot sole is important for absorbing impacts. In contrast to the simple planar rubber pad foot sole that is conventionally used in humanoid robots this paper introduces a new foot s…
Encoders have been an inseparable part of robots since the very beginning of modern robotics in the 1950s. As a result, the foundations of robot control are built on the concepts of kinematics and dynamics of articulated rigid bodies, which rely on explicitly measuring the robot configuration in ter…
In this paper, we propose an Energy based Fall Prediction (EFP) which observes the real-time balance status of a humanoid robot during standing. The EFP provides an analytic and quantitative measure of the level of balance. Both simulation and experimental studies were conducted and compared with th…
In this paper we present a feed forward controller to regulate the depth of laser incisions in soft tissue. Such a controller is compatible with the requirements of laser microsurgery, where space constraints limit the use of sensing devices. The controller is based on an inverse model that maps the…
This paper aims at developing a unified and adaptive foot placement control for legged robots. The locomotion control of legged robots can be classified into three parts as body height control, body attitude control, and forward velocity control. In our study, the body attitude is controlled at stan…
It is well known that kinematics can significantly affect the manipulation capabilities of robotic arms, traditionally illustrated by performance indices such as workspace volume, kinematic and force manipulability, and isotropy within the arm workspace. In the case of dual-arm systems and bimanual…
This paper challenges the well-established assumption in robotics that in order to control a robot it is necessary to know its kinematic information, that is, the arrangement of links and joints, the link dimensions and the joint positions. We propose a kinematic-free robot control concept that does…
Very often, when addressing the problem of human-robot skill transfer in task space, only the Cartesian position of the end-effector is encoded by the learning algorithms, instead of the full pose. However, orientation is just as important as position, if not more, when it comes to successfully perf…
Human-robot collaboration seeks to have humans and robots closely interacting in everyday situations. For some tasks, physical contact between the user and the robot may occur, originating significant challenges at safety, cognition, perception and control levels, among others. This paper focuses on…
In this paper, a robot learning approach is proposed which integrates Visuospatial Skill Learning, Imitation Learning, and conventional planning methods. In our approach, the sensorimotor skills (i.e., actions) are learned through a learning from demonstration strategy. The sequence of performed act…
In laser-based laryngeal surgeries, motorized laser scanners offer greater aiming accuracy and efficiency. In this paper, a new motorized laser micromanipulator is presented, which is based on a spherical orienting device. It is a 2 degrees-of-freedom roll/pitch mechanism which actuates the laser be…
We propose a new algorithm capable of online regeneration of gait patterns. The algorithm uses a nonlinear optimization technique to find step parameters that will bring the robot from the present state to a desired state. It modifies online not only the footstep positions, but also the step timing…
A fundamental aspect of controlling humanoid robots lies in the capability to exploit the whole body to perform tasks. This work introduces a novel whole body control library called OpenSoT. OpenSoT is combined with joint impedance control to create a framework that can effectively generate complex…
We present a framework for dynamic quadrupedal locomotion over challenging terrain, where the choice of appropriate footholds is crucial for the success of the behaviour. We build a model of the environment on-line and on-board using an efficient occupancy grid representation. We use Any-time-Repair…
Agile robot locomotion on rough terrain is highly dependent on the ability to perceive the environment. In this paper, we show how the interaction between a reactive control framework and an online mapping system can significantly improve the trotting performance on irregular terrain. In particular,…
Autonomous manipulation of objects requires reliable information on robot-object contact state. Underwater environments can adversely affect sensing modalities such as vision, making them unreliable. In this paper we investigate underwater robot-object contact perception between an autonomous underw…