← Search

Michael Foshey

6 accepted papers

2024

Learning to Jointly Understand Visual and Tactile Signals

ICLR 2024poster

Modeling and analyzing object and shape has been well studied in the past. However, manipulation of these complex tools and articulated objects remains difficult for autonomous agents. Our human hands, however, are dexterous and adaptive. We can easily adapt a manipulation skill on one object to all…

Cited by 6SourcePDFScholar
2022

ActionSense: A Multimodal Dataset and Recording Framework for Human Activities Using Wearable Sensors in a Kitchen Environment

NeurIPS 2022accept

This paper introduces ActionSense, a multimodal dataset and recording framework with an emphasis on wearable sensing in a kitchen environment. It provides rich, synchronized data streams along with ground truth data to facilitate learning pipelines that could extract insights about how humans inter…

Cited by 59SourcePDFScholar
2022

An Integrated Design Pipeline for Tactile Sensing Robotic Manipulators

ICRA 2022poster

Traditional robotic manipulator design methods require extensive, time-consuming, and manual trial and error to produce a viable design. During this process, engineers often spend their time redesigning or reshaping components as they discover better topologies for the robotic manipula-tor. Tactile…

Cited by 18SourceScholar
2021

An End-to-End Differentiable Framework for Contact-Aware Robot Design

RSS 2021poster

The current dominant paradigm for robotic manipulation involves two separate stages: manipulator design and control. Because the robot's morphology and how it can be controlled are intimately linked; joint optimization of design and control can significantly improve performance. Existing methods for…

2021

Dynamic Modeling of Hand-Object Interactions via Tactile Sensing

IROS 2021poster

Tactile sensing is critical for humans to perform everyday tasks. While significant progress has been made in analyzing object grasping from vision, it remains unclear how we can utilize tactile sensing to reason about and model the dynamics of hand-object interactions. In this work, we employ a hig…

Cited by 19SourceScholar
2021

Intelligent Carpet: Inferring 3D Human Pose From Tactile Signals

CVPR 2021poster

Daily human activities, e.g., locomotion, exercises, and resting, are heavily guided by the tactile interactions between the human and the ground. In this work, leveraging such tactile interactions, we propose a 3D human pose estimation approach using the pressure maps recorded by a tactile carpet a…

Cited by 67PDFScholar