← Search

Shintaro Ishikawa

3 accepted papers

2023

Prototypical Contrastive Transfer Learning for Multimodal Language Understanding

IROS 2023poster

Although domestic service robots are expected to assist individuals who require support, they cannot currently interact smoothly with people through natural language. For example, given the instruction “Bring me a bottle from the kitchen,” it is difficult for such robots to specify the bottle in an…

Cited by 2SourceScholar
2023

Switching Head-Tail Funnel UNITER for Dual Referring Expression Comprehension with Fetch-and-Carry Tasks

IROS 2023poster

This paper describes a domestic service robot (DSR) that fetches everyday objects and carries them to specified destinations according to free-form natural language instructions. Given an instruction such as “Move the bottle on the left side of the plate to the empty chair,” the DSR is expected to i…

Cited by 11SourceScholar
2021

Target-Dependent UNITER: A Transformer-Based Multimodal Language Comprehension Model for Domestic Service Robots

RA-L 2021

Currently, domestic service robots have an insufficient ability to interact naturally through language. This is because understanding human instructions is complicated by various ambiguities. In existing methods, the referring expressions that specify the relationships between objects were insuffici

Cited by 13SourceScholar