← Search

Mobarakol Islam

9 accepted papers

2024

LLM-Assisted Multi-Teacher Continual Learning for Visual Question Answering in Robotic Surgery

ICRA 2024poster

Visual question answering (VQA) can be fundamentally crucial for promoting robotic-assisted surgical education. In practice, the needs of trainees are constantly evolving, such as learning more surgical types and adapting to new surgical instruments/techniques. Therefore, continually updating the VQ…

Cited by 17SourcecodeScholar
2024

OSSAR: Towards Open-Set Surgical Activity Recognition in Robot-assisted Surgery

ICRA 2024poster

In the realm of automated robotic surgery and computer-assisted interventions, understanding robotic surgical activities stands paramount. Existing algorithms dedicated to surgical activity recognition predominantly cater to pre-defined closed-set paradigms, ignoring the challenges of real-world ope…

Cited by 7SourcecodeScholar
2023

Generalizing Surgical Instruments Segmentation to Unseen Domains with One-to-Many Synthesis

IROS 2023poster

Despite their impressive performance in various surgical scene understanding tasks, deep learning-based methods are frequently hindered from deploying to real-world surgical applications for various causes. Particularly, data collection, annotation, and domain shift in-between sites and patients are…

Cited by 3SourcecodeScholar
2023

Surgical-VQLA:Transformer with Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgery

ICRA 2023poster

Despite the availability of computer-aided simulators and recorded videos of surgical procedures, junior residents still heavily rely on experts to answer their queries. However, expert surgeons are often overloaded with clinical and academic workloads and limit their time in answering. For this pur…

Cited by 34SourcecodeScholar
2022

Global-Reasoned Multi-Task Learning Model for Surgical Scene Understanding

RA-L 2022

Global and local relational reasoning enable scene understanding models to perform human-like scene analysis and understanding. Scene understanding enables better semantic segmentation and object-to-object interaction detection. In the medical domain, a robust surgical scene understanding model allo

Cited by 44SourcecodeScholar
2022

Rethinking Feature Extraction: Gradient-Based Localized Feature Extraction for End-To-End Surgical Downstream Tasks

RA-L 2022

Several approaches have been introduced to understand surgical scenes through downstream tasks like captioning and surgical scene graph generation. However, most of them heavily rely on an independent object detector and region-based feature extractor. Encompassing computationally expensive detectio

Cited by 4SourceScholar
2021

Learning Domain Adaptation with Model Calibration for Surgical Report Generation in Robotic Surgery

ICRA 2021poster

Generating a surgical report in robot-assisted surgery, in the form of natural language expression of surgical scene understanding, can play a significant role in document entry tasks, surgical training, and post-operative analysis. Despite the state-of-the-art accuracy of the deep learning algorith…

Cited by 39SourceScholar
2020

AP-MTL: Attention Pruned Multi-task Learning Model for Real-time Instrument Detection and Segmentation in Robot-assisted Surgery

ICRA 2020poster

Surgical scene understanding and multi-tasking learning are crucial for image-guided robotic surgery. Training a real-time robotic system for the detection and segmentation of high-resolution images provides a challenging problem with the limited computational resource. The perception drawn can be a…

Cited by 32SourcecodeScholar
2019

Real-Time Instrument Segmentation in Robotic Surgery Using Auxiliary Supervised Deep Adversarial Learning

RA-L 2019

Robot-assisted surgery is an emerging technology that has undergone rapid growth with the development of robotics and imaging systems. Innovations in vision, haptics, and accurate movements of robot arms have enabled surgeons to perform precise minimally invasive surgeries. Real-time semantic segmen

Cited by 104SourcecodeScholar