← Search

Jiangtao Gong

15 accepted papers

2026

An LLM-based Simulation Framework for Embodied Conversational Agents in Psychological Counseling

AAAI 2026technical

Due to privacy concerns, open dialogue datasets for mental health are primarily generated through human or AI synthesis methods. However, the inherent implicit nature of psychological processes, particularly those of clients, poses challenges to the authenticity and diversity of synthetic data. In t

Cited by 0SourcePDFScholar
2026

CoIRL-AD: Collaborative-Competitive Imitation-Reinforcement Learning in Latent World Models for Autonomous Driving

ICML 2026poster

End-to-end autonomous driving models trained with imitation learning (IL) often generalize poorly, particularly in long-tail scenarios where expert demonstrations are sparse. Reinforcement learning (RL) can provide complementary reward signals, but applying RL in real-world autonomous driving is cha…

Cited by 1SourceScholar
2026

FreeAskWorld: An Interactive and Closed-Loop Simulator for Human-Centric Embodied AI

AAAI 2026technical

As embodied intelligence emerges as a core frontier in artificial intelligence research, simulation platforms must evolve beyond low-level physical interactions to capture complex, human-centered social behaviors. We introduce FreeAskWorld, an interactive simulation framework that integrates large l

Cited by 0SourcePDFScholar
2025

A Comprehensive LLM-powered Framework for Driving Intelligence Evaluation

ICRA 2025

Evaluation methods for autonomous driving are crucial for algorithm optimization. However, due to the complexity of driving intelligence, there is currently no comprehensive evaluation method for the level of autonomous driving intelligence. In this paper, we propose an evaluation framework for driv

Cited by 9SourcecodeScholar
2025

Embodied Cognition Augmented End2End Autonomous Driving

NeurIPS 2025poster

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision framework restricts the generality and applicability of dri…

Cited by 0SourcecodeScholar
2024

Driving Style Alignment for LLM-powered Driver Agent

IROS 2024poster

Recently, LLM-powered driver agents have demonstrated considerable potential in the field of autonomous driving, showcasing human-like reasoning and decision-making abilities. However, current research on aligning driver agent behaviors with human driving styles remains limited, partly due to the sc…

Cited by 12SourceScholar
2024

Large Language Models Powered Context-aware Motion Prediction in Autonomous Driving

IROS 2024poster

Motion prediction is among the most fundamental tasks in autonomous driving. Traditional methods of motion forecasting primarily encode vector information of maps and historical trajectory data of traffic participants, lacking a comprehensive understanding of overall traffic semantics, which in turn…

Cited by 13SourcecodeScholar
2024

SurrealDriver: Designing LLM-powered Generative Driver Agent Framework based on Human Drivers’ Driving-thinking Data

IROS 2024poster

Leveraging advanced reasoning capabilities and extensive world knowledge of large language models (LLMs) to construct generative agents for solving complex real-world problems is a major trend. However, LLMs inherently lack embodiment as humans, resulting in suboptimal performance in many embodied d…

Cited by 9SourcecodeScholar
2023

Annotating Covert Hazardous Driving Scenarios Online: Utilizing Drivers' Electroencephalography (EEG) Signals

ICRA 2023poster

As autonomous driving systems prevail, it is becoming increasingly critical that the systems learn from databases containing fine-grained driving scenarios. Most databases currently available are human-annotated; they are expensive, time-consuming, and subject to behavioral biases. In this paper, we…

Cited by 3SourceScholar
2023

Enable Natural Tactile Interaction for Robot Dog based on Large-format Distributed Flexible Pressure Sensors

ICRA 2023poster

Touch is an important channel for human-robot interaction, while it is challenging for robots to recognize human touch accurately and make appropriate responses. In this paper, we design and implement a set of large-format distributed flexible pressure sensors on a robot dog to enable natural human-…

Cited by 6SourcecodeScholar
2023

INT2: Interactive Trajectory Prediction at Intersections

ICCV 2023poster

Motion forecasting is an important component in autonomous driving systems. One of the most challenging problems in motion forecasting is interactive trajectory prediction, whose goal is to jointly forecasts the future trajectories of interacting agents. To this end, we present a large-scale interac…

Cited by 10PDFcodeScholar
2023

Planning Assembly Sequence with Graph Transformer

ICRA 2023poster

Assembly Sequence Planning (ASP) is the essential process for modern manufacturing, proven to be NP-complete thus its effective and efficient solution has been a challenge for researchers in the field. In this paper, we present a graph-transformer based framework for the ASP problem which is trained…

Cited by 23SourcecodeScholar
2023

Understanding Embodied Reference with Touch-Line Transformer

ICLR 2023poster

We study embodied reference understanding, the task of locating referents using embodied gestural signals and language references. Human studies have revealed that, contrary to popular belief, objects referred to or pointed to do not lie on the elbow-wrist line, but rather on the so-called virtual t…

2022

Learning with Yourself: a Tangible Twin Robot System to Promote STEM Education

IROS 2022poster

This paper presents a customized programmable robotic system, TanTwin (Tangible Twin), designed to promote STEM education for K-12 children. Firstly, TanTwin is implemented based on a wheel-robot with standard LEGO bricks. With several deep neural networks, a child can convert a captured portrait of…

Cited by 6SourceScholar