← Search

Qi Yi

15 accepted papers

2024

Emergent Communication for Numerical Concepts Generalization

AAAI 2024technical

Research on emergent communication has recently gained significant traction as a promising avenue for the linguistic community to unravel human language's origins and explore artificial intelligence's generalization capabilities. Current research has predominantly concentrated on recognizing qualita…

Cited by 0SourcePDFScholar
2024

Hypothesis, Verification, and Induction: Grounding Large Language Models with Self-Driven Skill Learning

AAAI 2024technical

Large language models (LLMs) show their powerful automatic reasoning and planning capability with a wealth of semantic knowledge about the human world. However, the grounding problem still hinders the applications of LLMs in the real-world environment. Existing studies try to fine-tune the LLM or ut…

Cited by 0SourcePDFScholar
2024

OCEAN-MBRL: Offline Conservative Exploration for Model-Based Offline Reinforcement Learning

AAAI 2024technical

Model-based offline reinforcement learning (RL) algorithms have emerged as a promising paradigm for offline RL. These algorithms usually learn a dynamics model from a static dataset of transitions, use the model to generate synthetic trajectories, and perform conservative policy optimization within…

2024

Prompt-based Visual Alignment for Zero-shot Policy Transfer

ICML 2024poster

Overfitting in RL has become one of the main obstacles to applications in reinforcement learning(RL). Existing methods do not provide explicit semantic constrain for the feature extractor, hindering the agent from learning a unified cross-domain representation and resulting in performance degradatio…

Cited by 0SourcePDFScholar
2023

Conceptual Reinforcement Learning for Language-Conditioned Tasks

AAAI 2023technical

Despite the broad application of deep reinforcement learning (RL), transferring and adapting the policy to unseen but similar environments is still a significant challenge. Recently, the language-conditioned policy is proposed to facilitate policy transfer through learning the joint representation o…

Cited by 9SourcePDFScholar
2023

Context Shift Reduction for Offline Meta-Reinforcement Learning

NeurIPS 2023poster

Offline meta-reinforcement learning (OMRL) utilizes pre-collected offline datasets to enhance the agent's generalization ability on unseen tasks. However, the context shift problem arises due to the distribution discrepancy between the contexts used for training (from the behavior policy) and testin…

2023

Contrastive Modules with Temporal Attention for Multi-Task Reinforcement Learning

NeurIPS 2023poster

In the field of multi-task reinforcement learning, the modular principle, which involves specializing functionalities into different modules and combining them appropriately, has been widely adopted as a promising approach to prevent the negative transfer problem that performance degradation due to…

2023

Efficient Symbolic Policy Learning with Differentiable Symbolic Expression

NeurIPS 2023poster

Deep reinforcement learning (DRL) has led to a wide range of advances in sequential decision-making tasks. However, the complexity of neural network policies makes it difficult to understand and deploy with limited computational resources. Currently, employing compact symbolic expressions as symboli…

2023

Emergent Communication for Rules Reasoning

NeurIPS 2023poster

Research on emergent communication between deep-learning-based agents has received extensive attention due to its inspiration for linguistics and artificial intelligence. However, previous attempts have hovered around emerging communication under perception-oriented environmental settings, that…

Cited by 0SourcePDFScholar
2023

ImageNet Pre-training Also Transfers Non-robustness

AAAI 2023technical

ImageNet pre-training has enabled state-of-the-art results on many tasks. In spite of its recognized contribution to generalization, we observed in this study that ImageNet pre-training also transfers adversarial non-robustness from pre-trained model into fine-tuned model in the downstream classific…

2023

Online Prototype Alignment for Few-shot Policy Transfer

ICML 2023poster

Domain adaptation in RL mainly deals with the changes of observation when transferring the policy to a new environment. Many traditional approaches of domain adaptation in RL manage to learn a mapping function between the source and target domain in explicit or implicit ways. However, they typically…

2023

Unlearnable Clusters: Towards Label-Agnostic Unlearnable Examples

CVPR 2023poster

There is a growing interest in developing unlearnable examples (UEs) against visual privacy leaks on the Internet. UEs are training samples added with invisible but unlearnable noise, which have been found can prevent unauthorized training of machine learning models. UEs typically are generated via…

2022

Causality-driven Hierarchical Structure Discovery for Reinforcement Learning

NeurIPS 2022accept

Hierarchical reinforcement learning (HRL) has been proven to be effective for tasks with sparse rewards, for it can improve the agent's exploration efficiency by discovering high-quality hierarchical structures (e.g., subgoals or options). However, automatically discovering high-quality hierarchical…

Cited by 23SourcePDFScholar
2021

Hindsight Value Function for Variance Reduction in Stochastic Dynamic Environment

IJCAI 2021poster

Policy gradient methods are appealing in deep reinforcement learning but suffer from high variance of gradient estimate. To reduce the variance, the state value function is applied commonly. However, the effect of the state value function becomes limited in stochastic dynamic environments, where the…

Cited by 9SourcePDFScholar