← Search

Jian Shen

11 accepted papers

2025

Clients Collaborate: Flexible Differentially Private Federated Learning with Guaranteed Improvement of Utility-Privacy Trade-off

ICML 2025poster

To defend against privacy leakage of user data, differential privacy is widely used in federated learning, but it is not free. The addition of noise randomly disrupts the semantic integrity of the model and this disturbance accumulates with increased communication rounds. In this paper, we introduce…

2023

Set-to-Sequence Ranking-Based Concept-Aware Learning Path Recommendation

AAAI 2023technical

With the development of the online education system, personalized education recommendation has played an essential role. In this paper, we focus on developing path recommendation systems that aim to generating and recommending an entire learning path to the given user in each session. Noticing that…

Cited by 11SourcePDFScholar
2022

Towards Return Parity in Markov Decision Processes

AISTATS 2022poster

Algorithmic decisions made by machine learning models in high-stakes domains may have lasting impacts over time. However, naive applications of standard fairness criterion in static settings over temporal domains may lead to delayed and adverse effects. To understand the dynamics of performance disp…

2021

Curriculum Offline Imitating Learning

NeurIPS 2021poster

Offline reinforcement learning (RL) tasks require the agent to learn from a pre-collected dataset with no further interactions with the environment. Despite the potential to surpass the behavioral policies, RL-based methods are generally impractical due to the training instability and bootstrapping…

Cited by 42SourcePDFScholar
2021

MapGo: Model-Assisted Policy Optimization for Goal-Oriented Tasks

IJCAI 2021poster

In Goal-oriented Reinforcement learning, relabeling the raw goals in past experience to provide agents with hindsight ability is a major solution to the reward sparsity problem. In this paper, to enhance the diversity of relabeled goals, we develop FGI (Foresight Goal Inference), a new relabeling st…

2021

Model-based Multi-agent Policy Optimization with Adaptive Opponent-wise Rollouts

IJCAI 2021poster

This paper investigates the model-based methods in multi-agent reinforcement learning (MARL). We specify the dynamics sample complexity and the opponent sample complexity in MARL, and conduct a theoretic analysis of return discrepancy upper bound. To reduce the upper bound with the intention of low…

2021

On Effective Scheduling of Model-based Reinforcement Learning

NeurIPS 2021poster

Model-based reinforcement learning has attracted wide attention due to its superior sample efficiency. Despite its impressive success so far, it is still unclear how to appropriately schedule the important hyperparameters to achieve adequate performance, such as the real data ratio for policy optimi…

2020

Improving Knowledge Tracing via Pre-training Question Embeddings

IJCAI 2020poster

Knowledge tracing (KT) defines the task of predicting whether students can correctly answer questions based on their historical response. Although much research has been devoted to exploiting the question information, plentiful advanced information among questions and skills hasn't been well extract…

2020

Model-based Policy Optimization with Unsupervised Model Adaptation

NeurIPS 2020spotlight

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between simulated data and real data, this could lead to degraded performan…