Bounded Off-Policy Evaluation with Missing Data for Course Recommendation and Curriculum Design
William Hoiles, Mihaela Schaar
Abstract
Successfully recommending personalized course schedules is a difficult problem given the diversity of students knowledge, learning behaviour, and goals. This paper presents personalized course recommendation and curriculum design algorithms that exploit logged student data. The algorithms are based on the regression estimator for contextual multi-armed bandits with a penalized variance term. Guarantees on the predictive performance of the algorithms are provided using empirical Bernstein bounds. We also provide guidelines for including expert domain knowledge into the recommendations. Using undergraduate engineering logged data from a post-secondary institution we illustrate the performance of these algorithms.
BibTeX
@InProceedings{pmlr-v48-hoiles16,
title = {Bounded Off-Policy Evaluation with Missing Data for Course Recommendation and Curriculum Design},
author = {Hoiles, William and Schaar, Mihaela},
booktitle = {Proceedings of The 33rd International Conference on Machine Learning},
pages = {1596--1604},
year = {2016},
editor = {Balcan, Maria Florina and Weinberger, Kilian Q.},
volume = {48},
series = {Proceedings of Machine Learning Research},
address = {New York, New York, USA},
month = {20--22 Jun},
publisher = {PMLR},
pdf = {http://proceedings.mlr.press/v48/hoiles16.pdf},
url = {https://proceedings.mlr.press/v48/hoiles16.html},
abstract = {Successfully recommending personalized course schedules is a difficult problem given the diversity of students knowledge, learning behaviour, and goals. This paper presents personalized course recommendation and curriculum design algorithms that exploit logged student data. The algorithms are based on the regression estimator for contextual multi-armed bandits with a penalized variance term. Guarantees on the predictive performance of the algorithms are provided using empirical Bernstein bounds. We also provide guidelines for including expert domain knowledge into the recommendations. Using undergraduate engineering logged data from a post-secondary institution we illustrate the performance of these algorithms.}
}