Community Exploration: From Offline Optimization to Online Learning
Xiaowei Chen, Weiran Huang, Wei Chen, John C. S. Lui
Abstract
We introduce the community exploration problem that has various real-world applications such as online advertising. In the problem, an explorer allocates limited budget to explore communities so as to maximize the number of members he could meet. We provide a systematic study of the community exploration problem, from offline optimization to online learning. For the offline setting where the sizes of communities are known, we prove that the greedy methods for both of non-adaptive exploration and adaptive exploration are optimal. For the online setting where the sizes of communities are not known and need to be learned from the multi-round explorations, we propose an ``upper confidence'' like algorithm that achieves the logarithmic regret bounds. By combining the feedback from different rounds, we can achieve a constant regret bound.
BibTeX
@inproceedings{NEURIPS2018_c60d870e,
author = {Chen, Xiaowei and Huang, Weiran and Chen, Wei and Lui, John C. S.},
booktitle = {Advances in Neural Information Processing Systems},
editor = {S. Bengio and H. Wallach and H. Larochelle and K. Grauman and N. Cesa-Bianchi and R. Garnett},
pages = {},
publisher = {Curran Associates, Inc.},
title = {Community Exploration: From Offline Optimization to Online Learning},
url = {https://proceedings.neurips.cc/paper_files/paper/2018/file/c60d870eaad6a3946ab3e8734466e532-Paper.pdf},
volume = {31},
year = {2018}
}