Anti-drifting Feature Selection via Deep Reinforcement Learning (Student Abstract)
Aoran Wang, Hongyang Yang, Feng Mao, Zongzhang Zhang, Yang Yu, Xiaoyang Liu
Abstract
Feature selection (FS) is a crucial procedure in machine learning pipelines for its significant benefits in removing data redundancy and mitigating model overfitting. Since concept drift is a widespread phenomenon in streaming data and could severely affect model performance, effective FS on concept drifting data streams is imminent. However, existing state-of-the-art FS algorithms fail to adjust their selection strategy adaptively when the effective feature subset changes, making them unsuitable for drifting streams. In this paper, we propose a dynamic FS method that selects effective features on concept drifting data streams via deep reinforcement learning. Specifically, we present two novel designs: (i) a skip-mode reinforcement learning environment that shrinks action space size for high-dimensional FS tasks; (ii) a curiosity mechanism that generates intrinsic rewards to address the long-horizon exploration problem. The experiment results show that our proposed method outperforms other FS methods and can dynamically adapt to concept drifts.
BibTeX
@article{Wang_Yang_Mao_Zhang_Yu_Liu_2024, title={Anti-drifting Feature Selection via Deep Reinforcement Learning (Student Abstract)}, volume={37}, url={https://ojs.aaai.org/index.php/AAAI/article/view/27038}, DOI={10.1609/aaai.v37i13.27038}, abstractNote={Feature selection (FS) is a crucial procedure in machine learning pipelines for its significant benefits in removing data redundancy and mitigating model overfitting. Since concept drift is a widespread phenomenon in streaming data and could severely affect model performance, effective FS on concept drifting data streams is imminent. However, existing state-of-the-art FS algorithms fail to adjust their selection strategy adaptively when the effective feature subset changes, making them unsuitable for drifting streams. In this paper, we propose a dynamic FS method that selects effective features on concept drifting data streams via deep reinforcement learning. Specifically, we present two novel designs: (i) a skip-mode reinforcement learning environment that shrinks action space size for high-dimensional FS tasks; (ii) a curiosity mechanism that generates intrinsic rewards to address the long-horizon exploration problem. The experiment results show that our proposed method outperforms other FS methods and can dynamically adapt to concept drifts.}, number={13}, journal={Proceedings of the AAAI Conference on Artificial Intelligence}, author={Wang, Aoran and Yang, Hongyang and Mao, Feng and Zhang, Zongzhang and Yu, Yang and Liu, Xiaoyang}, year={2024}, month={Jul.}, pages={16356-16357} }