AAAI 2025technical0 citations
Optimized Random Features for the Neural Tangent Kernel (Student Abstract)
Abstract
The neural tangent kernel (NTK) has emerged as an important tool in recent years, both for developing a theoretical understanding of deep learning as well as for various applications. Even though recursive closed form expressions have been derived for computing the NTK, these become computationally expensive as the complexity of a network increases. Recent papers have looked at reducing this complexity using various sketching techniques along with random features. Building on these techniques, we propose an additional optimization step which results in better approximation of the NTK.
BibTeX
@article{Das_Maity_2025, title={Optimized Random Features for the Neural Tangent Kernel (Student Abstract)}, volume={39}, url={https://ojs.aaai.org/index.php/AAAI/article/view/35244}, DOI={10.1609/aaai.v39i28.35244}, abstractNote={The neural tangent kernel (NTK) has emerged as an important tool in recent years, both for developing a theoretical understanding of deep learning as well as for various applications. Even though recursive closed form expressions have been derived for computing the NTK, these become computationally expensive as the complexity of a network increases. Recent papers have looked at reducing this complexity using various sketching techniques along with random features. Building on these techniques, we propose an additional optimization step which results in better approximation of the NTK.}, number={28}, journal={Proceedings of the AAAI Conference on Artificial Intelligence}, author={Das, Shrutimoy and Maity, Binita}, year={2025}, month={Apr.}, pages={29340-29342} }