DeblurSR: Event-Based Motion Deblurring under the Spiking Representation
Chen Song, Chandrajit Bajaj, Qixing Huang
Abstract
We present DeblurSR, a novel motion deblurring approach that converts a blurry image into a sharp video. DeblurSR utilizes event data to compensate for motion ambiguities and exploits the spiking representation to parameterize the sharp output video as a mapping from time to intensity. Our key contribution, the Spiking Representation (SR), is inspired by the neuromorphic principles determining how biological neurons communicate with each other in living organisms. We discuss why the spikes can represent sharp edges and how the spiking parameters are interpreted from the neuromorphic perspective. DeblurSR has higher output quality and requires fewer computing resources than state-of-the-art event-based motion deblurring methods. We additionally show that our approach easily extends to video super-resolution when combined with recent advances in implicit neural representation.
BibTeX
@article{Song_Bajaj_Huang_2024, title={DeblurSR: Event-Based Motion Deblurring under the Spiking Representation}, volume={38}, url={https://ojs.aaai.org/index.php/AAAI/article/view/28293}, DOI={10.1609/aaai.v38i5.28293}, abstractNote={We present DeblurSR, a novel motion deblurring approach that converts a blurry image into a sharp video. DeblurSR utilizes event data to compensate for motion ambiguities and exploits the spiking representation to parameterize the sharp output video as a mapping from time to intensity. Our key contribution, the Spiking Representation (SR), is inspired by the neuromorphic principles determining how biological neurons communicate with each other in living organisms. We discuss why the spikes can represent sharp edges and how the spiking parameters are interpreted from the neuromorphic perspective. DeblurSR has higher output quality and requires fewer computing resources than state-of-the-art event-based motion deblurring methods. We additionally show that our approach easily extends to video super-resolution when combined with recent advances in implicit neural representation.}, number={5}, journal={Proceedings of the AAAI Conference on Artificial Intelligence}, author={Song, Chen and Bajaj, Chandrajit and Huang, Qixing}, year={2024}, month={Mar.}, pages={4900-4908} }