Motion compensated frame rate up-conversion using 3D frequency selective extrapolation and a multi-layer consistency check
Michel Bätz, Fabian Brand, Andrea Eichenseer, André Kaup
Abstract
A high temporal resolution is desirable in many applications such as entertainment systems, automotive systems, or video surveillance. Apart from using cameras with a higher temporal resolution, it is also possible to employ frame rate up-conversion methods to obtain an enhanced temporal resolution. In principle, those algorithms can be grouped into approaches that rely on a motion estimation and approaches that do not. Both strategies typically process a video sequence frame by frame and take into account only the directly adjacent frames to compute the intermediate frame. In this paper, we propose a frame rate up-conversion technique that employs a motion compensated three-dimensional reconstruction algorithm. As a result, the proposed method takes into account more than two frames and is capable of jointly reconstructing up to a certain amount of missing frames in a video sequence. Furthermore, we present a multi-layer consistency check to further improve the reconstruction. On average, simulation results show a luminance PSNR gain compared to a conventional frame rate up-conversion method of 0.5 dB. Visual examples substantiate our objective results.
BibTeX
@inproceedings{icassp2017_motioncompensate,
title = {Motion compensated frame rate up-conversion using 3D frequency selective extrapolation and a multi-layer consistency check},
author = {Michel Bätz and Fabian Brand and Andrea Eichenseer and André Kaup},
booktitle = {ICASSP 2017},
year = {2017}
}