Title: A high-quality frame rate up-conversion technique for Super SloMo

Authors: Minseop Kim; Haechul Choi

Addresses: Hanbat National University (HNU), 125, Dongseo-daero, Yuseong-gu, Daejeon, Republic of Korea ' Hanbat National University (HNU), 125, Dongseo-daero, Yuseong-gu, Daejeon, Republic of Korea

Abstract: In this paper, we propose several methods to improve Super SloMo, a deep learning-based frame rate up-conversion technique for the temporal quality improvement of video. In the proposed methods, the training dataset and hyper-parameter are changed and trained to obtain optimal results while maintaining the existing network structure of Super SloMo. The first method improves the cognition of images when trained with the validation set of characteristics similar to the training set. The second method reduces video loss in all validation sets when trained by adjusting the hyper-parameters of the error function value. The experimental results show that the two proposed methods improved the peak signal-to-noise ratio and the mean of the structural similarity index by 0.11 dB and 0.033% with the specialised training set and by 0.37 dB and 0.077% via adjusting the reconstruction and warping loss parameters, respectively.

Keywords: frame rate up-conversion; FRUC; deep learning; image processing.

DOI: 10.1504/IJCVR.2021.117583

International Journal of Computational Vision and Robotics, 2021 Vol.11 No.5, pp.512 - 525

Received: 21 Dec 2019
Accepted: 13 May 2020
Published online: 14 Sep 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article