6 November 2021 Context-based video frame interpolation via depthwise over-parameterized convolution
Haoran Zhang, Xiaohui Yang, Zhiquan Feng
Author Affiliations +
Funded by: National Natural Science Foundation of China (NSFC)
Abstract

Video frame interpolation is used to generate intermediate frames by estimating the movement of pixels between the input frames. However, problems of blurring, object occlusion, and sudden brightness changes occur in naturally obtained video frames. We propose a context-based video frame interpolation method via depthwise over-parameterized convolution. First, the proposed network obtains the context graphs of the input frames. Subsequently, an adaptive collaboration of flows is adopted to warp the input frames and the context graphs. Then, the frame synthesis network is used to fuse the warped input frames and context graphs to obtain a preliminary estimate of the interpolated frame. Finally, a post-processing module is employed to refine the result. Experimental results on several datasets demonstrate that the proposed method performs qualitatively and quantitatively better than state-of-the-art methods.

© 2021 SPIE and IS&T 1017-9909/2021/$28.00© 2021 SPIE and IS&T
Haoran Zhang, Xiaohui Yang, and Zhiquan Feng "Context-based video frame interpolation via depthwise over-parameterized convolution," Journal of Electronic Imaging 30(6), 063004 (6 November 2021). https://doi.org/10.1117/1.JEI.30.6.063004
Received: 22 May 2021; Accepted: 21 October 2021; Published: 6 November 2021
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Video

Convolution

Visualization

Optical flow

Motion estimation

Motion models

Network architectures

RELATED CONTENT


Back to Top