De-blurring of faces in video based on GAN prior

Datao Xie; Lei Yu; Xingyu Geng

doi:10.1117/12.2681680

1 June 2023 De-blurring of faces in video based on GAN prior

Datao Xie, Lei Yu, Xingyu Geng

Proceedings Volume 12718, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023); 127180N (2023) https://doi.org/10.1117/12.2681680
Event: International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023), 2023, Nanjing, China

Abstract

Until now, the video de-blurring is still a challenging task. In many video de-blurring tasks, high-quality face images in videos is particularly important. However, due to the mutual motion between the camera and the subject during video recording, motion blur often occurs, especially in some frames the blurring of face is particularly serious. But before or after this frame, it may be possible to obtain different local information of the blurred face. For this reason, this paper proposes a new video face de-blurring method based on GAN prior. First, we learn the GAN prior network that generates high-quality face images, and embed it into the whole network as a prior module. Then, residual dense blocks are used in the RNN cell to extract the spatial features of the face in the current frame. In addition, a fusion module is used to fuse the hierarchical features of past and future frames to de-blur the current frame and generate a low quality low fuzzy face. Finally, this face is sent to a trained prior generator to generate a high-quality face. After a series of experiments, the results show that the de-blurring effect of the method we proposed is better than the existing algorithm.

Citation Download Citation

Datao Xie, Lei Yu, and Xingyu Geng "De-blurring of faces in video based on GAN prior", Proc. SPIE 12718, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2023), 127180N (1 June 2023); https://doi.org/10.1117/12.2681680

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Deblurring

Video

Education and training

Fuzzy logic

Image fusion

Image quality

Feature fusion

Show All Keywords

Keywords/Phrases

Search In:

Publication Years