Speech enhancement based on spectrogram conditional generative adversarial networks

Ru Han; Jianming Liu; Mingwen Wang

doi:10.1117/12.2557256

3 January 2020 Speech enhancement based on spectrogram conditional generative adversarial networks

Ru Han, Jianming Liu, Mingwen Wang

Proceedings Volume 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019); 113732S (2020) https://doi.org/10.1117/12.2557256
Event: Eleventh International Conference on Graphics and Image Processing, 2019, Hangzhou, China

Abstract

Voice is the main way of communication and information sharing with others, It brings great convenience to human life. The existing speech recognition classification has the problem of considerable performance attenuation to environment noise and accent. Most of these problems can be mitigated by training on large amounts of data. However, collecting large Numbers of high-quality datasets in real life is time-consuming and expensive. In order to solve this problem, this paper proposes a data enhancement method,which is suitable for the speech image extension of small samples. S-GAN is used to generate datasets that conform to the real distribution of samples, and GAN-train and GAN-test methods are used to evaluate the quality and diversity of network generated images. Meanwhile, the spatial transformation network (STN) and CNN framework are combined to get the useful information part of the data for data classification. The results show that this method can significantly improve the classification accuracy of speech recognition and lay a foundation for small sample data enhancement.

Citation Download Citation

Ru Han, Jianming Liu, and Mingwen Wang "Speech enhancement based on spectrogram conditional generative adversarial networks", Proc. SPIE 11373, Eleventh International Conference on Graphics and Image Processing (ICGIP 2019), 113732S (3 January 2020); https://doi.org/10.1117/12.2557256

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available