Voice Conversion Using a Perceptual Criterion

• Published in: Applied Sciences
• Main Author: Ki-Seung Lee
• Format: Article in Journal/Newspaper
• Language: English
• Published: MDPI AG 2020
• Subjects: voice conversion; joint conversion; perceptual distance measure; Technology; T; Engineering (General). Civil engineering (General); TA1-2040; Biology (General); QH301-705.5; Physics; QC1-999; Chemistry; QD1-999; Arctic
• Online Access: https://doi.org/10.3390/app10082884; https://doaj.org/article/fb1f585af195451bbe205f19aedbe8d6

In voice conversion (VC), it is highly desirable to obtain transformed speech signals that are perceptually close to a target speaker’s voice. To this end, a perceptually meaningful criterion where the human auditory system was taken into consideration in measuring the distances between the converted and the target voices was adopted in the proposed VC scheme. The conversion rules for the features associated with the spectral envelope and the pitch modification factor were jointly constructed so that perceptual distance measurement was minimized. This minimization problem was solved using a deep neural network (DNN) framework where input features and target features were derived from source speech signals and time-aligned version of target speech signals, respectively. The validation tests were carried out for the CMU ARCTIC database to evaluate the effectiveness of the proposed method, especially in terms of perceptual quality. The experimental results showed that the proposed method yielded perceptually preferred results compared with independent conversion using conventional mean-square error (MSE) criterion. The maximum improvement in perceptual evaluation of speech quality (PESQ) was 0.312, compared with the conventional VC method.