izmertechИзмерительная техникаIzmeritel`naya Tekhnika0368-10252949-5237ФГУП "ВНИИФТРИ"10.32446/0368-1025it.2024-2-55-62izmertech-2090Research ArticleАКУСТИЧЕСКИЕ ИЗМЕРЕНИЯACOUSTIC MEASUREMENTSМетод асинхронного анализа голосового источника речи на основе двухуровневой авторегрессионной модели речевого сигналаMethod for asynchronous analysis of a glottal source based on a two-level autoregressive model of the speech signalhttps://orcid.org/0000-0003-3045-3337СавченкоВ. В.SavchenkoV. V.

Владимир Васильевич Савченко, доктор технических наук, профессор

Нижний Новгород

Vladimir V. Savchenko

Nizhny Novgorod

vvsavchenko@yandex.ruhttps://orcid.org/0000-0002-2776-5471СавченкоЛ. В.SavchenkoL. V.

Людмила Васильевна Савченко

Нижний Новгород

Lyudmila V. Savchenko

Nizhny Novgorod

vvsavchenko@yandex.ruНациональный исследовательский университет «Высшая школа экономики»РоссияNational Research University Higher School of EconomicsRussian Federation202405042024025562Copyright © ФГУП "ВНИИФТРИ", 20242024ФГУП "ВНИИФТРИ"ФГУП "ВНИИФТРИ"https://www.izmt.ru/jour/about/submissions#copyrightNoticehttps://www.izmt.ru/jour/article/view/2090

Рассмотрена задача анализа голосового источника речи в интервале наблюдений небольшой длительности. Описана проблема недостаточного быстродействия известных методов анализа голосового источника вне зависимости от способа подготовки данных: синхронного с основным тоном звуков речи или асинхронного. Предложен метод анализа голосового источника речи, основанный на двухуровневой авторегрессионной модели речевого сигнала. Описана программная реализация разработанного метода анализа на базе высокоскоростной вычислительной процедуры Берга-Левинсона. Показано, что данная процедура характеризуется относительно небольшим объёмом вычислительных затрат, и при её применении не требуется синхронизировать последовательность наблюдений с основным тоном речевого сигнала. С использованием программной реализации предложенного метода поставлен и проведён натурный эксперимент, в котором объектом исследования служили гласные звуки речи контрольного диктора. По результатам эксперимента подтверждено повышенное быстродействие метода и сформулированы требования к длительности речевого сигнала при голосовом анализе в режиме реального времени. Оптимальная длительность речевого сигнала составила 32–128 мс. Полученные результаты можно применять при разработке и исследовании систем цифровой речевой связи, голосового управления, биометрии, биомедицины и других речевых систем, где первостепенное значение имеют голосовые особенности речи диктора.

The task of analyzing a glottal source over a short observation interval is considered. The acute problem of insufficient performance of known methods for analyzing a glottal source is pointed out, regardless of the mode of data preparation: synchronous with the main tone of speech sounds or asynchronous. A method for analyzing the glottal source based on a two-level autoregressive model of the speech signal is proposed. Its software implementation based on the high-speed Burg-Levinson computational procedure is described. It does not require synchronization of the sequence of observations used with the main tone of the speech signal and is characterized by a relatively small amount of computational costs. Using the described software implementation, a full-scale experiment was set up and conducted, where the vowel sounds of the control speaker’s speech were used as the object of study. Based on the results of the experiment, the increased performance of the proposed method was confirmed and its requirements for the duration of the speech signal during voice analysis in real time were formulated. It is shown that the optimal duration is in the range from 32 to 128 ms. The results obtained can be used in the development and research of digital speech communication systems, voice control, biometrics, biomedicine and other speech systems where the voice characteristics of the speaker’s speech are of paramount importance.

акустика речиречевой сигналанализ речиголосовой анализречевой трактосновной тончастота основного тонаspeech acousticsspeech signalspeech analysisglottal analysisvocal tractfundamental tonefundamental frequencyReferencesLi Y., Tao J., Erickson D., Liu B. and Akagi M. F0-Noise-robust glottal source and vocal tract analysis based on ARX-LF model, In IEEE/ACM Transactions on Audio, Speech, Language Processing, 29, 3375–3383 (2021). https://doi.org/10.1109/TASLP.2021.3120585Li Y., Tao J., Erickson D., Liu B. and Akagi M. F0-Noise-robust glottal source and vocal tract analysis based on ARX-LF model, In IEEE/ACM Transactions on Audio, Speech, Language Processing, 29, 3375–3383 (2021). https://doi.org/10.1109/TASLP.2021.3120585Narendra N. P., Airaksinen M., Story B., Alku P. Estimation of the glottal source from coded telephone speech using deep neural networks. Speech Communication, 106, 95–104 (2019). https://doi.org/10.1016/j.specom.2018.12.002Narendra N. P., Airaksinen M., Story B., Alku P. Estimation of the glottal source from coded telephone speech using deep neural networks. Speech Communication, 106, 95–104 (2019). https://doi.org/10.1016/j.specom.2018.12.002Drugman T., Alku P., Alwan A., Yegnanarayana B. Glottal source processing: From analysis to applications. Computer Speech & Language, 28(5), 1117–1138 (2014). https://doi.org/10.1016/j.csl.2014.03.003Drugman T., Alku P., Alwan A., Yegnanarayana B. Glottal source processing: From analysis to applications. Computer Speech & Language, 28(5), 1117–1138 (2014). https://doi.org/10.1016/j.csl.2014.03.003Sadok S., Leglaive S., Girin L., Alameda-Pineda X., Séguier R. Learning and controlling the source-fi lter representation of speech with a variational autoencoder. Speech Communication, 148, 53–65 (2023). https://doi.org/10.1016/j.specom.2023.02.005Sadok S., Leglaive S., Girin L., Alameda-Pineda X., Séguier R. Learning and controlling the source-fi lter representation of speech with a variational autoencoder. Speech Communication, 148, 53–65 (2023). https://doi.org/10.1016/j.specom.2023.02.005Mittapalle K. R., Pohjalainen H., Helkkula P. et al. Glottal fl ow characteristics in vowels produced by speakers with heart failure. Speech Communication, 137, 35–43 (2022). https://doi.org/10.1016/j.specom.2021.12.001Mittapalle K. R., Pohjalainen H., Helkkula P. et al. Glottal fl ow characteristics in vowels produced by speakers with heart failure. Speech Communication, 137, 35–43 (2022). https://doi.org/10.1016/j.specom.2021.12.001Rudzicz F. Clear Speech: Technologies that Enable the Expression and Reception of Language. Springer Cham (2022). https://doi.org/10.1007/978-3-031-01599-1Rudzicz F. Clear Speech: Technologies that Enable the Expression and Reception of Language. Springer Cham (2022). https://doi.org/10.1007/978-3-031-01599-1Ternström S. Special issue on current trends and future directions in voice acoustics measurement. Applied Sciences, 13(6), 3514 (2023). https://doi.org/10.3390/app13063514Ternström S. Special issue on current trends and future directions in voice acoustics measurement. Applied Sciences, 13(6), 3514 (2023). https://doi.org/10.3390/app13063514Savchenko V. V. Acoustic variability of voice signal as factor of information security for automatic speech recognition systems with tuning to user voice. Radioelectronics and Communications Systems, 63(10), 532–542 (2020). https://doi.org/10.3103/S0735272720100039Savchenko V. V. Acoustic variability of voice signal as factor of information security for automatic speech recognition systems with tuning to user voice. Radioelectronics and Communications Systems, 63(10), 532–542 (2020). https://doi.org/10.3103/S0735272720100039Serry M. A., Alzamendi G. A., Zañartu M., Peterson S. D. An Euler-Bernoulli-type beam model of the vocal folds for describing curved and incomplete glottal closure patterns. Journal of the Mechanical Behavior of Biomedical Materials, 147, 106130 (2023). https://doi.org/10.1016/j.jmbbm.2023.106130Serry M. A., Alzamendi G. A., Zañartu M., Peterson S. D. An Euler-Bernoulli-type beam model of the vocal folds for describing curved and incomplete glottal closure patterns. Journal of the Mechanical Behavior of Biomedical Materials, 147, 106130 (2023). https://doi.org/10.1016/j.jmbbm.2023.106130Sundberg J. Objective characterization of phonation type using amplitude of fl ow glottogram pulse and of voice source fundamental. Journal of Voice, 36(1), 4–14 (2022). https://doi.org/10.1016/j.jvoice.2020.03.018Sundberg J. Objective characterization of phonation type using amplitude of fl ow glottogram pulse and of voice source fundamental. Journal of Voice, 36(1), 4–14 (2022). https://doi.org/10.1016/j.jvoice.2020.03.018Yao X., Bai W., Ren Y.n, Liu X., Hui Zh. Exploration of glottal characteristics and the vocal folds behavior for the speech under emotion. Neurocomputing, 410, 328–341 (2020). https://doi.org/10.1016/j.neucom.2020.06.010Yao X., Bai W., Ren Y.n, Liu X., Hui Zh. Exploration of glottal characteristics and the vocal folds behavior for the speech under emotion. Neurocomputing, 410, 328–341 (2020). https://doi.org/10.1016/j.neucom.2020.06.010Rabiner L. R., Shafer R. W. Theory and Applications of Digital Speech Processing, Pearson, Boston (2011).Rabiner L. R., Shafer R. W. Theory and Applications of Digital Speech Processing, Pearson, Boston (2011).Gibson J. Mutual Information, the Linear Prediction Model, and CELP Voice Codecs. Information, 10(5), 179–189 (2019). https://doi.org/10.3390/info10050179Gibson J. Mutual Information, the Linear Prediction Model, and CELP Voice Codecs. Information, 10(5), 179–189 (2019). https://doi.org/10.3390/info10050179Südholt D., Cámara M., Xu Zh., Reiss J. D. Vocal Tract Area Estimation by Gradient Descent. Proceedings of the 26th International Conference on Digital Audio Effects (DAFx23), Copenhagen, Denmark, 2023. https://doi.org/10.48550/arXiv.2307.04702Südholt D., Cámara M., Xu Zh., Reiss J. D. Vocal Tract Area Estimation by Gradient Descent. Proceedings of the 26th International Conference on Digital Audio Effects (DAFx23), Copenhagen, Denmark, 2023. https://doi.org/10.48550/arXiv.2307.04702Li Y., Sakakibara K. I. & Akagi M. Simultaneous estimation of glottal source waveforms and vocal tract shapes from speech signals based on ARX-LF Model. Jornal Signal Processing Systems, 92, 831–838 (2020). https://doi.org/10.1007/s11265-019-01510-4Li Y., Sakakibara K. I. & Akagi M. Simultaneous estimation of glottal source waveforms and vocal tract shapes from speech signals based on ARX-LF Model. Jornal Signal Processing Systems, 92, 831–838 (2020). https://doi.org/10.1007/s11265-019-01510-4Drugman T., Bozkurt B. and Dutoit Th. A comparative study of glottal source estimation techniques. Computer Speech and Language, 26, 20–34 (2019).Drugman T., Bozkurt B. and Dutoit Th. A comparative study of glottal source estimation techniques. Computer Speech and Language, 26, 20–34 (2019).Freixes M., Luis J. O., Socoró J. C. and Francesc A. P. Evaluation of glottal inverse fi ltering techniques on OPENGLOT synthetic male and female vowels. Applied Sciences, 13(15), 8775 (2023). https://doi.org/10.3390/app13158775Freixes M., Luis J. O., Socoró J. C. and Francesc A. P. Evaluation of glottal inverse fi ltering techniques on OPENGLOT synthetic male and female vowels. Applied Sciences, 13(15), 8775 (2023). https://doi.org/10.3390/app13158775Zhang Zh., Lin J. Evaluation of glottal inverse fi ltering in the presence of source-fi lter interaction. The Journal of the Acoustical Society of America, 152(4), A284–A284 (2022). https://doi.org/10.1121/10.0016281Zhang Zh., Lin J. Evaluation of glottal inverse fi ltering in the presence of source-fi lter interaction. The Journal of the Acoustical Society of America, 152(4), A284–A284 (2022). https://doi.org/10.1121/10.0016281Perrotin O. and McLoughlin I. A spectral glottal fl ow model for source-fi lter separation of speech, 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2019), Brighton, UK, pp. 7160–7164 (2019). https://doi.org/10.1109/ICASSP.2019.8682625Perrotin O. and McLoughlin I. A spectral glottal fl ow model for source-fi lter separation of speech, 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2019), Brighton, UK, pp. 7160–7164 (2019). https://doi.org/10.1109/ICASSP.2019.8682625Savchenko V. V. Method for reduction of speech signal autoregression model for speech transmission systems on lowspeed communication channels. Radioelectronics and Communications Systems, 64(11), pp. 592–603 (2021). https://doi.org/10.3103/S0735272721110030Savchenko V. V. Method for reduction of speech signal autoregression model for speech transmission systems on lowspeed communication channels. Radioelectronics and Communications Systems, 64(11), pp. 592–603 (2021). https://doi.org/10.3103/S0735272721110030Walker J., Murphy P. A., Review of Glottal Waveform Analysis, In: Progress in Nonlinear Speech Processing. Lecture Notes in Computer Science, 4391 (2007). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71505-4_1Walker J., Murphy P. A., Review of Glottal Waveform Analysis, In: Progress in Nonlinear Speech Processing. Lecture Notes in Computer Science, 4391 (2007). Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71505-4_1Palaparthi A., Titze I. R. Analysis of glottal inverse fi ltering in the presence of source-fi lter interaction. Speech Communication, 123, 98–108 (2020). https://doi.org/10.1016/j.specom.2020.07.003Palaparthi A., Titze I. R. Analysis of glottal inverse fi ltering in the presence of source-fi lter interaction. Speech Communication, 123, 98–108 (2020). https://doi.org/10.1016/j.specom.2020.07.003Gupta S., Fahad M. S., Deepak A. Pitch-synchronous single frequency fi ltering spectrogram for speech emotion recognition. Multimed Tools Applications, 79, 23347–23365 (2020). https://doi.org/10.1007/s11042-020-09068-1Gupta S., Fahad M. S., Deepak A. Pitch-synchronous single frequency fi ltering spectrogram for speech emotion recognition. Multimed Tools Applications, 79, 23347–23365 (2020). https://doi.org/10.1007/s11042-020-09068-1Савченко В. В. Мера различий речевых сигналов по тембру голоса. Измерительная техника, (10), 63–69 (2023). [Savchenko V. V. Mera razlichij rechevyh signalov po tembru golosa. Izmeritel’naya tekhnika, (10), 63–69 (2023). (In Russ.)] https://doi.org/10.32446/0368-1025it.2023-10-63-69Савченко В. В. Мера различий речевых сигналов по тембру голоса. Измерительная техника, (10), 63–69 (2023). [Savchenko V. V. Mera razlichij rechevyh signalov po tembru golosa. Izmeritel’naya tekhnika, (10), 63–69 (2023). (In Russ.)] https://doi.org/10.32446/0368-1025it.2023-10-63-69Nossier S. A., Wall J., Moniri M., Glackin C. and Cannings N. A comparative study of time and frequency domain approaches to deep learning based speech enhancement. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK, pp. 1–8 (2020). https://doi.org/10.1109/IJCNN48605.2020.9206928Nossier S. A., Wall J., Moniri M., Glackin C. and Cannings N. A comparative study of time and frequency domain approaches to deep learning based speech enhancement. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, UK, pp. 1–8 (2020). https://doi.org/10.1109/IJCNN48605.2020.9206928Freixes, M., Arnela, M., Socoró, J. C., Alías F., Guasch O. Glottal source contribution to higher order modes in the fi nite element synthesis of vowels. Applied Sciences, 9(21), 4535 (2019). https://doi.org/10.3390/app9214535Freixes, M., Arnela, M., Socoró, J. C., Alías F., Guasch O. Glottal source contribution to higher order modes in the fi nite element synthesis of vowels. Applied Sciences, 9(21), 4535 (2019). https://doi.org/10.3390/app9214535Candan Ç. Making linear prediction perform like maximum likelihood in Gaussian autoregressive model parameter estimation. Signal Processing, 166, 107256 (2020). https://doi.org/10.1016/j.sigpro.2019.107256Candan Ç. Making linear prediction perform like maximum likelihood in Gaussian autoregressive model parameter estimation. Signal Processing, 166, 107256 (2020). https://doi.org/10.1016/j.sigpro.2019.107256Cui S., Li E. and Kang X. Autoregressive model based smoothing forensics of very short speech clips. In: IEEE International Conference on Multimedia and Expo (ICME), London, UK, pp. 1–6 (2020). https://doi.org/10.1109/ICME46284.2020.9102765Cui S., Li E. and Kang X. Autoregressive model based smoothing forensics of very short speech clips. In: IEEE International Conference on Multimedia and Expo (ICME), London, UK, pp. 1–6 (2020). https://doi.org/10.1109/ICME46284.2020.9102765Савченко А. В., Савченко В. В. Адаптивный метод измерения частоты основного тона с использованием двухуровневой авторегрессионной модели речевого сигнала. Измерительная техника. (6), 60–66 (2022). https://doi.org/10.32446/0368-1025it.2022-6-60-66Savchenko A. V., Savchenko V. V. Adaptive method for measuring a fundamental tone frequency using a two-level autoregressive model of speech signals. Measurement Techniques, 65(6), 453–460 (2022). https://doi.org/10.1007/s11018-022-02104-6Marple S. L. Digital Spectral Analysis with Appli cations, 2nd ed. Dover Publications, Mineola, New York (2019).Marple S. L. Digital Spectral Analysis with Appli cations, 2nd ed. Dover Publications, Mineola, New York (2019).Савченко В. В., Савченко А. В. Метод измерения искажений речевого сигнала, переданного по каналу связи в биометрическую систему идентификации. Измерительная техника. (11), 65–72 (2020). https://doi.org/10.32446/0368-1025it.2020-11-65-72Savchenko V. V., Savchenko A. V. Method for measuring distortions in speech signals during transmission over a communication channel to a biometric identifi cation system. Measurement Techniques, 63(11), 917–925 (2021). https://doi.org/10.1007/s11018-021-01864-xKathiresan Th., Maurer D., Suter H., Dellwo V. Formant pattern and spectral shape ambiguity in vowel synthesis: The role of fundamental frequency and formant amplitude. The Journal of Acoustical Society of America, 143(3), 1919–1920 (2018). https://doi.org/10.1121/1.5036258Kathiresan Th., Maurer D., Suter H., Dellwo V. Formant pattern and spectral shape ambiguity in vowel synthesis: The role of fundamental frequency and formant amplitude. The Journal of Acoustical Society of America, 143(3), 1919–1920 (2018). https://doi.org/10.1121/1.5036258Corey R. M., Kozat S. S., Singer A. C. Parametric estimation. In: Paulo S. R. Diniz (Eds.). Signal Processing and Machine Learning Theory, Academic Press, pp. 689–716 (2024). https://doi.org/10.1016/B978-0-32-391772-8.00017-XCorey R. M., Kozat S. S., Singer A. C. Parametric estimation. In: Paulo S. R. Diniz (Eds.). Signal Processing and Machine Learning Theory, Academic Press, pp. 689–716 (2024). https://doi.org/10.1016/B978-0-32-391772-8.00017-XСавченко В. В. Метод сравнительного тестирования параметрических оценок спектра мощности: спектральный анализ через синтез временно́го ряда. Измерительная техника, (6), 56–62 (2023). https://doi.org/10.32446/0368-1025it.2023-6-56-62Savchenko V. V. Method for comparison testing of parametric power spectrum estimates: spectral analysis via time series synthesis. Measurement Techniques, 66(6), 430–438 (2023). https://doi.org/10.1007/s11018-023-02244-3Savchenko A. V., Savchenko V. V. Sc ale-invariant modifi cation of COSH distance for measuring speech signal distortions in real-time mode. Radioelectronics and Communications Systems, 64(6), 300–306 (2021). https://doi.org/10.3103/S0735272721060030Savchenko A. V., Savchenko V. V. Sc ale-invariant modification of COSH distance for measuring speech signal distortions in real-time mode. Radioelectronics and Communications Systems, 64(6), 300–306 (2021). https://doi.org/10.3103/S0735272721060030Савченко В. В. Совершенствование методики измерения показателя точности авторегрессионной модели речевого сигнала. Измерительная техника, (10), 58–63 (2022). https://doi.org/10.32446/0368-1025it.2022-10-58-63Savchenko V. V. Improving the method for measuring the accuracy indicator of a speech signal autoregression model. Measurement Techniques, 65(10), 769–775 (2023). https://doi.org/10.1007/s11018-023-02150-8Kumar S., Singh S. K., Bhattacharya S. Performance evaluation of a ACF-AMDF based pitch detection scheme in realtime. International Journal of Speech Technology, 18, 521–527 (2015). https://doi.org/10.1007/s10772-015-9296-2Kumar S., Singh S. K., Bhattacharya S. Performance evaluation of a ACF-AMDF based pitch detection scheme in realtime. International Journal of Speech Technology, 18, 521–527 (2015). https://doi.org/10.1007/s10772-015-9296-2

The authors declare that there are no conflicts of interest present.