TY - GEN
T1 - Efficient synthesis of violin sounds using a bilstm network based source filter model
AU - Dai, Yi Ren
AU - Yang, Hung Chih
AU - Su, Alvin W.Y.
N1 - Funding Information:
This work is supported by MOST Taiwan in part under contract 107-2221-E-006-197-MY3.
Publisher Copyright:
© 2021 150th Audio Engineering Society Convention, AES 2021. All rights reserved.
PY - 2021
Y1 - 2021
N2 - The dynamic changes in playing skills generated from bow-string interaction make synthesizing bowed string instrument sounds a difficult task. Recently, a source filter model incorporating the LSTM predictor and the granular wavetables gives encouraging results. However, the prediction error is still large and the model hasn't caught the nuance caused by the constantly changing characteristics of a playing violin. In this paper, the granular wavetable is represented of DCT coefficients and a new training strategy is proposed to reduce the predictor error. In addition, we analyze the difference between the original violin tone and the corresponding synthesis tone. A random pitch perturbation and a DCT coefficient shaping method are proposed to imitate the changing characteristics since results sound regular.
AB - The dynamic changes in playing skills generated from bow-string interaction make synthesizing bowed string instrument sounds a difficult task. Recently, a source filter model incorporating the LSTM predictor and the granular wavetables gives encouraging results. However, the prediction error is still large and the model hasn't caught the nuance caused by the constantly changing characteristics of a playing violin. In this paper, the granular wavetable is represented of DCT coefficients and a new training strategy is proposed to reduce the predictor error. In addition, we analyze the difference between the original violin tone and the corresponding synthesis tone. A random pitch perturbation and a DCT coefficient shaping method are proposed to imitate the changing characteristics since results sound regular.
UR - http://www.scopus.com/inward/record.url?scp=85113850321&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85113850321&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85113850321
T3 - 150th Audio Engineering Society Convention, AES 2021
BT - 150th Audio Engineering Society Convention, AES 2021
PB - Audio Engineering Society
T2 - 150th Audio Engineering Society Convention, AES 2021
Y2 - 25 May 2021 through 28 May 2021
ER -