Accurate audio-to-score alignment for expressive violin recordings

Jia Ling Syue, Li Su, Yi Ju Lin, Pei Ching Li, Yen Kuang Lu, Yu Lin Wang, Alvin W.Y. Su

研究成果: Conference contribution

摘要

An audio-to-score alignment system adaptive to various playing styles and techniques, and also with high accuracy for onset/offset annotation is the key step toward advanced research on automatic music expression analysis. Technical barriers include the processing of overlapped notes, repeated note sequences, and silence. Most of these characteristics vary with expressions. In this paper, the audio-toscore alignment problem of expressive violin performance is addressed. We propose a two-stage alignment system composed of the dynamic time warping (DTW) algorithm, simulation of overlapped sustain notes, background noise model, silence detection, and refinement process, to better capture the onset. More importantly, we utilize the nonnegative matrix factorization (NMF) method for synthesis of the reference signal in order to deal with highly diverse timbre in real-world performance. A dataset of annotated expressive violin recordings in which each piece is played with various expressive musical terms is used. The optimal choice of basic parameters considered in conventional alignment systems, such as features, distance functions in DTW, synthesis methods for the reference signal, and energy ratios, is analyzed. Different settings on different expressions are compared and discussed. Results show that the proposed methods notably improve the conventional DTW-based alignment method.

原文English
主出版物標題Proceedings of the 18th International Society for Music Information Retrieval Conference, ISMIR 2017
編輯Sally Jo Cunningham, Zhiyao Duan, Xiao Hu, Douglas Turnbull
發行者International Society for Music Information Retrieval
頁面250-256
頁數7
ISBN(電子)9789811151798
出版狀態Published - 2017 一月 1
事件18th International Society for Music Information Retrieval Conference, ISMIR 2017 - Suzhou, China
持續時間: 2017 十月 232017 十月 27

出版系列

名字Proceedings of the 18th International Society for Music Information Retrieval Conference, ISMIR 2017

Conference

Conference18th International Society for Music Information Retrieval Conference, ISMIR 2017
國家China
城市Suzhou
期間17-10-2317-10-27

All Science Journal Classification (ASJC) codes

  • Music
  • Information Systems

指紋 深入研究「Accurate audio-to-score alignment for expressive violin recordings」主題。共同形成了獨特的指紋。

引用此