Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization

Yi Ju Lin, Yu Lin Wang, Wen-Yu Su, Li Su

研究成果: Paper

摘要

In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.

原文English
出版狀態Published - 2015 一月 1
事件18th International Conference on Digital Audio Effects, DAFx 2015 - Trondheim, Norway
持續時間: 2015 十一月 302015 十二月 3

Other

Other18th International Conference on Digital Audio Effects, DAFx 2015
國家Norway
城市Trondheim
期間15-11-3015-12-03

指紋

Factorization
factorization
matrices
octaves
Modulation
modulation
Source separation
music
artifacts
computerized simulation
interference
harmonics
Computer simulation
coefficients
Octave
energy

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Signal Processing
  • Acoustics and Ultrasonics
  • Music

引用此文

Lin, Y. J., Wang, Y. L., Su, W-Y., & Su, L. (2015). Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. 論文發表於 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.
Lin, Yi Ju ; Wang, Yu Lin ; Su, Wen-Yu ; Su, Li. / Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. 論文發表於 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.
@conference{bce22b515c694bac96f234c8b3bc13aa,
title = "Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization",
abstract = "In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.",
author = "Lin, {Yi Ju} and Wang, {Yu Lin} and Wen-Yu Su and Li Su",
year = "2015",
month = "1",
day = "1",
language = "English",
note = "18th International Conference on Digital Audio Effects, DAFx 2015 ; Conference date: 30-11-2015 Through 03-12-2015",

}

Lin, YJ, Wang, YL, Su, W-Y & Su, L 2015, 'Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization' 論文發表於 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway, 15-11-30 - 15-12-03, .

Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. / Lin, Yi Ju; Wang, Yu Lin; Su, Wen-Yu; Su, Li.

2015. 論文發表於 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.

研究成果: Paper

TY - CONF

T1 - Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization

AU - Lin, Yi Ju

AU - Wang, Yu Lin

AU - Su, Wen-Yu

AU - Su, Li

PY - 2015/1/1

Y1 - 2015/1/1

N2 - In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.

AB - In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.

UR - http://www.scopus.com/inward/record.url?scp=85030183340&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030183340&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85030183340

ER -

Lin YJ, Wang YL, Su W-Y, Su L. Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. 2015. 論文發表於 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.