Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization

Yi Ju Lin, Yu Lin Wang, Wen-Yu Su, Li Su

Research output: Contribution to conferencePaper

Abstract

In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.

Original languageEnglish
Publication statusPublished - 2015 Jan 1
Event18th International Conference on Digital Audio Effects, DAFx 2015 - Trondheim, Norway
Duration: 2015 Nov 302015 Dec 3

Other

Other18th International Conference on Digital Audio Effects, DAFx 2015
CountryNorway
CityTrondheim
Period15-11-3015-12-03

Fingerprint

Factorization
factorization
matrices
octaves
Modulation
modulation
Source separation
music
artifacts
computerized simulation
interference
harmonics
Computer simulation
coefficients
Octave
energy

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Signal Processing
  • Acoustics and Ultrasonics
  • Music

Cite this

Lin, Y. J., Wang, Y. L., Su, W-Y., & Su, L. (2015). Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. Paper presented at 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.
Lin, Yi Ju ; Wang, Yu Lin ; Su, Wen-Yu ; Su, Li. / Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. Paper presented at 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.
@conference{bce22b515c694bac96f234c8b3bc13aa,
title = "Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization",
abstract = "In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.",
author = "Lin, {Yi Ju} and Wang, {Yu Lin} and Wen-Yu Su and Li Su",
year = "2015",
month = "1",
day = "1",
language = "English",
note = "18th International Conference on Digital Audio Effects, DAFx 2015 ; Conference date: 30-11-2015 Through 03-12-2015",

}

Lin, YJ, Wang, YL, Su, W-Y & Su, L 2015, 'Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization' Paper presented at 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway, 15-11-30 - 15-12-03, .

Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. / Lin, Yi Ju; Wang, Yu Lin; Su, Wen-Yu; Su, Li.

2015. Paper presented at 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.

Research output: Contribution to conferencePaper

TY - CONF

T1 - Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization

AU - Lin, Yi Ju

AU - Wang, Yu Lin

AU - Su, Wen-Yu

AU - Su, Li

PY - 2015/1/1

Y1 - 2015/1/1

N2 - In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.

AB - In note separation of polyphonic music, how to separate the overlapping partials is an important and difficult problem. Fifths and octaves, as the most challenging ones, are, however, usually seen in many cases. Non-negative matrix factorization (NMF) employs the constraints of energy and harmonic ratio to tackle this problem. Recently, complex matrix factorization (CMF) is proposed by combining the phase information in source separation problem. However, temporal magnitude modulation is still serious in the situation of fifths and octaves, when CMF is applied. In this work, we investigate the temporal smoothness model based on CMF approach. The temporal ac-tivation coefficient of a preceding note is constrained when the succeeding notes appear. Compare to the unconstraint CMF, the magnitude modulation are greatly reduced in our computer simulation. Performance indices including sourceto- interference ratio (SIR), source-to-artifacts ratio (SAR), sourceto- distortion ratio (SDR), as well as modulation error ratio (MER) are given.

UR - http://www.scopus.com/inward/record.url?scp=85030183340&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85030183340&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:85030183340

ER -

Lin YJ, Wang YL, Su W-Y, Su L. Separation of musical notes with highly overlapping partials using phase and temporal constrained complex matrix factorization. 2015. Paper presented at 18th International Conference on Digital Audio Effects, DAFx 2015, Trondheim, Norway.