Affordable Access

Access to the full text

Online/offline score informed music signal decomposition: application to minus one

Authors
  • Munoz-Montoro, Antonio Jesús1
  • Carabias-Orti, Julio José1
  • Vera-Candeas, Pedro1
  • Canadas-Quesada, Francisco Jesús1
  • Ruiz-Reyes, Nicolás1
  • 1 Department of Telecommunication Engineering, University of Jaen, Linares, Jaen, 23700, Spain , Linares (Spain)
Type
Published Article
Journal
EURASIP Journal on Audio, Speech, and Music Processing
Publisher
Springer International Publishing
Publication Date
Dec 23, 2019
Volume
2019
Issue
1
Identifiers
DOI: 10.1186/s13636-019-0168-6
Source
Springer Nature
Keywords
License
Green

Abstract

In this paper, we propose a score-informed source separation framework based on non-negative matrix factorization (NMF) and dynamic time warping (DTW) that suits for both offline and online systems. The proposed framework is composed of three stages: training, alignment, and separation. In the training stage, the score is encoded as a sequence of individual occurrences and unique combinations of notes denoted as score units. Then, we proposed a NMF-based signal model where the basis functions for each score unit are represented as a weighted combination of spectral patterns for each note and instrument in the score obtained from a trained a priori over-completed dictionary. In the alignment stage, the time-varying gains are estimated at frame level by computing the projection of each score unit basis function over the captured audio signal. Then, under the assumption that only a score unit is active at a time, we propose an online DTW scheme to synchronize the score information with the performance. Finally, in the separation stage, the obtained gains are refined using local low-rank NMF and the separated sources are obtained using a soft-filter strategy. The framework has been evaluated and compared with other state-of-the-art methods for single channel source separation of small ensembles and large orchestra ensembles obtaining reliable results in terms of SDR and SIR. Finally, our method has been evaluated in the specific task of acoustic minus one, and some demos are presented.

Report this publication

Statistics

Seen <100 times