TR2006-064

Latent Dirichlet Decomposition for Single Channel Speaker Separation


Abstract:

We present an algorithm for the seaparation of multiple speakers from mixed single-channel recordings by latent variable decomposition of the speech spectrogram. We model each magnitude spectral vector in the short-time Fourier transform of a speech signal as the outcome of a discrete random process that generates frequency bin indices. The distribution of the process is modeled as a mixture of multinomial distributions, such that the mixture weights of the component multinomials vary from analysis window to analysis window. The component multinomials are assumed to be speaker specific and are learned from training signals for each speaker. We model the prior distribution of the mixture weights for each speaker as a Dirichlet distribution. The distributions representing magnitude spectral vectors for the mixed signal are decomposed into mixtures of the multinomials for all component speakers. The frequency distribution i.e. the spectrum for each speaker is reconstructed from this decomposition.

 

  • Related News & Events

    •  NEWS    ICASSP 2006: 3 publications by Ajay Divakaran and others
      Date: May 14, 2006
      Where: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
      Brief
      • The papers "Generative Process Tracking for Audio Analysis" by Radhakrishnan, R. and Divakaran, A., "Latent Dirichlet Decomposition for Single Channel Speaker Separation" by Raj, B., Shashanka, M.V.S. and Smaragdis, P. and "Secure Sound Classification: Gaussian Mixture Models" by Shashanka, M.V.S. and Smaragdis, P. were presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).
    •