Ultrasonic Doppler Sensor For Speaker Recognition

TR Image

In this paper we present a novel use of an acoustic Doppler sonar for multi-modal speaker identification. An ultrasonic emitter directs a 40kHz tone toward the speaker. Reflections from the speaker\'s face are recorded as the speaker talks. The frequency of the tone is modified by the velocity of the facial structures it is reflected by. The received ultrasonic signal thus contains an entire spectrum of frequencies representing the set of all velocities of facial components. The pattern of frequencies in the reflected signal is observed to be typical of the speaker. The captured ultrasonic signal is synchronously analyzed with the corresponding voice signal to extract specific characteristics that can be used to identify the speaker. Experiments show that the information this can result in significant improvements in speaker identification accuracy both under clean conditions and in noise.


  • Related News & Events

    •  NEWS    ICASSP 2008: 4 publications by MERL researchers and others
      Date: March 31, 2008
      Where: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
      • The papers "Joint Tracking and Video Registration by Factorial Hidden Markov Models" by Mei, X. and Porikli, F., "Speech Denoising Using Nonnegative Matrix Factorization with Priors" by Wilson, K.W., Raj, B., Smaragdis, P. and Divakaran, A., "Ultrasonic Doppler Sensor for Speaker Recognition" by Kalgaonkar, K. and Raj, B. and "Sparse and Shift-Invariant Feature Extraction from Non-Negative Data" by Smaragdis, P., Raj, B. and Shashanka, M. were presented at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).