diarize-jruby

This library provides an easy-to-use toolkit for speaker segmentation (diarization) and identification from audio.

This library is being used within the BBC R&D World Service archive prototype.

See http://worldservice.prototyping.bbc.co.uk/programmes/X0403940 for an example.

This library gives acccess to the algorithm developed by the LIUM for the ESTER 2 evaluation campaign and described in [Meigner2010].

It wraps a binary JAR file compiled from http://lium3.univ-lemans.fr/diarization/doku.php/welcome.

This library also implements an algorithm for speaker identification based on the comparison of normalised speaker models, which can be accessed through the Speaker#match method.

This algorithm builds on top of the LIUM toolkit and uses the following techniques:

• "M-Norm" normalisation of speaker models [Ben2003]
• The symmetric Kullback-Leibler divergence approximation described in [Do2003]
• The detection score specified in [Ben2005]

It also includes support for speaker supervectors [Campbell2006], which can be used in combination with our ruby-lsh library for fast speaker identification.

This gem has been tested with jruby 1.7.0 onwards.

$ jruby -S gem install diarize-jruby
$ jruby -S irb
> require 'diarize'
> audio = Diarize::Audio.new URI('http://example.com/file.wav')
> audio.analyze!
> audio.segments
> audio.speakers
> audio.to_rdf
> speakers = audio.speakers
> speakers.first.gender
> speakers.first.model.mean_log_likelihood
> speakers.first.model.components.size
> audio.segments_by_speaker(speakers.first)[0].play
> audio.segments_by_speaker(speakers.first)[1].play
> ...
> speakers |= other_speakers
> Diarize::Speaker.match(speakers)

$ jruby -S rake

[Meigner2010] S. Meignier and T. Merlin, "LIUM SpkDiarization: An Open Source Toolkit For Diarization" in Proc. CMU SPUD Workshop, March 2010, Dallas (Texas, USA)

[Ben2003] M. Ben and F. Bimbot, "D-MAP: A Distance-Normalized Map Estimation of SPeaker Models for Automatic Speaker Verification", Proceedings of ICASSP, 2003

[Do2003] M. N. Do, "Fast Approximation of Kullback-Leibler Distance for Dependence Trees and Hidden Markov Models", IEEE Signal Processing Letters, April 2003

[Ben2005] M. Ben and G. Gravier and F. Bimbot. "A model space framework for efficient speaker detection", Proceedings of INTERSPEECH, 2005

[Campbell2006] W. M. Campbell, D. E. Sturim and D. A. Reynolds, "Support vector machines using GMM supervectors for speaker verification", IEEE Signal Processing Letters, 2006, 13, 308-311

See 'COPYING' and 'AUTHORS' files.

All code here, except where otherwise indicated, is licensed under the GNU Affero General Public License version 3. This license includes many restrictions. If this causes a problem, please contact us. See "AUTHORS" for contact details.

This library includes a binary JAR file from the LIUM project, which code is licensed under the GNU General Public License version 2. See http://lium3.univ-lemans.fr/diarization/doku.php/licence for more information.