Comparing two methods for crowdsourcing speech transcription

Rachele Sprugnoli, Giovanni Moretti, Matteo Fuoli, Diego Giuliani, Luisa Bentivogli, Emanuele Pianta, Roberto Gretter, Fabio Brugnara

Risultato della ricerca: Contributo in libroContributo a convegno

5 Citazioni (Scopus)

Abstract

This paper presents the results of an experimental study conducted with the aim of comparing two methods for crowdsourcing speech transcription that incorporate two different quality control mechanisms (i.e. explicit versus implicit) and that are based on two different processes (i.e. parallel versus iterative). In the Gold Standard method the same speech segment is transcribed in parallel by multiple contributors whose reliability is checked with respect to some reference transcriptions provided by experts. On the other hand, in the Dual Pathway method two independent groups of contributors work on the same set of transcriptions refining them in an iterative way until they converge, and thus eliminating the need to have reference transcriptions and to check transcription quality in a separate phase. These two methods were tested on about half an hour of broadcast news speech and for two different European languages, namely German and Italian. Both methods obtained good results in terms of Word Error Rate (WER) and compare well with the word disagreement rate of experts on the same data.
Lingua originaleEnglish
Titolo della pubblicazione ospiteProceedings of ICASSP 2013
Pagine8116-8120
Numero di pagine5
DOI
Stato di pubblicazionePubblicato - 2013
Evento38th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) - Vancouver, CA
Durata: 26 mag 201331 mag 2013

Convegno

Convegno38th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
CittàVancouver, CA
Periodo26/5/1331/5/13

Keywords

  • Crowdsourcing
  • speech transcription
  • spoken language resources

Fingerprint

Entra nei temi di ricerca di 'Comparing two methods for crowdsourcing speech transcription'. Insieme formano una fingerprint unica.

Cita questo