Unsupervised segmentation of words into morphemes - Morpho challenge 2005 application to automatic speech recognition


Kurimo M., Creutz M., Varjokallio M., Arisoy E., SARAÇLAR M.

INTERSPEECH 2006 and 9th International Conference on Spoken Language Processing, INTERSPEECH 2006 - ICSLP, Pittsburgh, PA, Amerika Birleşik Devletleri, 17 - 21 Eylül 2006, cilt.2, ss.1021-1024, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 2
  • Basıldığı Şehir: Pittsburgh, PA
  • Basıldığı Ülke: Amerika Birleşik Devletleri
  • Sayfa Sayıları: ss.1021-1024
  • Anahtar Kelimeler: Language modelling, Morphemes, Speech recognition, Unsupervised learning
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

Within the EU Network of Excellence PASCAL, a challenge was organized to design a statistical machine learning algorithm that segments words into the smallest meaning-bearing units of language, morphemes. Ideally, these are basic vocabulary units suitable for different tasks, such as speech and text understanding, machine translation, information retrieval, and statistical language modeling. Twelve research groups participated in the challenge and had submitted segmentation results obtained by their algorithms. In this paper, we evaluate the application of these segmentation algorithms to large vocabulary speech recognition using statistical n-gram language models based on the proposed word segments instead of entire words. Experiments were done for two agglutinative and morphologically rich languages: Finnish and Turkish. We also investigate combining various segmentations to improve the performance of the recognizer.