Turkish language resources: Morphological parser, morphological disambiguator and web corpus
6th International Conference on Natural Language Processing, GoTAL 2008, Gothenburg, İsveç, 25 - 27 Ağustos 2008, cilt.5221 LNAI, ss.417-427, (Tam Metin Bildiri)
- Yayın Türü: Bildiri / Tam Metin Bildiri
- Cilt numarası: 5221 LNAI
- Doi Numarası: 10.1007/978-3-540-85287-2_40
- Basıldığı Şehir: Gothenburg
- Basıldığı Ülke: İsveç
- Sayfa Sayıları: ss.417-427
- Anahtar Kelimeler: Morphological disambiguation, Morphological parsing, Turkish, Web corpus
- Boğaziçi Üniversitesi Adresli: Evet
Özet
In this paper, we propose a set of language resources for building Turkish language processing applications. Specifically, we present a finite-state implementation of a morphological parser, an averaged perceptron-based morphological disambiguator, and compilation of a web corpus. Turkish is an agglutinative language with a highly productive inflectional and derivational morphology. We present an implementation of a morphological parser based on two-level morphology. This parser is one of the most complete parsers for Turkish and it runs independent of any other external system such as PC-KIMMO in contrast to existing parsers. Due to complex phonology and morphology of Turkish, parsing introduces some ambiguous parses. We developed a morphological disambiguator with accuracy of about 98% using averaged perceptron algorithm. We also present our efforts to build a Turkish web corpus of about 423 million words. © 2008 Springer-Verlag Berlin Heidelberg.