Keyword Search for Sign Language using Machine Translation Makine evirisi Kullanarak I aret Dili i~in Anahtar Sozctik Arama


Tamer N. C., SARAÇLAR M.

28th Signal Processing and Communications Applications Conference, SIU 2020, Gaziantep, Türkiye, 5 - 07 Ekim 2020, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu49456.2020.9302337
  • Basıldığı Şehir: Gaziantep
  • Basıldığı Ülke: Türkiye
  • Anahtar Kelimeler: cross language retrieval, keyword search, neural machine translation., sign language recognition
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

Sign language, the main mode of communication for the Deaf, is different from the written language in terms of both vocabulary and grammar. Lacking a proper written form, information retrieval from this visual language is a challenging task. Keyword search for sign language will benefit greatly from the use of written language text queries by (i) creating a middle ground for information retrieval, (ii) enabling the people outside of the Deaf community to learn sign language and (iii) making vast amount of parallel corpora between sign language and the written language available for research. In this work, we propose a cross-lingual keyword search paradigm for sign language based on neural machine translation, and analyze the effects of different decoding strategies on retrieval performance.