Adaptation of Unsupervised Term Discovery for Speech to Sign Languages Konusmadaki Gozetimsiz Terim Kesfinin I saret Dillerine Uyarlanmasi


Polat K., SARAÇLAR M.

28th Signal Processing and Communications Applications Conference, SIU 2020, Gaziantep, Türkiye, 5 - 07 Ekim 2020, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu49456.2020.9302225
  • Basıldığı Şehir: Gaziantep
  • Basıldığı Ülke: Türkiye
  • Anahtar Kelimeler: sign language, term discovery, unsupervised learning
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

Unsupervised spoken term discovery (UTD), which is an active research area in speech processing, aims to find repeating units in speech signal using only the signal itself. It is useful for finding terms in low resource languages. Sign languages can also be considered as low resource since annotated corpora are not abundant, thus arises the need for unsupervised methods. In this work, we adapt a well known UTD algorithm to work with sign language videos. Instead of speech features, we used visual features obtained from a pre-trained convolutional neural net. We used an annotated sign dataset in order to evaluate the performance of the algorithm. According to the metrics that are used in UTD for speech, we show that the algorithm for sign language videos achieves similar performance compared to UTD for speech.