Decoding Sign Languages: The SL-FE Framework for Phonological Analysis and Automated Annotation


Şahin K., GÖKGÖZ K.

11th Workshop on the Representation and Processing of Sign Languages: Evaluation of Sign Language Resources, sign-lang@LREC-COLING 2024, Torino, İtalya, 25 Mayıs 2024, ss.335-342, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Basıldığı Şehir: Torino
  • Basıldığı Ülke: İtalya
  • Sayfa Sayıları: ss.335-342
  • Anahtar Kelimeler: automatic annotation, pose estimation, sign language phonology
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

SL-FE is a framework designed for the phonological representation of sign languages, bridging the gap between theoretical phonology and practical sign language annotation. SL-FE defines phonological information as a continuous signal from pose estimation information that enables not only the extraction of the comprehensive set of discrete phonological information but also provides a quantitative framework for theoretical analyses. By utilizing our framework, we conduct case studies to test empirical claims of feature dominance and symmetry on phonological complexity in Turkish Sign Language (TID). Only by defining a ranking function, we were able to classify these conditions with high lexical retrieval accuracy offering empirical evidence to support theoretical claims. The framework proves to be an essential tool for research in sign language linguistics.