Generative RNNs for OOV keyword search


Gundogdu B., Yusuf B., SARAÇLAR M.

IEEE Signal Processing Letters, cilt.26, sa.1, ss.124-128, 2019 (SCI-Expanded, Scopus)

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 26 Sayı: 1
  • Basım Tarihi: 2019
  • Doi Numarası: 10.1109/lsp.2018.2881610
  • Dergi Adı: IEEE Signal Processing Letters
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.124-128
  • Anahtar Kelimeler: Keyword search, out of vocabulary terms, query modeling, recurrent neural networks
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

The modeling of text queries as sequences of embeddings for conducting similarity matching based search within speech features has been recently shown to improve keyword search (KWS) performance, especially for the out-of-vocabulary (OOV) terms. This technique uses a dynamic time warping based search methodology, converting the KWS problem into a pattern search problem by artificially modeling the text queries as pronunciation-based embedding sequences. This query modeling is done by concatenating and repeating frame representations for each phoneme in the keyword's pronunciation. In this letter, we propose a query model that incorporates temporal context information using recurrent neural networks (RNN) trained to generate realistic query representations. With experiments conducted on the IARPA Babel Program's Turkish and Zulu datasets, we show that the proposed RNN-based query generation yields significant improvements over the statistical query models of earlier work, and yields a comparable performance to the state-of-the-art techniques for OOV KWS.