Video coding based on pre-attentive processing


Dikici Ç., BOZMA AYDIN H. I.

Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Imaging IX, San Jose, CA, Amerika Birleşik Devletleri, 18 - 20 Ocak 2005, cilt.5671, ss.212-220, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 5671
  • Doi Numarası: 10.1117/12.602122
  • Basıldığı Şehir: San Jose, CA
  • Basıldığı Ülke: Amerika Birleşik Devletleri
  • Sayfa Sayıları: ss.212-220
  • Anahtar Kelimeler: Attentive Vision, Biologically motivated vision, Foveation, Real-time video processing
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

Attentive robots have visual systems with fovea-periphery distinction and saccadic motion capability. Previous work has shown that spatial and temporal redundancy thus present can be exploited in video coding / streaming algorithms and hence considerable bandwidth efficiency can be achieved. In this paper, we present a complete framework for real-time video coding with integrated pre-attentive processing and show that areas of greatest interest can be ensured of being processed in greater detail. The first step is pre-attention where the goal is to fixate on the most interesting parts of the incoming scene using a measure of saliency. The construction of the pre-attention function can vary depending on the set of visual primitives used. Here, we use Cartesian and Non-Cartesian filters and build a pre-attention function for a specific problem - namely video coding in applications such as robot-human tracking or video-conferencing. Using the most salient and distinguishing filter responses as the input, system parameters of a neural network are trained using resilient back-propagation algorithm with supervised learning. These parameters are then used in the construction of the pre-attentive function. Comparative results indicate that even with a very limited amount of learning, performance robustness can be achieved. © 2005 SPIE and IS&T.