Attention-based video streaming
Signal Processing: Image Communication, cilt.25, sa.10, ss.745-760, 2010 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 25 Sayı: 10
- Basım Tarihi: 2010
- Doi Numarası: 10.1016/j.image.2010.08.002
- Dergi Adı: Signal Processing: Image Communication
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
- Sayfa Sayıları: ss.745-760
- Anahtar Kelimeler: Biologically motivated attentive vision, Face tracking, Foveation, Neural networks, Spatio-temporal pre-processing, Video streaming
- Boğaziçi Üniversitesi Adresli: Evet
Özet
This paper considers the problem of video streaming in low bandwidth networks and presents a complete framework that is inspired by the foveaperiphery distinction of biological vision systems. First, an application specific attention function that serves to find the important small regions in a given frame is constructed a priori using a back-propagation neural network that is optimized combinatorially. Given a specific application, the respective attention function partitions each frame into foveal and periphery regions and then a spatialtemporal pre-processing algorithm encodes the foveal regions with high spatial resolution while the periphery regions are encoded with lower spatial and temporal resolution. Finally, the pre-processed video sequence is streamed using a standard streaming server. As an application, we consider the transmission of human face videos. Our experimental results indicate that even with limited amount of training, the constructed attention function is able to determine the foveal regions which have improved transmission quality while the peripheral regions have an acceptable degradation. © 2010 Elsevier B.V. All rights reserved.