Image-to-Text Retrieval Using Object Detection Nesne Algilama ile G r nt den Metne Eri sim
33rd IEEE Conference on Signal Processing and Communications Applications, SIU 2025, İstanbul, Türkiye, 25 - 28 Haziran 2025, (Tam Metin Bildiri)
- Yayın Türü: Bildiri / Tam Metin Bildiri
- Doi Numarası: 10.1109/siu66497.2025.11112398
- Basıldığı Şehir: İstanbul
- Basıldığı Ülke: Türkiye
- Anahtar Kelimeler: object detection, image-to-text retrieval, zero-shot object detection
- Boğaziçi Üniversitesi Adresli: Evet
Özet
This study aims to enrich the image and use it more effectively through utilizing the image in different ways with object detection and thereby aims to improve the image-to-text retrieval studies. In this scope, a comprehensive analysis is presented using various methods on both monolingual and multilingual datasets. In addition to the traditional object detection architecture, it is aimed to obtain images that are more focused on objects by using zero-shot object detection and to compare it with the use of raw images. In this context, it is taken advantage of both the entire or part of the offline vocabulary and the open vocabulary. In addition, detected objects are also utilized as text and used to enrich the image representation. Thus, a comparative study is presented by exploiting the image with different methods through object detection.