EndoL2H: Deep Super-Resolution for Capsule Endoscopy


Creative Commons License

Almalioglu Y., Bengisu Ozyoruk K., Gokce A., Incetan K., Irem Gokceler G., Ali Simsek M., ...Daha Fazla

IEEE Transactions on Medical Imaging, cilt.39, sa.12, ss.4297-4309, 2020 (SCI-Expanded, Scopus) identifier identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 39 Sayı: 12
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1109/tmi.2020.3016744
  • Dergi Adı: IEEE Transactions on Medical Imaging
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Agricultural & Environmental Science Database, Biotechnology Research Abstracts, Business Source Elite, Business Source Premier, Communication Abstracts, Compendex, EMBASE, INSPEC, MEDLINE, Metadex, Civil Engineering Abstracts
  • Sayfa Sayıları: ss.4297-4309
  • Anahtar Kelimeler: Capsule endoscopy, conditional generative adversarial network, spatial attention network, super-resolution
  • Açık Arşiv Koleksiyonu: AVESİS Açık Erişim Koleksiyonu
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

Although wireless capsule endoscopy is the preferred modality for diagnosis and assessment of small bowel diseases, the poor camera resolution is a substantial limitation for both subjective and automated diagnostics. Enhanced-resolution endoscopy has shown to improve adenoma detection rate for conventional endoscopy and is likely to do the same for capsule endoscopy. In this work, we propose and quantitatively validate a novel framework to learn a mapping from low-to-high-resolution endoscopic images. We combine conditional adversarial networks with a spatial attention block to improve the resolution by up to factors of 8×, 10×, 12×, respectively. Quantitative and qualitative studies demonstrate the superiority of EndoL2H over state-of-the-art deep super-resolution methods Deep Back-Projection Networks (DBPN), Deep Residual Channel Attention Networks (RCAN) and Super Resolution Generative Adversarial Network (SRGAN). Mean Opinion Score (MOS) tests were performed by 30 gastroenterologists qualitatively assess and confirm the clinical relevance of the approach. EndoL2H is generally applicable to any endoscopic capsule system and has the potential to improve diagnosis and better harness computational approaches for polyp detection and characterization. Our code and trained models are available at https://github.com/CapsuleEndoscope/EndoL2H.