Implementation of multi-threaded erasure coding under multi-processing environments Çoklu-Süreçli Ortamlarda Silme Kodlama Yöntemleri'nin Çoklu-Dizin Uygulamasi


Creative Commons License

ARSLAN Ş. Ş.

24th Signal Processing and Communication Application Conference, SIU 2016, Zonguldak, Türkiye, 16 - 19 Mayıs 2016, ss.1773-1776, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu.2016.7496104
  • Basıldığı Şehir: Zonguldak
  • Basıldığı Ülke: Türkiye
  • Sayfa Sayıları: ss.1773-1776
  • Anahtar Kelimeler: Erasure coding, Galois field, multithreading and multi-processing, Reed-Solomon
  • Açık Arşiv Koleksiyonu: AVESİS Açık Erişim Koleksiyonu
  • Boğaziçi Üniversitesi Adresli: Hayır

Özet

Galois Field arithmetic forms the basis of Reed-Solomon erasure coding techniques to protect storage or communication systems from failures. Most recent implementations of Galois Field arithmetic rely on 128-bit vector instructions, such as Intel's Streaming SIMD Extensions, which allows us to perform fast Galois Field computations. However, these implementations are not optimized for multi-threaded and multi-processing environments. Most of the real servers address multiple requests concurrently and it is desirable to use all the parallelism that hardware provides to efficiently handle the coding workload. This short paper gives some of the details about how to leverage multi-threading capabilities of the modern hardware in multi-processing environments, and demonstrates the significant performance improvements over the single-threaded applications on commodity microprocessors using Jerasure 2.0 library as a case study.