Integer programming based heterogeneous CPU-GPU cluster scheduler for SLURM resource manager


Soner S., ÖZTURAN C.

14th IEEE International Conference on High Performance Computing and Communications, HPCC-2012 - 9th IEEE International Conference on Embedded Software and Systems, ICESS-2012, Liverpool, İngiltere, 25 - 27 Haziran 2012, ss.418-424, (Tam Metin Bildiri)

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/hpcc.2012.63
  • Basıldığı Şehir: Liverpool
  • Basıldığı Ülke: İngiltere
  • Sayfa Sayıları: ss.418-424
  • Anahtar Kelimeler: integer programming, scheduling, SLURM
  • Boğaziçi Üniversitesi Adresli: Evet

Özet

We present an integer programming based heterogeneous CPU-GPU cluster scheduler for the widely used SLURM resource manager. Our scheduler algorithm takes windows of jobs and solves an allocation problem in which free CPU cores and GPU cards are allocated collectively to jobs so as to maximize some objective function. We perform realistic SLURM emulation tests using the Effective System Performance (ESP) workloads. The test results show that our scheduler produces better resource utilization and shorter average job waiting times. The SLURM scheduler plug-in that implements our algorithm is available at http://code.google.com/p/slurm-ipsched/. © 2012 IEEE.