Adversarial Training with Orthogonal Regularization Dikey Duzenlestirme ile Hasmane Egitim
28th Signal Processing and Communications Applications Conference, SIU 2020, Gaziantep, Türkiye, 5 - 07 Ekim 2020, (Tam Metin Bildiri)
- Yayın Türü: Bildiri / Tam Metin Bildiri
- Doi Numarası: 10.1109/siu49456.2020.9302247
- Basıldığı Şehir: Gaziantep
- Basıldığı Ülke: Türkiye
- Anahtar Kelimeler: adversarial machine learning, Deep learning, orthogonality, robust model training
- Boğaziçi Üniversitesi Adresli: Evet
Özet
Deep neural networks have been successful in various domains, such as computer vision and natural language processing. On the other hand, researchers have discovered a vulnerability of convolutional neural networks to the samples with imperceptible perturbations, also known as, adversarial perturbations. It has been observed that adversarial perturbations can alter the predictions of a deep model. One of the most common approaches to increase the robustness of deep models is adversarial training. However, adversarial training often suffers from a degradation in generalization performance. In this study, orthogonal regularization is used along with adversarial training to facilitate both generalizability and adversarial robustness in deep models. According to the experiments on MNIST and CIFAR10 datasets, imposing orthogonality in weights improves both the generalization performance and adversarial robustness.