Time-efficient spam e-mail filtering using n-gram models
Pattern Recognition Letters, cilt.29, sa.1, ss.19-33, 2008 (SCI-Expanded, Scopus)
- Yayın Türü: Makale / Tam Makale
- Cilt numarası: 29 Sayı: 1
- Basım Tarihi: 2008
- Doi Numarası: 10.1016/j.patrec.2007.07.018
- Dergi Adı: Pattern Recognition Letters
- Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
- Sayfa Sayıları: ss.19-33
- Anahtar Kelimeler: Agglutinative language, Free word order, Heuristics, Morphology, n-Gram model, Spam filtering, Turkish
- Boğaziçi Üniversitesi Adresli: Evet
Özet
In this paper, we propose spam e-mail filtering methods having high accuracies and low time complexities. The methods are based on the n-gram approach and a heuristics which is referred to as the first n-words heuristics. We develop two models, a class general model and an e-mail specific model, and test the methods under these models. The models are then combined in such a way that the latter one is activated for the cases the first model falls short. Though the approach proposed and the methods developed are general and can be applied to any language, we mainly apply them to Turkish, which is an agglutinative language, and examine some properties of the language. Extensive tests were performed and success rates about 98% for Turkish and 99% for English were obtained. It has been shown that the time complexities can be reduced significantly without sacrificing performance. © 2007 Elsevier B.V. All rights reserved.