An Alternative Artificial Intelligence Technique for Detecting Outliers
Hegazy Zaher
Institute of Statistical Studies and Research Cairo University, Egypt.
Abd El-Fattah Kandil
Department of Statistics, Mathematics and Insurance College of Commerce, Benha University, Egypt.
Rehab Shehata *
Department of Statistics, Mathematics and Insurance College of Commerce, Benha University, Egypt.
*Author to whom correspondence should be addressed.
Abstract
Data are rarely perfect. Whether the problem is data entry errors or rare events. Outliers have two opposing properties. They can be noises that disturb regression and classification task. On the other hand, they can provide valuable information about rare phenomena, which can lead to knowledge discovery. This paper proposes a hybrid algorithm including K Nearest Neighbor and Support Vector Machine (KSVM) that detects outliers by taking the advantages of the two intelligent techniques, Support Vector Machine (SVM) and K Nearest Neighbour (KNN). Also a global efficiency measure introduced to compare different methods. Finally, a comparison between KNN, SVM, and KSVM is conducted using detection rate, accuracy rate, false alarm rate, true negative rate and the proposed global efficiency measure based on benchmark data called Milk data.
Keywords: Outliers, outlier detection, KNN, SVM, global efficiency.