Robust Multiple Linear Backward EliminationRegression

Authors

  • Md Siddiqur Rahman Department of Statistics, Jagannath University, Dhaka-1100, Bangladesh
  • Sabina Sharmin Department of Statistics, University of Dhaka, Dhaka-1000, Bangladesh

DOI:

https://doi.org/10.3329/dujs.v71i2.69122

Keywords:

Computational complexity, Multivariate outliers, Robust model selection, Slash contamination, Winsorization

Abstract

For building a linear prediction model, robust Backward Elimination (RBE) algorithm, which is computationally useful and scalable to high-dimensional large datasets, is introduced in this investigation. Backward Elimination (BE) can be stated in terms of sample correlations and simple RBE can be obtained by swapping out these correlations with their corresponding robust counterparts. The robust correlation for winsorized data was employed based on the adjusted winsorized correlation as a robust bivariate correlation. In another study, the Spearman rank correlation was employed as a robust bivariate correlation. However, the RBE has some drawbacks in the presence of multivariate outliers. In this article, the usage of FastMCD (Fast minimum covariance determinant)-based correlation is proposed in BE to reduce the influence of outlying data points. We call this proposed method BEmcd. A comprehensive simulation study was conducted to evaluate the performance of BEmcd with that of RBE based on winsorized correlation and Spearman rank correlation. Simulations and an application of actual data demonstrate the outstanding performance of BEmcd.

Dhaka Univ. J. Sci. 71(2): 134-141, 2023 (July)

Downloads

Download data is not yet available.
Abstract
25
PDF
27

Downloads

Published

2023-10-18

How to Cite

Rahman, M. S., & Sharmin, S. . (2023). Robust Multiple Linear Backward EliminationRegression. Dhaka University Journal of Science, 71(2), 134–141. https://doi.org/10.3329/dujs.v71i2.69122

Issue

Section

Articles