The classical best-subset selection method has been demonstrated to be nondeterministic polynomial-time hard and thus presents computational challenges. This problem can now be solved via advanced mixed integer optimization (MIO) algorithms for linear regression. We extend this methodology to linear instrumental variable (IV) regression and propose the best-subset instrumental variable (BSIV) method incorporating the MIO procedure.
View Article and Find Full Text PDFValid instrumental variables (IVs) must not directly impact the outcome variable and must also be uncorrelated with nonmeasured variables. However, in practice, IVs are likely to be invalid. The existing methods can lead to large bias relative to standard errors in situations with many weak and invalid instruments.
View Article and Find Full Text PDFThis paper introduces a new class of efficient and debiased two-step shrinkage estimators for a linear regression model in the presence of multicollinearity. We derive the proposed estimators' mean square error and define the necessary and sufficient conditions for superiority over the existing estimators. In addition, we develop an algorithm for selecting the shrinkage parameters for the proposed estimators.
View Article and Find Full Text PDFThe maximum likelihood estimator (MLE) suffers from the instability problem in the presence of multicollinearity for a Poisson regression model (PRM). In this study, we propose a new estimator with some biasing parameters to estimate the regression coefficients for the PRM when there is multicollinearity problem. Some simulation experiments are conducted to compare the estimators' performance by using the mean squared error (MSE) criterion.
View Article and Find Full Text PDFIran J Sci Technol Trans A Sci
October 2020
Månsson and Shukur (Econ Model 28:1475-1481, 2011) proposed a Poisson ridge regression estimator (PRRE) to reduce the negative effects of multicollinearity. However, a weakness of the PRRE is its relatively large bias. Therefore, as a remedy, Türkan and Özel (J Appl Stat 43:1892-1905, 2016) examined the performance of almost unbiased ridge estimators for the Poisson regression model.
View Article and Find Full Text PDFIn the logistic regression model, the variance of the maximum likelihood estimator is inflated and unstable when the multicollinearity exists in the data. There are several methods available in literature to overcome this problem. We propose a new stochastic restricted biased estimator.
View Article and Find Full Text PDFThis paper considers the estimation of parameters for the Poisson regression model in the presence of high, but imperfect multicollinearity. To mitigate this problem, we suggest using the Poisson Liu Regression Estimator (PLRE) and propose some new approaches to estimate this shrinkage parameter. The small sample statistical properties of these estimators are systematically scrutinized using Monte Carlo simulations.
View Article and Find Full Text PDF