TY - JOUR
T1 - Equivalence between adaptive Lasso and generalized ridge estimators in linear regression with orthogonal explanatory variables after optimizing regularization parameters
AU - Ohishi, Mineaki
AU - Yanagihara, Hirokazu
AU - Kawano, Shuichi
N1 - Publisher Copyright:
© 2019, The Institute of Statistical Mathematics, Tokyo.
PY - 2020/12/1
Y1 - 2020/12/1
N2 - In this paper, we deal with a penalized least-squares (PLS) method for a linear regression model with orthogonal explanatory variables. The used penalties are an adaptive Lasso (AL)-type ℓ1 penalty (AL penalty) and a generalized ridge (GR)-type ℓ2 penalty (GR penalty). Since the estimators obtained by minimizing the PLS methods strongly depend on the regularization parameters, we optimize them by a model selection criterion (MSC) minimization method. The estimators based on the AL penalty and the GR penalty have different properties, and it is universally recognized that these are completely different estimators. However, in this paper, we show an interesting result that the two estimators are exactly equal when the explanatory variables are orthogonal after optimizing the regularization parameters by the MSC minimization method.
AB - In this paper, we deal with a penalized least-squares (PLS) method for a linear regression model with orthogonal explanatory variables. The used penalties are an adaptive Lasso (AL)-type ℓ1 penalty (AL penalty) and a generalized ridge (GR)-type ℓ2 penalty (GR penalty). Since the estimators obtained by minimizing the PLS methods strongly depend on the regularization parameters, we optimize them by a model selection criterion (MSC) minimization method. The estimators based on the AL penalty and the GR penalty have different properties, and it is universally recognized that these are completely different estimators. However, in this paper, we show an interesting result that the two estimators are exactly equal when the explanatory variables are orthogonal after optimizing the regularization parameters by the MSC minimization method.
UR - http://www.scopus.com/inward/record.url?scp=85074562579&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85074562579&partnerID=8YFLogxK
U2 - 10.1007/s10463-019-00734-2
DO - 10.1007/s10463-019-00734-2
M3 - Article
AN - SCOPUS:85074562579
SN - 0020-3157
VL - 72
SP - 1501
EP - 1516
JO - Annals of the Institute of Statistical Mathematics
JF - Annals of the Institute of Statistical Mathematics
IS - 6
ER -