摘要
为了解决异方差存在时最小二乘回归不适用的问题,基于最小化非对称L2范数的Expectile回归,通过引入一种非凸惩罚(minimax concave penalty,MCP),提出带有MCP惩罚项的正则化Expectile回归模型,可以同时实现模型的变量选择和异方差检测,挖掘自变量与因变量之间更完整关系。传统方法假设随机误差项独立同分布且具有有限阶矩,本文方法将该假设弱化为误差项独立但不同分布,具有有限阶矩。证明了在一定条件下,带有MCP惩罚项的Expectile回归得到的估计量具有Oracle性质。数值模拟结果表明,该方法在变量选择上具有优良的表现,且通过不同Expectile权重值时的自变量集合变化,能有效检测出异方差。
Ordinary least square regression is invalid when the heteroscedasticity exists.To solve the problem of regression model construction and variable selection when the heteroscedasticity existed,based on expectile regression which relied on asymmetric L2 norm the regularized expectile regression with minimax concave penalty(MCP)was proposed to achieve the variable selection and heteroscedasticity detection simultaneously,and more complete relationship between the response variable and predictors was captured.Existing achievements mostly based on the assumption that the error followed normal distribution or it was independent and identically distributed.The proposed method weakened this assumption to the assumption that the random errors were independent but different distributions(non-iid)and had finite moments.Under some conditions,the Oracle property of the proposed estimator was obtained.Numerical simulation showed that the proposed method had good performance in variable selection and could detect heteroscedasticity efficiently according to the change of covariates set under different expectile values.
作者
李顺勇
卫夏利
张晓琴
LI Shunyong;WEI Xiali;ZHANG Xiaoqin(School of Mathmatical Sciences,Shanxi University,Taiyuan 030006,Shanxi,China;School of Statistics,Shanxi University of Finance and Economics,Taiyuan 030006,Shanxi,China)
出处
《河南理工大学学报（自然科学版）》
CAS
北大核心
2020年第4期125-132,共8页
Journal of Henan Polytechnic University（Natural Science）
基金
国家自然科学基金资助项目(81803962)
山西省基础研究计划项目(201701D121004)
山西省回国留学人员科研项目(2017-020)
山西省科技计划研发项目(2018140105000084)
山西省基础研究计划项目(201901D111320)。
作者简介
第一作者:李顺勇(1975—),男,山西大同人,博士,教授,主要从事统计机器学习方面的教学和研究工作,E-mail:lisy75@sxu.edu.cn。
