As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorit...As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.展开更多
The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in p...The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.展开更多
建立准确的滚动轴承性能退化预测模型对于轴承故障分类、寿命预测等后续处理有着至关重要的作用。为了解决轴承性能退化模型预测不准确的问题,提出了一种改进的蝙蝠算法(improvement bat algorithm,IBA)来提高退化模型预测的准确度。首...建立准确的滚动轴承性能退化预测模型对于轴承故障分类、寿命预测等后续处理有着至关重要的作用。为了解决轴承性能退化模型预测不准确的问题,提出了一种改进的蝙蝠算法(improvement bat algorithm,IBA)来提高退化模型预测的准确度。首先将Cat混沌映射应用到种群初始位置,增强种群的遍历性,提高初始解的质量;其次在迭代过程中加入类反正切控制因子,提高算法寻优精度;最后改进位置更新策略,防止陷入局部最优。通过与蝙蝠算法(bat algorithm,BA)优化的支持向量回归机(support vector regression,SVR)、粒子群优化算法优化的SVR和灰狼优化算法优化的SVR所得的结果做对比,结果表明:IBA所优化预测模型的均值绝对误差分别下降了70.60%、67.19%、55.56%,均方根误差分别下降了76.64%、76.12%、30.29%,进一步证明了改进后的预测模型的准确性。展开更多
为了提高渔业数据单位捕捞努力量渔获量(catch per unite of effort,CPUE)标准化数据的质量和模型连续稳定预测能力,该文采用人工神经网络(artificial neural network,ANN)、回归树(regression trees,RT)、随机森林(random forest,RF)...为了提高渔业数据单位捕捞努力量渔获量(catch per unite of effort,CPUE)标准化数据的质量和模型连续稳定预测能力,该文采用人工神经网络(artificial neural network,ANN)、回归树(regression trees,RT)、随机森林(random forest,RF)和支持向量机(support vector machine,SVM)等机器学习方法和传统的广义线性模型(generalized linear model,GLM)等方法,对2000-2013年大西洋大眼金枪鱼(Thunnus obesus)延绳钓CPUE数据进行标准化。采用平均绝对误差、平均均方误差、3种相关系数(Pearson’s,Kendall’s和Spearman’s)和标准化均方误差等评价指标对不同模型标准化结果进行对比,寻找较优的标准化方法。研究结果表明,在验证数据集SVM方法得到的3种相关系数(0.596,0473和0.632)和RF(0.623,0.456,0.621)相似,高于RT(0.516,0.432和0.586)、ANN(0.428,0.249和0.365)和GLM(0.199,0.106和0.159)。SVM预测的均方误差(11.25)、平均绝对误差(2.107)和标准化均方误差(0.652)略低于RF(11.655,2.377和0.661),明显低于RT(14.999,2.434和0.801)、ANN(16.692,2.883和0.823)和GLM(16.517,2.777和0.993)。各项指标揭示SVM方法要优于其他4种方法,RF次之,GLM计算结果在所有方法中最差,不适合渔业数据CPUE标准化。SVM和RF方法应该被优先考虑用于渔业数据CPUE标准化。研究结果为渔业资源管理和保护提供更好的支持。展开更多
基金supported by the National Natural Science Foundation of China (61074127)
文摘As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.
基金supported by the National Natural Science Foundation of China(50576033)
文摘The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.
文摘为了提高渔业数据单位捕捞努力量渔获量(catch per unite of effort,CPUE)标准化数据的质量和模型连续稳定预测能力,该文采用人工神经网络(artificial neural network,ANN)、回归树(regression trees,RT)、随机森林(random forest,RF)和支持向量机(support vector machine,SVM)等机器学习方法和传统的广义线性模型(generalized linear model,GLM)等方法,对2000-2013年大西洋大眼金枪鱼(Thunnus obesus)延绳钓CPUE数据进行标准化。采用平均绝对误差、平均均方误差、3种相关系数(Pearson’s,Kendall’s和Spearman’s)和标准化均方误差等评价指标对不同模型标准化结果进行对比,寻找较优的标准化方法。研究结果表明,在验证数据集SVM方法得到的3种相关系数(0.596,0473和0.632)和RF(0.623,0.456,0.621)相似,高于RT(0.516,0.432和0.586)、ANN(0.428,0.249和0.365)和GLM(0.199,0.106和0.159)。SVM预测的均方误差(11.25)、平均绝对误差(2.107)和标准化均方误差(0.652)略低于RF(11.655,2.377和0.661),明显低于RT(14.999,2.434和0.801)、ANN(16.692,2.883和0.823)和GLM(16.517,2.777和0.993)。各项指标揭示SVM方法要优于其他4种方法,RF次之,GLM计算结果在所有方法中最差,不适合渔业数据CPUE标准化。SVM和RF方法应该被优先考虑用于渔业数据CPUE标准化。研究结果为渔业资源管理和保护提供更好的支持。
