A method for fast 1-fold cross validation is proposed for the regularized extreme learning machine （RELM）. The computational time of fast l-fold cross validation increases as the fold number decreases, which is oppo...A method for fast 1-fold cross validation is proposed for the regularized extreme learning machine （RELM）. The computational time of fast l-fold cross validation increases as the fold number decreases, which is opposite to that of naive 1-fold cross validation. As opposed to naive l-fold cross validation, fast l-fold cross validation takes the advantage in terms of computational time, especially for the large fold number such as l 〉 20. To corroborate the efficacy and feasibility of fast l-fold cross validation, experiments on five benchmark regression data sets are evaluated.展开更多
Rock burst is a kind of geological disaster in rock excavation of high stress areas.To evaluate intensity of rock burst,the maximum shear stress,uniaxial compressive strength,uniaxial tensile strength and rock elastic...Rock burst is a kind of geological disaster in rock excavation of high stress areas.To evaluate intensity of rock burst,the maximum shear stress,uniaxial compressive strength,uniaxial tensile strength and rock elastic energy index were selected as input factors,and burst pit depth as output factor.The rock burst prediction model was proposed according to the genetic algorithms and extreme learning machine.The effect of structural surface was taken into consideration.Based on the engineering examples of tunnels,the observed and collected data were divided into the training set,validation set and prediction set.The training set and validation set were used to train and optimize the model.Parameter optimization results are presented.The hidden layer node was450,and the fitness of the predictions was 0.0197 under the optimal combination of the input weight and offset vector.Then,the optimized model is tested with the prediction set.Results show that the proposed model is effective.The maximum relative error is4.71%,and the average relative error is 3.20%,which proves that the model has practical value in the relative engineering.展开更多
Extreme learning machine(ELM)has been proved to be an effective pattern classification and regression learning mechanism by researchers.However,its good performance is based on a large number of hidden layer nodes.Wit...Extreme learning machine(ELM)has been proved to be an effective pattern classification and regression learning mechanism by researchers.However,its good performance is based on a large number of hidden layer nodes.With the increase of the nodes in the hidden layers,the computation cost is greatly increased.In this paper,we propose a novel algorithm,named constrained voting extreme learning machine(CV-ELM).Compared with the traditional ELM,the CV-ELM determines the input weight and bias based on the differences of between-class samples.At the same time,to improve the accuracy of the proposed method,the voting selection is introduced.The proposed method is evaluated on public benchmark datasets.The experimental results show that the proposed algorithm is superior to the original ELM algorithm.Further,we apply the CV-ELM to the classification of superheat degree(SD)state in the aluminum electrolysis industry,and the recognition accuracy rate reaches87.4%,and the experimental results demonstrate that the proposed method is more robust than the existing state-of-the-art identification methods.展开更多
As a new neural network model,extreme learning machine(ELM)has a good learning rate and generalization ability.However,ELM with a single hidden layer structure often fails to achieve good results when faced with large...As a new neural network model,extreme learning machine(ELM)has a good learning rate and generalization ability.However,ELM with a single hidden layer structure often fails to achieve good results when faced with large-scale multi-featured problems.To resolve this problem,we propose a multi-layer framework for the ELM learning algorithm to improve the model’s generalization ability.Moreover,noises or abnormal points often exist in practical applications,and they result in the inability to obtain clean training data.The generalization ability of the original ELM decreases under such circumstances.To address this issue,we add model bias and variance to the loss function so that the model gains the ability to minimize model bias and model variance,thus reducing the influence of noise signals.A new robust multi-layer algorithm called ML-RELM is proposed to enhance outlier robustness in complex datasets.Simulation results show that the method has high generalization ability and strong robustness to noise.展开更多
There are various heterogeneous networks for terminals to deliver a better quality of service. Signal system recognition and classification contribute a lot to the process. However, in low signal to noise ratio（SNR）...There are various heterogeneous networks for terminals to deliver a better quality of service. Signal system recognition and classification contribute a lot to the process. However, in low signal to noise ratio（SNR） circumstances or under time-varying multipath channels, the majority of the existing algorithms for signal recognition are already facing limitations. In this series, we present a robust signal recognition method based upon the original and latest updated version of the extreme learning machine（ELM） to help users to switch between networks. The ELM utilizes signal characteristics to distinguish systems. The superiority of this algorithm lies in the random choices of hidden nodes and in the fact that it determines the output weights analytically, which result in lower complexity. Theoretically, the algorithm tends to offer a good generalization performance at an extremely fast speed of learning. Moreover, we implement the GSM/WCDMA/LTE models in the Matlab environment by using the Simulink tools. The simulations reveal that the signals can be recognized successfully to achieve a 95% accuracy in a low SNR（0 dB） environment in the time-varying multipath Rayleigh fading channel.展开更多
Underground excavation can lead to stress redistribution and result in an excavation damaged zone(EDZ),which is an important factor affecting the excavation stability and support design.Accurately estimating the thick...Underground excavation can lead to stress redistribution and result in an excavation damaged zone(EDZ),which is an important factor affecting the excavation stability and support design.Accurately estimating the thickness of EDZ is essential to ensure the safety of the underground excavation.In this study,four novel hybrid ensemble learning models were developed by optimizing the extreme gradient boosting(XGBoost)and random forest(RF)algorithms through simulated annealing(SA)and Bayesian optimization(BO)approaches,namely SA-XGBoost,SA-RF,BO XGBoost and BO-RF models.A total of 210 cases were collected from Xiangxi Gold Mine in Hunan Province and Fankou Lead-zinc Mine in Guangdong Province,China,including seven input indicators:embedding depth,drift span,uniaxial compressive strength of rock,rock mass rating,unit weight of rock,lateral pressure coefficient of roadway and unit consumption of blasting explosive.The performance of the proposed models was evaluated by the coefficient of determination,root mean squared error,mean absolute error and variance accounted for.The results indicated that the SA-XGBoost model performed best.The Shapley additive explanations method revealed that the embedding depth was the most important indicator.Moreover,the convergence curves suggested that the SA-XGBoost model can reduce the generalization error and avoid overfitting.展开更多
Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel...Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.展开更多
目的本研究旨在构建一个基于临床和影像学特征的极端梯度提升(extreme gradient boosting,XGBoost)模型,以鉴别乳腺非肿块病变的良恶性。材料与方法收集2018年1月至2024年7月2个机构,2种乳腺X线设备检查的有病理结果的首诊乳腺非肿块病...目的本研究旨在构建一个基于临床和影像学特征的极端梯度提升(extreme gradient boosting,XGBoost)模型,以鉴别乳腺非肿块病变的良恶性。材料与方法收集2018年1月至2024年7月2个机构,2种乳腺X线设备检查的有病理结果的首诊乳腺非肿块病变480个。患者被分为建模组[n=310,数字乳腺X线摄影(digital mammography,DM)检查]、内部验证组(n=108,DM检查),和外部验证组[n=62,数字乳腺体层合成摄影(digital breast tomosynthesis,DBT)检查]。记录患者术前乳腺X线(DM或DBT),MRI以及临床特征。采用XGBoost算法和多因素逻辑回归分析,分别构建XGBoost模型和逻辑回归(logistic regression,LR)模型。使用受试者工作特征(receiver operating characteristic,ROC)曲线评估模型的诊断效能。结果在建模组中,患者以7∶3随机分为训练集(n=217)和测试集(n=93)。训练集、测试集、训练集的内部验证组及训练集的外部验证组中,恶性非肿块病灶分别为159(73%)、58(62%)、73(68%)和43(69%)。XGBoost模型的诊断效能明显优于LR模型,在独立的训练集、测试集、训练集的内部验证组及训练集的外部验证组中均表现出良好的诊断效能,曲线下面积(area under the curve,AUC)在0.884~0.913之间。XGBoost模型在四个队列中也表现出良好的校准能力和临床净获益。结论XGBoost模型能够准确鉴别乳腺非肿块病变的良恶性,具有推广应用的潜力。展开更多
基金supported by the National Natural Science Foundation of China(51006052)the NUST Outstanding Scholar Supporting Program
文摘A method for fast 1-fold cross validation is proposed for the regularized extreme learning machine （RELM）. The computational time of fast l-fold cross validation increases as the fold number decreases, which is opposite to that of naive 1-fold cross validation. As opposed to naive l-fold cross validation, fast l-fold cross validation takes the advantage in terms of computational time, especially for the large fold number such as l 〉 20. To corroborate the efficacy and feasibility of fast l-fold cross validation, experiments on five benchmark regression data sets are evaluated.
基金Project(2013CB036004)supported by the National Basic Research Program of ChinaProject(51378510)supported by the National Natural Science Foundation of China
文摘Rock burst is a kind of geological disaster in rock excavation of high stress areas.To evaluate intensity of rock burst,the maximum shear stress,uniaxial compressive strength,uniaxial tensile strength and rock elastic energy index were selected as input factors,and burst pit depth as output factor.The rock burst prediction model was proposed according to the genetic algorithms and extreme learning machine.The effect of structural surface was taken into consideration.Based on the engineering examples of tunnels,the observed and collected data were divided into the training set,validation set and prediction set.The training set and validation set were used to train and optimize the model.Parameter optimization results are presented.The hidden layer node was450,and the fitness of the predictions was 0.0197 under the optimal combination of the input weight and offset vector.Then,the optimized model is tested with the prediction set.Results show that the proposed model is effective.The maximum relative error is4.71%,and the average relative error is 3.20%,which proves that the model has practical value in the relative engineering.
基金supported by the National Natural Science Foundation of China(6177340561751312)the Major Scientific and Technological Innovation Projects of Shandong Province(2019JZZY020123)。
文摘Extreme learning machine(ELM)has been proved to be an effective pattern classification and regression learning mechanism by researchers.However,its good performance is based on a large number of hidden layer nodes.With the increase of the nodes in the hidden layers,the computation cost is greatly increased.In this paper,we propose a novel algorithm,named constrained voting extreme learning machine(CV-ELM).Compared with the traditional ELM,the CV-ELM determines the input weight and bias based on the differences of between-class samples.At the same time,to improve the accuracy of the proposed method,the voting selection is introduced.The proposed method is evaluated on public benchmark datasets.The experimental results show that the proposed algorithm is superior to the original ELM algorithm.Further,we apply the CV-ELM to the classification of superheat degree(SD)state in the aluminum electrolysis industry,and the recognition accuracy rate reaches87.4%,and the experimental results demonstrate that the proposed method is more robust than the existing state-of-the-art identification methods.
基金Project(21878081)supported by the National Natural Science Foundation of ChinaProject(222201917006)supported by the Fundamental Research Funds for the Central Universities,China。
文摘As a new neural network model,extreme learning machine(ELM)has a good learning rate and generalization ability.However,ELM with a single hidden layer structure often fails to achieve good results when faced with large-scale multi-featured problems.To resolve this problem,we propose a multi-layer framework for the ELM learning algorithm to improve the model’s generalization ability.Moreover,noises or abnormal points often exist in practical applications,and they result in the inability to obtain clean training data.The generalization ability of the original ELM decreases under such circumstances.To address this issue,we add model bias and variance to the loss function so that the model gains the ability to minimize model bias and model variance,thus reducing the influence of noise signals.A new robust multi-layer algorithm called ML-RELM is proposed to enhance outlier robustness in complex datasets.Simulation results show that the method has high generalization ability and strong robustness to noise.
基金supported by the National Science and Technology Major Project of the Ministry of Science and Technology of China(2014 ZX03001027)
文摘There are various heterogeneous networks for terminals to deliver a better quality of service. Signal system recognition and classification contribute a lot to the process. However, in low signal to noise ratio（SNR） circumstances or under time-varying multipath channels, the majority of the existing algorithms for signal recognition are already facing limitations. In this series, we present a robust signal recognition method based upon the original and latest updated version of the extreme learning machine（ELM） to help users to switch between networks. The ELM utilizes signal characteristics to distinguish systems. The superiority of this algorithm lies in the random choices of hidden nodes and in the fact that it determines the output weights analytically, which result in lower complexity. Theoretically, the algorithm tends to offer a good generalization performance at an extremely fast speed of learning. Moreover, we implement the GSM/WCDMA/LTE models in the Matlab environment by using the Simulink tools. The simulations reveal that the signals can be recognized successfully to achieve a 95% accuracy in a low SNR（0 dB） environment in the time-varying multipath Rayleigh fading channel.
基金Project(52204117)supported by the National Natural Science Foundation of ChinaProject(2022JJ40601)supported by the Natural Science Foundation of Hunan Province,China。
文摘Underground excavation can lead to stress redistribution and result in an excavation damaged zone(EDZ),which is an important factor affecting the excavation stability and support design.Accurately estimating the thickness of EDZ is essential to ensure the safety of the underground excavation.In this study,four novel hybrid ensemble learning models were developed by optimizing the extreme gradient boosting(XGBoost)and random forest(RF)algorithms through simulated annealing(SA)and Bayesian optimization(BO)approaches,namely SA-XGBoost,SA-RF,BO XGBoost and BO-RF models.A total of 210 cases were collected from Xiangxi Gold Mine in Hunan Province and Fankou Lead-zinc Mine in Guangdong Province,China,including seven input indicators:embedding depth,drift span,uniaxial compressive strength of rock,rock mass rating,unit weight of rock,lateral pressure coefficient of roadway and unit consumption of blasting explosive.The performance of the proposed models was evaluated by the coefficient of determination,root mean squared error,mean absolute error and variance accounted for.The results indicated that the SA-XGBoost model performed best.The Shapley additive explanations method revealed that the embedding depth was the most important indicator.Moreover,the convergence curves suggested that the SA-XGBoost model can reduce the generalization error and avoid overfitting.
基金Sponsored by the National Natural Science Foundation of China(51006052)
文摘Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.
文摘目的本研究旨在构建一个基于临床和影像学特征的极端梯度提升(extreme gradient boosting,XGBoost)模型,以鉴别乳腺非肿块病变的良恶性。材料与方法收集2018年1月至2024年7月2个机构,2种乳腺X线设备检查的有病理结果的首诊乳腺非肿块病变480个。患者被分为建模组[n=310,数字乳腺X线摄影(digital mammography,DM)检查]、内部验证组(n=108,DM检查),和外部验证组[n=62,数字乳腺体层合成摄影(digital breast tomosynthesis,DBT)检查]。记录患者术前乳腺X线(DM或DBT),MRI以及临床特征。采用XGBoost算法和多因素逻辑回归分析,分别构建XGBoost模型和逻辑回归(logistic regression,LR)模型。使用受试者工作特征(receiver operating characteristic,ROC)曲线评估模型的诊断效能。结果在建模组中,患者以7∶3随机分为训练集(n=217)和测试集(n=93)。训练集、测试集、训练集的内部验证组及训练集的外部验证组中,恶性非肿块病灶分别为159(73%)、58(62%)、73(68%)和43(69%)。XGBoost模型的诊断效能明显优于LR模型,在独立的训练集、测试集、训练集的内部验证组及训练集的外部验证组中均表现出良好的诊断效能,曲线下面积(area under the curve,AUC)在0.884~0.913之间。XGBoost模型在四个队列中也表现出良好的校准能力和临床净获益。结论XGBoost模型能够准确鉴别乳腺非肿块病变的良恶性,具有推广应用的潜力。
