As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorit...As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.展开更多
The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in p...The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.展开更多
Rate of penetration(ROP) of a tunnel boring machine(TBM) in a rock environment is generally a key parameter for the successful accomplishment of a tunneling project. The objectives of this work are to compare the accu...Rate of penetration(ROP) of a tunnel boring machine(TBM) in a rock environment is generally a key parameter for the successful accomplishment of a tunneling project. The objectives of this work are to compare the accuracy of prediction models employing partial least squares(PLS) regression and support vector machine(SVM) regression technique for modeling the penetration rate of TBM. To develop the proposed models, the database that is composed of intact rock properties including uniaxial compressive strength(UCS), Brazilian tensile strength(BTS), and peak slope index(PSI), and also rock mass properties including distance between planes of weakness(DPW) and the alpha angle(α) are input as dependent variables and the measured ROP is chosen as an independent variable. Two hundred sets of data are collected from Queens Water Tunnel and Karaj-Tehran water transfer tunnel TBM project. The accuracy of the prediction models is measured by the coefficient of determination(R2) and root mean squares error(RMSE) between predicted and observed yield employing 10-fold cross-validation schemes. The R2 and RMSE of prediction are 0.8183 and 0.1807 for SVMR method, and 0.9999 and 0.0011 for PLS method, respectively. Comparison between the values of statistical parameters reveals the superiority of the PLSR model over SVMR one.展开更多
The predictive model of surface roughness of the spiral bevel gear (SBG) tooth based on the least square support vector machine (LSSVM) was proposed.A nonlinear LSSVM model with radial basis function (RBF) kernel was ...The predictive model of surface roughness of the spiral bevel gear (SBG) tooth based on the least square support vector machine (LSSVM) was proposed.A nonlinear LSSVM model with radial basis function (RBF) kernel was presented and then the experimental setup of PECF system was established.The Taguchi method was introduced to assess the effect of finishing parameters on the gear tooth surface roughness,and the training data was also obtained through experiments.The comparison between the predicted values and the experimental values under the same conditions was carried out.The results show that the predicted values are found to be approximately consistent with the experimental values.The mean absolute percent error (MAPE) is 2.43% for the surface roughness and 2.61% for the applied voltage.展开更多
During the Twelfth Five-Year plan,large-scale construction of smart grid with safe and stable operation requires a timely and accurate short-term load forecasting method.Moreover,along with the full-scale smart grid c...During the Twelfth Five-Year plan,large-scale construction of smart grid with safe and stable operation requires a timely and accurate short-term load forecasting method.Moreover,along with the full-scale smart grid construction,the power supply mode and consumption mode of the whole system can be optimized through the accurate short-term load forecasting;and the security,stability and cleanness of the system can be guaranteed.展开更多
Least squares projection twin support vector machine(LSPTSVM)has faster computing speed than classical least squares support vector machine(LSSVM).However,LSPTSVM is sensitive to outliers and its solution lacks sparsi...Least squares projection twin support vector machine(LSPTSVM)has faster computing speed than classical least squares support vector machine(LSSVM).However,LSPTSVM is sensitive to outliers and its solution lacks sparsity.Therefore,it is difficult for LSPTSVM to process large-scale datasets with outliers.In this paper,we propose a robust LSPTSVM model(called R-LSPTSVM)by applying truncated least squares loss function.The robustness of R-LSPTSVM is proved from a weighted perspective.Furthermore,we obtain the sparse solution of R-LSPTSVM by using the pivoting Cholesky factorization method in primal space.Finally,the sparse R-LSPTSVM algorithm(SR-LSPTSVM)is proposed.Experimental results show that SR-LSPTSVM is insensitive to outliers and can deal with large-scale datasets fastly.展开更多
Numerical simulation has been carried out to investigate the major factors affecting the time of composite regeneration due to coupling cerium-based additive and microwave for diesel particulate f3ilter(DPF). Effect o...Numerical simulation has been carried out to investigate the major factors affecting the time of composite regeneration due to coupling cerium-based additive and microwave for diesel particulate f3ilter(DPF). Effect on the composite regeneration time from various factors such as mass flow rate of exhaust gas, temperature of exhaust gas, oxygen concentration of exhaust gas, microwave power and amount of cerium-based additive are investigated. And a mathematical model based on fuzzy least squares support vector machines has been developed to forecast the endpoint of the composite regeneration. The results show that the relative error of endpoint forecasting model of composite regeneration is less than 3.5%, and the oxygen concentration of exhaust gas has the biggest effect on the endpoint of composite regeneration, followed by the mass flow rate of exhaust gas, the microwave power, the temperature of exhaust gas and the amount of cerium-based additive.展开更多
Solar arrays are important and indispensable parts of spacecraft and provide energy support for spacecraft to operate in orbit and complete on-orbit missions.When a spacecraft is in orbit,because the solar array is ex...Solar arrays are important and indispensable parts of spacecraft and provide energy support for spacecraft to operate in orbit and complete on-orbit missions.When a spacecraft is in orbit,because the solar array is exposed to the harsh space environment,with increasing working time,the performance of its internal electronic components gradually degrade until abnormal damage occurs.This damage makes solar array power generation unable to fully meet the energy demand of a spacecraft.Therefore,timely and accurate detection of solar array anomalies is of great significance for the on-orbit operation and maintenance management of spacecraft.In this paper,we propose an anomaly detection method for spacecraft solar arrays based on the integrated least squares support vector machine(ILS-SVM)model:it selects correlated telemetry data from spacecraft solar arrays to form a training set and extracts n groups of training subsets from this set,then gets n corresponding least squares support vector machine(LS-SVM)submodels by training on these training subsets,respectively;after that,the ILS-SVM model is obtained by integrating these submodels through a weighting operation to increase the prediction accuracy and so on;finally,based on the obtained ILS-SVM model,a parameterfree and unsupervised anomaly determination method is proposed to detect the health status of solar arrays.We use the telemetry data set from a satellite in orbit to carry out experimental verification and find that the proposed method can diagnose solar array anomalies in time and can capture the signs before a solar array anomaly occurs,which reflects the applicability of the method.展开更多
According to the characteristics of large underground caverns, by using the safety factor of surrounding rock mass point as the control standard of cavern stability, RandWPSO-LSSVM optimization feedback method and flo...According to the characteristics of large underground caverns, by using the safety factor of surrounding rock mass point as the control standard of cavern stability, RandWPSO-LSSVM optimization feedback method and flow process of large underground cavern anchor parameters were established. By applying the optimization feedback method to actual project, the best anchor parameters of large surge shaft five-tunnel area underground cavern of the Nuozhadu hydropower station were obtained through optimization. The results show that the predicted effect of LSSVM prediction model obtained through RandWPSO optimization is good, reasonable and reliable. Combination of the best anchor parameters obtained is 114131312, that is, the locked anchor bar spacing is 1 m x 1 m, pre-stress is 100 kN, elevation 580.45-586.50 m section anchor bar diameter is 36.00 mm, length is 4.50 m, spacing is 1.5 m × 2.5 m; anchor bar diameter at the five-tunnel area side wall is 25.00 mm, length is 7.50 m, spacing is 1 m× 1.5 m, and the shotcrete thickness is 0.15 m. The feedback analyses show that the optimization feedback method of large underground cavern anchor parameters is reasonable and reliable, which has important guiding significance for ensuring the stability of large underground caverns and for saving project investment.展开更多
To make full use of the gas resource, stabilize the pipe network pressure, and obtain higher economic benefits in the iron and steel industry, the surplus gas prediction and scheduling models were proposed. Before app...To make full use of the gas resource, stabilize the pipe network pressure, and obtain higher economic benefits in the iron and steel industry, the surplus gas prediction and scheduling models were proposed. Before applying the forecasting techniques, a support vector classifier was first used to classify the data, and then the filtering was used to create separate trend and volatility sequences. After forecasting, the Markov chain transition probability matrix was introduced to adjust the residual. Simulation results using surplus gas data from an iron and steel enterprise demonstrate that the constructed SVC-HP-ENN-LSSVM-MC prediction model prediction is accurate, and that the classification accuracy is high under different conditions. Based on this, the scheduling model was constructed for surplus gas operating, and it has been used to investigate the comprehensive measures for managing the operational probabilistic risk and optimize the economic benefit at various working conditions and implementations. It has extended the concepts of traditional surplus gas dispatching systems, and provides a method for enterprises to determine optimal schedules.展开更多
Aimed at uncertainties and model's impreciseness, nonlinearity and time-variability of depth control system in autonomous underwater vehicle (AUV), a depth predictive control method was put forward based on rough ...Aimed at uncertainties and model's impreciseness, nonlinearity and time-variability of depth control system in autonomous underwater vehicle (AUV), a depth predictive control method was put forward based on rough set (RS) and least squares support vector machine (LSSVM). By using RS theory, the monitor data attribute of AUV was reduced to eliminate the redundant information and to improve efficiency. Then, LSSVM model was trained by using the reduced rules, and its parameters were optimized by using chaos theory for the higher accurate control. Taken an AUV typed NPS Phoenix as an example, its depth step response, horizontal rudder and pitch change were simulated. The simulation results show that the method improves the model's accuracy and has better real-time response, fault-tolerant ability, reliability and strong anti-interfere capability.展开更多
基金supported by the National Natural Science Foundation of China (61074127)
文摘As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.
基金supported by the National Natural Science Foundation of China(50576033)
文摘The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.
基金Project(2010CB732004)supported by the National Basic Research Program of ChinaProjects(50934006,41272304)supported by the National Natural Science Foundation of China
文摘Rate of penetration(ROP) of a tunnel boring machine(TBM) in a rock environment is generally a key parameter for the successful accomplishment of a tunneling project. The objectives of this work are to compare the accuracy of prediction models employing partial least squares(PLS) regression and support vector machine(SVM) regression technique for modeling the penetration rate of TBM. To develop the proposed models, the database that is composed of intact rock properties including uniaxial compressive strength(UCS), Brazilian tensile strength(BTS), and peak slope index(PSI), and also rock mass properties including distance between planes of weakness(DPW) and the alpha angle(α) are input as dependent variables and the measured ROP is chosen as an independent variable. Two hundred sets of data are collected from Queens Water Tunnel and Karaj-Tehran water transfer tunnel TBM project. The accuracy of the prediction models is measured by the coefficient of determination(R2) and root mean squares error(RMSE) between predicted and observed yield employing 10-fold cross-validation schemes. The R2 and RMSE of prediction are 0.8183 and 0.1807 for SVMR method, and 0.9999 and 0.0011 for PLS method, respectively. Comparison between the values of statistical parameters reveals the superiority of the PLSR model over SVMR one.
基金Project(90923022) supported by the National Natural Science Foundation of ChinaProject(2009220022) supported by Liaoning Science and Technology Foundation,China
文摘The predictive model of surface roughness of the spiral bevel gear (SBG) tooth based on the least square support vector machine (LSSVM) was proposed.A nonlinear LSSVM model with radial basis function (RBF) kernel was presented and then the experimental setup of PECF system was established.The Taguchi method was introduced to assess the effect of finishing parameters on the gear tooth surface roughness,and the training data was also obtained through experiments.The comparison between the predicted values and the experimental values under the same conditions was carried out.The results show that the predicted values are found to be approximately consistent with the experimental values.The mean absolute percent error (MAPE) is 2.43% for the surface roughness and 2.61% for the applied voltage.
文摘During the Twelfth Five-Year plan,large-scale construction of smart grid with safe and stable operation requires a timely and accurate short-term load forecasting method.Moreover,along with the full-scale smart grid construction,the power supply mode and consumption mode of the whole system can be optimized through the accurate short-term load forecasting;and the security,stability and cleanness of the system can be guaranteed.
基金supported by the National Natural Science Foundation of China(6177202062202433+4 种基金621723716227242262036010)the Natural Science Foundation of Henan Province(22100002)the Postdoctoral Research Grant in Henan Province(202103111)。
文摘Least squares projection twin support vector machine(LSPTSVM)has faster computing speed than classical least squares support vector machine(LSSVM).However,LSPTSVM is sensitive to outliers and its solution lacks sparsity.Therefore,it is difficult for LSPTSVM to process large-scale datasets with outliers.In this paper,we propose a robust LSPTSVM model(called R-LSPTSVM)by applying truncated least squares loss function.The robustness of R-LSPTSVM is proved from a weighted perspective.Furthermore,we obtain the sparse solution of R-LSPTSVM by using the pivoting Cholesky factorization method in primal space.Finally,the sparse R-LSPTSVM algorithm(SR-LSPTSVM)is proposed.Experimental results show that SR-LSPTSVM is insensitive to outliers and can deal with large-scale datasets fastly.
基金Projects(51176045,51276056)supported by the National Natural Science Foundation of ChinaProject(201208430262)supported by the National Studying Abroad Foundation Project of China
文摘Numerical simulation has been carried out to investigate the major factors affecting the time of composite regeneration due to coupling cerium-based additive and microwave for diesel particulate f3ilter(DPF). Effect on the composite regeneration time from various factors such as mass flow rate of exhaust gas, temperature of exhaust gas, oxygen concentration of exhaust gas, microwave power and amount of cerium-based additive are investigated. And a mathematical model based on fuzzy least squares support vector machines has been developed to forecast the endpoint of the composite regeneration. The results show that the relative error of endpoint forecasting model of composite regeneration is less than 3.5%, and the oxygen concentration of exhaust gas has the biggest effect on the endpoint of composite regeneration, followed by the mass flow rate of exhaust gas, the microwave power, the temperature of exhaust gas and the amount of cerium-based additive.
基金supported by the National Natural Science Foundation of China(7190121061973310).
文摘Solar arrays are important and indispensable parts of spacecraft and provide energy support for spacecraft to operate in orbit and complete on-orbit missions.When a spacecraft is in orbit,because the solar array is exposed to the harsh space environment,with increasing working time,the performance of its internal electronic components gradually degrade until abnormal damage occurs.This damage makes solar array power generation unable to fully meet the energy demand of a spacecraft.Therefore,timely and accurate detection of solar array anomalies is of great significance for the on-orbit operation and maintenance management of spacecraft.In this paper,we propose an anomaly detection method for spacecraft solar arrays based on the integrated least squares support vector machine(ILS-SVM)model:it selects correlated telemetry data from spacecraft solar arrays to form a training set and extracts n groups of training subsets from this set,then gets n corresponding least squares support vector machine(LS-SVM)submodels by training on these training subsets,respectively;after that,the ILS-SVM model is obtained by integrating these submodels through a weighting operation to increase the prediction accuracy and so on;finally,based on the obtained ILS-SVM model,a parameterfree and unsupervised anomaly determination method is proposed to detect the health status of solar arrays.We use the telemetry data set from a satellite in orbit to carry out experimental verification and find that the proposed method can diagnose solar array anomalies in time and can capture the signs before a solar array anomaly occurs,which reflects the applicability of the method.
基金Project(50911130366) supported by the National Natural Science Foundation of China
文摘According to the characteristics of large underground caverns, by using the safety factor of surrounding rock mass point as the control standard of cavern stability, RandWPSO-LSSVM optimization feedback method and flow process of large underground cavern anchor parameters were established. By applying the optimization feedback method to actual project, the best anchor parameters of large surge shaft five-tunnel area underground cavern of the Nuozhadu hydropower station were obtained through optimization. The results show that the predicted effect of LSSVM prediction model obtained through RandWPSO optimization is good, reasonable and reliable. Combination of the best anchor parameters obtained is 114131312, that is, the locked anchor bar spacing is 1 m x 1 m, pre-stress is 100 kN, elevation 580.45-586.50 m section anchor bar diameter is 36.00 mm, length is 4.50 m, spacing is 1.5 m × 2.5 m; anchor bar diameter at the five-tunnel area side wall is 25.00 mm, length is 7.50 m, spacing is 1 m× 1.5 m, and the shotcrete thickness is 0.15 m. The feedback analyses show that the optimization feedback method of large underground cavern anchor parameters is reasonable and reliable, which has important guiding significance for ensuring the stability of large underground caverns and for saving project investment.
基金Project(51204082)supported by the National Natural Science Foundation of ChinaProject(KKSY201458118)supported by the Talent Cultivation Project of Kuning University of Science and Technology,China
文摘To make full use of the gas resource, stabilize the pipe network pressure, and obtain higher economic benefits in the iron and steel industry, the surplus gas prediction and scheduling models were proposed. Before applying the forecasting techniques, a support vector classifier was first used to classify the data, and then the filtering was used to create separate trend and volatility sequences. After forecasting, the Markov chain transition probability matrix was introduced to adjust the residual. Simulation results using surplus gas data from an iron and steel enterprise demonstrate that the constructed SVC-HP-ENN-LSSVM-MC prediction model prediction is accurate, and that the classification accuracy is high under different conditions. Based on this, the scheduling model was constructed for surplus gas operating, and it has been used to investigate the comprehensive measures for managing the operational probabilistic risk and optimize the economic benefit at various working conditions and implementations. It has extended the concepts of traditional surplus gas dispatching systems, and provides a method for enterprises to determine optimal schedules.
文摘Aimed at uncertainties and model's impreciseness, nonlinearity and time-variability of depth control system in autonomous underwater vehicle (AUV), a depth predictive control method was put forward based on rough set (RS) and least squares support vector machine (LSSVM). By using RS theory, the monitor data attribute of AUV was reduced to eliminate the redundant information and to improve efficiency. Then, LSSVM model was trained by using the reduced rules, and its parameters were optimized by using chaos theory for the higher accurate control. Taken an AUV typed NPS Phoenix as an example, its depth step response, horizontal rudder and pitch change were simulated. The simulation results show that the method improves the model's accuracy and has better real-time response, fault-tolerant ability, reliability and strong anti-interfere capability.
