To overcome the disadvantage that the standard least squares support vector regression(LS-SVR) algorithm is not suitable to multiple-input multiple-output(MIMO) system modelling directly,an improved LS-SVR algorithm w...To overcome the disadvantage that the standard least squares support vector regression(LS-SVR) algorithm is not suitable to multiple-input multiple-output(MIMO) system modelling directly,an improved LS-SVR algorithm which was defined as multi-output least squares support vector regression(MLSSVR) was put forward by adding samples' absolute errors in objective function and applied to flatness intelligent control.To solve the poor-precision problem of the control scheme based on effective matrix in flatness control,the predictive control was introduced into the control system and the effective matrix-predictive flatness control method was proposed by combining the merits of the two methods.Simulation experiment was conducted on 900HC reversible cold roll.The performance of effective matrix method and the effective matrix-predictive control method were compared,and the results demonstrate the validity of the effective matrix-predictive control method.展开更多
As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorit...As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.展开更多
With the development of technology, the relevant performance of unmanned aerial vehicles(UAVs) has been greatly improved, and various highly maneuverable UAVs have been developed, which puts forward higher requirement...With the development of technology, the relevant performance of unmanned aerial vehicles(UAVs) has been greatly improved, and various highly maneuverable UAVs have been developed, which puts forward higher requirements on target tracking technology. Strong maneuvering refers to relatively instantaneous and dramatic changes in target acceleration or movement patterns, as well as continuous changes in speed,angle, and acceleration. However, the traditional UAV tracking algorithm model has poor adaptability and large amount of calculation. This paper applies support vector regression(SVR)to the interacting multiple model(IMM) algorithm. The simulation results show that the improved algorithm has higher tracking accuracy for highly maneuverable targets than the original algorithm, and can adjust parameters adaptively, making it more adaptable.展开更多
Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-...Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.展开更多
Support vector regression （SVR） method is a novel type of learning machine algorithms, which is seldom applied to the development of urban atmospheric quality models under multiple socio-economic factors. This study...Support vector regression （SVR） method is a novel type of learning machine algorithms, which is seldom applied to the development of urban atmospheric quality models under multiple socio-economic factors. This study presents four SVR models by selecting linear, radial basis, spline, and polynomial functions as kernels, respectively for the prediction of urban dust fall levels. The inputs of the models are identified as industrial coal consumption, population density, traffic flow coefficient, and shopping density coefficient. The training and testing results show that the SVR model with radial basis kernel performs better than the other three both in the training and testing processes. In addition, a number of scenario analyses reveal that the most suitable parameters （insensitive loss function e, the parameter to reduce the influence of error C, and discrete level or average distribution of parameters σ） are 0.001, 0.5, and 2 000, respectively.展开更多
As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonl...As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonlinear effectiveness evaluation under small sample conditions,we propose an evaluation method based on support vector regression(SVR)to effectively address the defects of traditional methods.Considering the performance of SVR is influenced by the penalty factor,kernel type,and other parameters deeply,the improved grey wolf optimizer(IGWO)is employed for parameter optimization.In the proposed IGWO algorithm,the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima,the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence.Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization.The index system and evaluation method are constructed based on the characteristics of RSS.To validate the proposed IGWO-SVR evaluation method,eight benchmark data sets and combat simulation are employed to estimate the evaluation accuracy,convergence performance and computational complexity.According to the experimental results,the proposed method outperforms several prediction based evaluation methods,verifies the superiority and effectiveness in RSS operational effectiveness evaluation.展开更多
A novel method for developing a reliable data driven soft sensor to improve the prediction accuracy of sulfur content in hydrodesulfurization(HDS) process was proposed. Therefore, an integrated approach using support ...A novel method for developing a reliable data driven soft sensor to improve the prediction accuracy of sulfur content in hydrodesulfurization(HDS) process was proposed. Therefore, an integrated approach using support vector regression(SVR) based on wavelet transform(WT) and principal component analysis(PCA) was used. Experimental data from the HDS setup were employed to validate the proposed model. The results reveal that the integrated WT-PCA with SVR model was able to increase the prediction accuracy of SVR model. Implementation of the proposed model delivers the best satisfactory predicting performance(EAARE=0.058 and R2=0.97) in comparison with SVR. The obtained results indicate that the proposed model is more reliable and more precise than the multiple linear regression(MLR), SVR and PCA-SVR.展开更多
Least square support vector regression(LSSVR)is a method for function approximation,whose solutions are typically non-sparse,which limits its application especially in some occasions of fast prediction.In this paper,a...Least square support vector regression(LSSVR)is a method for function approximation,whose solutions are typically non-sparse,which limits its application especially in some occasions of fast prediction.In this paper,a sparse algorithm for adaptive pruning LSSVR algorithm based on global representative point ranking(GRPR-AP-LSSVR)is proposed.At first,the global representative point ranking(GRPR)algorithm is given,and relevant data analysis experiment is implemented which depicts the importance ranking of data points.Furthermore,the pruning strategy of removing two samples in the decremental learning procedure is designed to accelerate the training speed and ensure the sparsity.The removed data points are utilized to test the temporary learning model which ensures the regression accuracy.Finally,the proposed algorithm is verified on artificial datasets and UCI regression datasets,and experimental results indicate that,compared with several benchmark algorithms,the GRPR-AP-LSSVR algorithm has excellent sparsity and prediction speed without impairing the generalization performance.展开更多
The computational cost of support vector regression in the training phase is O （N^3）, which is very expensive for a large scale problem. In addition, the solution of support vector regression is of parsimoniousness,...The computational cost of support vector regression in the training phase is O （N^3）, which is very expensive for a large scale problem. In addition, the solution of support vector regression is of parsimoniousness, which has relation to a part of the whole training data set. Hence, it is reasonable to reduce the training data set. Aiming at the scheme based on k-nearest neighbors to reduce the training data set with the computational complexity O （kMN^2）, an improved scheme is proposed to accelerate the reducing phase, which cuts down the computational complexity from O （kMN^2） to O （MN^2）. Finally, experimental results on benchmark data sets validate the effectiveness of the improved scheme.展开更多
The electromagnetic scattering computation has developed rapidly for many years; some computing problems for complex and coated targets cannot be solved by using the existing theory and computing models. A computing m...The electromagnetic scattering computation has developed rapidly for many years; some computing problems for complex and coated targets cannot be solved by using the existing theory and computing models. A computing model based on data is established for making up the insufficiency of theoretic models. Based on the ＂support vector regression method＂, which is formulated on the principle of minimizing a structural risk, a data model to predicate the unknown radar cross section of some appointed targets is given. Comparison between the actual data and the results of this predicting model based on support vector regression method proved that the support vector regression method is workable and with a comparative precision.展开更多
The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in p...The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.展开更多
An on-line forecasting model based on self-tuning support vectors regression for zinc output was put forward to maximize zinc output by adjusting operational parameters in the process of imperial smelting furnace. In ...An on-line forecasting model based on self-tuning support vectors regression for zinc output was put forward to maximize zinc output by adjusting operational parameters in the process of imperial smelting furnace. In this model, the mathematical model of support vector regression was converted into the same format as support vector machine for classification. Then a simplified sequential minimal optimization for classification was applied to train the regression coefficient vector α- α* and threshold b. Sequentially penalty parameter C was tuned dynamically through forecasting result during the training process. Finally, an on-line forecasting algorithm for zinc output was proposed. The simulation result shows that in spite of a relatively small industrial data set, the effective error is less than 10% with a remarkable performance of real time. The model was applied to the optimization operation and fault diagnosis system for imperial smelting furnace.展开更多
Zirconium,titanium,and other hexagonally close-packed(HCP)metals and their alloys are representative high specific strength,high reaction enthalpy,and high thermal conductivity structural materials.In this study,two t...Zirconium,titanium,and other hexagonally close-packed(HCP)metals and their alloys are representative high specific strength,high reaction enthalpy,and high thermal conductivity structural materials.In this study,two typical HCP metals,zirconium,and titanium,were applied to reactive materials(RMs)to prepare Zr/PTFE/W RMs and Ti/PTFE/W RMs,validating the feasibility of HCP metal/PTFE/W RMs.The impact response process of typical HCP metal/PTFE/W RMs under high-velocity dynamic loads was studied using shock equations of state(EOS)based on porous mixtures and chemical reaction kinetics equations.An improved hemispherical quasi-sealed test chamber was employed to measure the energy release characteristic curves of 10 types of Zr/PTFE/W RMs and Ti/PTFE/W RMs under impact velocities ranging from 500 m/s to 1300 m/s.The datasets of the impact-induced energy release characteristics of HCP metal/PTFE/W RMs were established.Additionally,the energy release efficiency of HCP metal/PTFE/W RMs under impact was predicted using the support vector regression(SVR)kernel function model.The datasets of Zr/PTFE/W RMs and Ti/PTFE/W RMs with W contents of 0%,25%,50%,and 75%were used as test sets,respectively.The model predictions showed a high degree of agreement with the experimental data,with mean absolute errors(MAE)of 4.8,6.5,4.6,and 4.1,respectively.展开更多
Aiming at the problem that the traditional Unscented Kalman Filtering(UKF) algorithm can't solve the problem that the measurement covariance matrix is unknown and the measured value contains outliers,this paper pr...Aiming at the problem that the traditional Unscented Kalman Filtering(UKF) algorithm can't solve the problem that the measurement covariance matrix is unknown and the measured value contains outliers,this paper proposes a robust adaptive UKF algorithm based on Support Vector Regression(SVR).The algorithm combines the advantages of support vector regression with small samples,nonlinear learning ability and online estimation capability of adaptive algorithm based on innovation.Firstly,the SVR model is trained by using the innovation in the sliding window,and the new innovation is monitored.If the deviation between the estimated innovation and the measured innovation exceeds a given threshold,then measured innovation will be replaced by the predicted innovation,and then the processed innovation is used to calculate the measurement noise covariance matrix using the adaptive estimation algorithm.Simulation experiments and measured data experiments show that SVRUKF is significantly better than the traditional UKF,robust UKF and adaptive UKF algorithms for the case where the covariance matrix is unknown and the measured values have outliers.展开更多
Considering the modeling errors of on-board self-tuning model in the fault diagnosis of aero-engine, a new mechanism for compensating the model outputs is proposed. A discrete series predictor based on multi-outputs l...Considering the modeling errors of on-board self-tuning model in the fault diagnosis of aero-engine, a new mechanism for compensating the model outputs is proposed. A discrete series predictor based on multi-outputs least square support vector regression （LSSVR） is applied to the compensation of on-board self-tuning model of aero-engine, and particle swarm optimization （PSO） is used to the kernels selection of multi-outputs LSSVR. The method need not reconstruct the model of aero-engine because of the differences in the individuals of the same type engines and engine degradation after use. The concrete steps for the application of the method are given, and the simulation results show the effectiveness of the algorithm.展开更多
In order to establish the baseline finite element model for structural health monitoring,a new method of model updating was proposed after analyzing the uncertainties of measured data and the error of finite element m...In order to establish the baseline finite element model for structural health monitoring,a new method of model updating was proposed after analyzing the uncertainties of measured data and the error of finite element model.In the new method,the finite element model was replaced by the multi-output support vector regression machine(MSVR).The interval variables of the measured frequency were sampled by Latin hypercube sampling method.The samples of frequency were regarded as the inputs of the trained MSVR.The outputs of MSVR were the target values of design parameters.The steel structure of National Aquatic Center for Beijing Olympic Games was introduced as a case for finite element model updating.The results show that the proposed method can avoid solving the problem of complicated calculation.Both the estimated values and associated uncertainties of the structure parameters can be obtained by the method.The static and dynamic characteristics of the updated finite element model are in good agreement with the measured data.展开更多
Due to the nonlinearity and nonstationary of hydropower market data, a novel hybrid learning paradigm is proposed to predict hydropower consumption, by incorporating firefly algorithm （FA） into least square support ...Due to the nonlinearity and nonstationary of hydropower market data, a novel hybrid learning paradigm is proposed to predict hydropower consumption, by incorporating firefly algorithm （FA） into least square support vector regression （LSSVR）, i.e., FA-based LSSVR model. In the novel model, the powerful and effective artificial intelligence （AI） technique, i.e., LSSVR, is employed to forecast hydropower consumption. Furthermore, a promising AI optimization tool, i.e., FA, is espe- cially introduced to address the crucial but difficult task of parameters determination in LSSVR （e.g., hyper and kernel function parameters）. With the Chinese hydropower consumption as sample data, the empirical study has statistically confirmed the superiority of the novel FA-based LSSVR model to other benchmark models （including existing popular traditional econometric models, AI models and similar hybrid LSSVRs with other popular parameter searching tools）~ in terms of level and direc- tional accuracy. The empirical results also imply that the hybrid FA-based LSSVR learning paradigm with powerful forecasting tool and parameters optimization method can be employed as an effective forecasting tool for not only hydropower consumption but also other complex data.展开更多
Short-term forecasting is a difficult problem because of the influence of non-linear factors and irregular events.A novel short-term forecasting method named TIK was proposed,in which ARMA forecasting model was used t...Short-term forecasting is a difficult problem because of the influence of non-linear factors and irregular events.A novel short-term forecasting method named TIK was proposed,in which ARMA forecasting model was used to consider the load time series trend forecasting,intelligence forecasting DESVR model was applied to estimate the non-linear influence,and knowledge mining methods were applied to correct the errors caused by irregular events.In order to prove the effectiveness of the proposed model,an application of the daily maximum load forecasting was evaluated.The experimental results show that the DESVR model improves the mean absolute percentage error(MAPE) from 2.82% to 2.55%,and the knowledge rules can improve the MAPE from 2.55% to 2.30%.Compared with the single ARMA forecasting method and ARMA combined SVR forecasting method,it can be proved that TIK method gains the best performance in short-term load forecasting.展开更多
Sale prediction plays a significant role in business management. By using support vector machine Regression （ε-SVR）, a method using to predict sale is illustrated. It takes historical data and current context data ...Sale prediction plays a significant role in business management. By using support vector machine Regression （ε-SVR）, a method using to predict sale is illustrated. It takes historical data and current context data as inputs and presents results, i.e. sale tendency in the future and the forecasting sales, according to the user＇s specification of accuracy and time cycles. Some practical data experiments and the comparative tests with other algorithms show the advantages of the proposed approach in computation time and correctness.展开更多
Objective speech quality is difficult to be measured without the input reference speech.Mapping methods using data mining are investigated and designed to improve the output-based speech quality assessment algorithm.T...Objective speech quality is difficult to be measured without the input reference speech.Mapping methods using data mining are investigated and designed to improve the output-based speech quality assessment algorithm.The degraded speech is firstly separated into three classes(unvoiced,voiced and silence),and then the consistency measurement between the degraded speech signal and the pre-trained reference model for each class is calculated and mapped to an objective speech quality score using data mining.Fuzzy Gaussian mixture model(GMM)is used to generate the artificial reference model trained on perceptual linear predictive(PLP)features.The mean opinion score(MOS)mapping methods including multivariate non-linear regression(MNLR),fuzzy neural network(FNN)and support vector regression(SVR)are designed and compared with the standard ITU-T P.563 method.Experimental results show that the assessment methods with data mining perform better than ITU-T P.563.Moreover,FNN and SVR are more efficient than MNLR,and FNN performs best with 14.50% increase in the correlation coefficient and 32.76% decrease in the root-mean-square MOS error.展开更多
基金Project(50675186) supported by the National Natural Science Foundation of China
文摘To overcome the disadvantage that the standard least squares support vector regression(LS-SVR) algorithm is not suitable to multiple-input multiple-output(MIMO) system modelling directly,an improved LS-SVR algorithm which was defined as multi-output least squares support vector regression(MLSSVR) was put forward by adding samples' absolute errors in objective function and applied to flatness intelligent control.To solve the poor-precision problem of the control scheme based on effective matrix in flatness control,the predictive control was introduced into the control system and the effective matrix-predictive flatness control method was proposed by combining the merits of the two methods.Simulation experiment was conducted on 900HC reversible cold roll.The performance of effective matrix method and the effective matrix-predictive control method were compared,and the results demonstrate the validity of the effective matrix-predictive control method.
基金supported by the National Natural Science Foundation of China (61074127)
文摘As the solutions of the least squares support vector regression machine （LS-SVRM） are not sparse, it leads to slow prediction speed and limits its applications. The defects of the ex- isting adaptive pruning algorithm for LS-SVRM are that the training speed is slow, and the generalization performance is not satis- factory, especially for large scale problems. Hence an improved algorithm is proposed. In order to accelerate the training speed, the pruned data point and fast leave-one-out error are employed to validate the temporary model obtained after decremental learning. The novel objective function in the termination condition which in- volves the whole constraints generated by all training data points and three pruning strategies are employed to improve the generali- zation performance. The effectiveness of the proposed algorithm is tested on six benchmark datasets. The sparse LS-SVRM model has a faster training speed and better generalization performance.
基金supported by the Foundation of Key Laboratory of Near-Surface。
文摘With the development of technology, the relevant performance of unmanned aerial vehicles(UAVs) has been greatly improved, and various highly maneuverable UAVs have been developed, which puts forward higher requirements on target tracking technology. Strong maneuvering refers to relatively instantaneous and dramatic changes in target acceleration or movement patterns, as well as continuous changes in speed,angle, and acceleration. However, the traditional UAV tracking algorithm model has poor adaptability and large amount of calculation. This paper applies support vector regression(SVR)to the interacting multiple model(IMM) algorithm. The simulation results show that the improved algorithm has higher tracking accuracy for highly maneuverable targets than the original algorithm, and can adjust parameters adaptively, making it more adaptable.
基金supported by the National Natural Science Foundation of China(61172127)the Natural Science Foundation of Anhui Province(1408085MF121)
文摘Removal of cloud cover on the satellite remote sensing image can effectively improve the availability of remote sensing images. For thin cloud cover, support vector value contourlet transform is used to achieve multi-scale decomposition of the area of thin cloud cover on remote sensing images. Through enhancing coefficients of high frequency and suppressing coefficients of low frequency, the thin cloud is removed. For thick cloud cover, if the areas of thick cloud cover on multi-source or multi-temporal remote sensing images do not overlap, the multi-output support vector regression learning method is used to remove this kind of thick clouds. If the thick cloud cover areas overlap, by using the multi-output learning of the surrounding areas to predict the surface features of the overlapped thick cloud cover areas, this kind of thick cloud is removed. Experimental results show that the proposed cloud removal method can effectively solve the problems of the cloud overlapping and radiation difference among multi-source images. The cloud removal image is clear and smooth.
基金Projects(2007JT3018, 2008JT1013, 2009FJ4056) supported by the Key Project in Hunan Science and Technology Program, ChinaProject(20090161120014) supported by the New Teachers Sustentation Fund in Doctoral Program, Ministry of Education, China
文摘Support vector regression （SVR） method is a novel type of learning machine algorithms, which is seldom applied to the development of urban atmospheric quality models under multiple socio-economic factors. This study presents four SVR models by selecting linear, radial basis, spline, and polynomial functions as kernels, respectively for the prediction of urban dust fall levels. The inputs of the models are identified as industrial coal consumption, population density, traffic flow coefficient, and shopping density coefficient. The training and testing results show that the SVR model with radial basis kernel performs better than the other three both in the training and testing processes. In addition, a number of scenario analyses reveal that the most suitable parameters （insensitive loss function e, the parameter to reduce the influence of error C, and discrete level or average distribution of parameters σ） are 0.001, 0.5, and 2 000, respectively.
基金the National Defense Science and Technology Key Laboratory Fund of China(XM2020XT1023).
文摘As one of the most important part of weapon system of systems(WSoS),quantitative evaluation of reconnaissance satellite system(RSS)is indispensable during its construction and application.Aiming at the problem of nonlinear effectiveness evaluation under small sample conditions,we propose an evaluation method based on support vector regression(SVR)to effectively address the defects of traditional methods.Considering the performance of SVR is influenced by the penalty factor,kernel type,and other parameters deeply,the improved grey wolf optimizer(IGWO)is employed for parameter optimization.In the proposed IGWO algorithm,the opposition-based learning strategy is adopted to increase the probability of avoiding the local optima,the mutation operator is used to escape from premature convergence and differential convergence factors are applied to increase the rate of convergence.Numerical experiments of 14 test functions validate the applicability of IGWO algorithm dealing with global optimization.The index system and evaluation method are constructed based on the characteristics of RSS.To validate the proposed IGWO-SVR evaluation method,eight benchmark data sets and combat simulation are employed to estimate the evaluation accuracy,convergence performance and computational complexity.According to the experimental results,the proposed method outperforms several prediction based evaluation methods,verifies the superiority and effectiveness in RSS operational effectiveness evaluation.
文摘A novel method for developing a reliable data driven soft sensor to improve the prediction accuracy of sulfur content in hydrodesulfurization(HDS) process was proposed. Therefore, an integrated approach using support vector regression(SVR) based on wavelet transform(WT) and principal component analysis(PCA) was used. Experimental data from the HDS setup were employed to validate the proposed model. The results reveal that the integrated WT-PCA with SVR model was able to increase the prediction accuracy of SVR model. Implementation of the proposed model delivers the best satisfactory predicting performance(EAARE=0.058 and R2=0.97) in comparison with SVR. The obtained results indicate that the proposed model is more reliable and more precise than the multiple linear regression(MLR), SVR and PCA-SVR.
基金supported by the Science and Technology on Space Intelligent Control Laboratory for National Defense(KGJZDSYS-2018-08)。
文摘Least square support vector regression(LSSVR)is a method for function approximation,whose solutions are typically non-sparse,which limits its application especially in some occasions of fast prediction.In this paper,a sparse algorithm for adaptive pruning LSSVR algorithm based on global representative point ranking(GRPR-AP-LSSVR)is proposed.At first,the global representative point ranking(GRPR)algorithm is given,and relevant data analysis experiment is implemented which depicts the importance ranking of data points.Furthermore,the pruning strategy of removing two samples in the decremental learning procedure is designed to accelerate the training speed and ensure the sparsity.The removed data points are utilized to test the temporary learning model which ensures the regression accuracy.Finally,the proposed algorithm is verified on artificial datasets and UCI regression datasets,and experimental results indicate that,compared with several benchmark algorithms,the GRPR-AP-LSSVR algorithm has excellent sparsity and prediction speed without impairing the generalization performance.
基金supported by the National Natural Science Foundation of China(50576033).
文摘The computational cost of support vector regression in the training phase is O （N^3）, which is very expensive for a large scale problem. In addition, the solution of support vector regression is of parsimoniousness, which has relation to a part of the whole training data set. Hence, it is reasonable to reduce the training data set. Aiming at the scheme based on k-nearest neighbors to reduce the training data set with the computational complexity O （kMN^2）, an improved scheme is proposed to accelerate the reducing phase, which cuts down the computational complexity from O （kMN^2） to O （MN^2）. Finally, experimental results on benchmark data sets validate the effectiveness of the improved scheme.
文摘The electromagnetic scattering computation has developed rapidly for many years; some computing problems for complex and coated targets cannot be solved by using the existing theory and computing models. A computing model based on data is established for making up the insufficiency of theoretic models. Based on the ＂support vector regression method＂, which is formulated on the principle of minimizing a structural risk, a data model to predicate the unknown radar cross section of some appointed targets is given. Comparison between the actual data and the results of this predicting model based on support vector regression method proved that the support vector regression method is workable and with a comparative precision.
基金supported by the National Natural Science Foundation of China(50576033)
文摘The pruning algorithms for sparse least squares support vector regression machine are common methods, and easily com- prehensible, but the computational burden in the training phase is heavy due to the retraining in performing the pruning process, which is not favorable for their applications. To this end, an im- proved scheme is proposed to accelerate sparse least squares support vector regression machine. A major advantage of this new scheme is based on the iterative methodology, which uses the previous training results instead of retraining, and its feasibility is strictly verified theoretically. Finally, experiments on bench- mark data sets corroborate a significant saving of the training time with the same number of support vectors and predictive accuracy compared with the original pruning algorithms, and this speedup scheme is also extended to classification problem.
文摘An on-line forecasting model based on self-tuning support vectors regression for zinc output was put forward to maximize zinc output by adjusting operational parameters in the process of imperial smelting furnace. In this model, the mathematical model of support vector regression was converted into the same format as support vector machine for classification. Then a simplified sequential minimal optimization for classification was applied to train the regression coefficient vector α- α* and threshold b. Sequentially penalty parameter C was tuned dynamically through forecasting result during the training process. Finally, an on-line forecasting algorithm for zinc output was proposed. The simulation result shows that in spite of a relatively small industrial data set, the effective error is less than 10% with a remarkable performance of real time. The model was applied to the optimization operation and fault diagnosis system for imperial smelting furnace.
基金sponsored by the National Natural Science Foundation of China(Grant Nos.U2241285,62201267)。
文摘Zirconium,titanium,and other hexagonally close-packed(HCP)metals and their alloys are representative high specific strength,high reaction enthalpy,and high thermal conductivity structural materials.In this study,two typical HCP metals,zirconium,and titanium,were applied to reactive materials(RMs)to prepare Zr/PTFE/W RMs and Ti/PTFE/W RMs,validating the feasibility of HCP metal/PTFE/W RMs.The impact response process of typical HCP metal/PTFE/W RMs under high-velocity dynamic loads was studied using shock equations of state(EOS)based on porous mixtures and chemical reaction kinetics equations.An improved hemispherical quasi-sealed test chamber was employed to measure the energy release characteristic curves of 10 types of Zr/PTFE/W RMs and Ti/PTFE/W RMs under impact velocities ranging from 500 m/s to 1300 m/s.The datasets of the impact-induced energy release characteristics of HCP metal/PTFE/W RMs were established.Additionally,the energy release efficiency of HCP metal/PTFE/W RMs under impact was predicted using the support vector regression(SVR)kernel function model.The datasets of Zr/PTFE/W RMs and Ti/PTFE/W RMs with W contents of 0%,25%,50%,and 75%were used as test sets,respectively.The model predictions showed a high degree of agreement with the experimental data,with mean absolute errors(MAE)of 4.8,6.5,4.6,and 4.1,respectively.
文摘Aiming at the problem that the traditional Unscented Kalman Filtering(UKF) algorithm can't solve the problem that the measurement covariance matrix is unknown and the measured value contains outliers,this paper proposes a robust adaptive UKF algorithm based on Support Vector Regression(SVR).The algorithm combines the advantages of support vector regression with small samples,nonlinear learning ability and online estimation capability of adaptive algorithm based on innovation.Firstly,the SVR model is trained by using the innovation in the sliding window,and the new innovation is monitored.If the deviation between the estimated innovation and the measured innovation exceeds a given threshold,then measured innovation will be replaced by the predicted innovation,and then the processed innovation is used to calculate the measurement noise covariance matrix using the adaptive estimation algorithm.Simulation experiments and measured data experiments show that SVRUKF is significantly better than the traditional UKF,robust UKF and adaptive UKF algorithms for the case where the covariance matrix is unknown and the measured values have outliers.
文摘Considering the modeling errors of on-board self-tuning model in the fault diagnosis of aero-engine, a new mechanism for compensating the model outputs is proposed. A discrete series predictor based on multi-outputs least square support vector regression （LSSVR） is applied to the compensation of on-board self-tuning model of aero-engine, and particle swarm optimization （PSO） is used to the kernels selection of multi-outputs LSSVR. The method need not reconstruct the model of aero-engine because of the differences in the individuals of the same type engines and engine degradation after use. The concrete steps for the application of the method are given, and the simulation results show the effectiveness of the algorithm.
基金Project(50678052) supported by the National Natural Science Foundation of China
文摘In order to establish the baseline finite element model for structural health monitoring,a new method of model updating was proposed after analyzing the uncertainties of measured data and the error of finite element model.In the new method,the finite element model was replaced by the multi-output support vector regression machine(MSVR).The interval variables of the measured frequency were sampled by Latin hypercube sampling method.The samples of frequency were regarded as the inputs of the trained MSVR.The outputs of MSVR were the target values of design parameters.The steel structure of National Aquatic Center for Beijing Olympic Games was introduced as a case for finite element model updating.The results show that the proposed method can avoid solving the problem of complicated calculation.Both the estimated values and associated uncertainties of the structure parameters can be obtained by the method.The static and dynamic characteristics of the updated finite element model are in good agreement with the measured data.
基金supported by the National Science Fund for Distinguished Young Scholars under Grant No.71025005the National Natural Science Foundation of China under Grant Nos.91224001 and 71301006+1 种基金National Program for Support of Top-Notch Young Professionalsthe Fundamental Research Funds for the Central Universities in BUCT
文摘Due to the nonlinearity and nonstationary of hydropower market data, a novel hybrid learning paradigm is proposed to predict hydropower consumption, by incorporating firefly algorithm （FA） into least square support vector regression （LSSVR）, i.e., FA-based LSSVR model. In the novel model, the powerful and effective artificial intelligence （AI） technique, i.e., LSSVR, is employed to forecast hydropower consumption. Furthermore, a promising AI optimization tool, i.e., FA, is espe- cially introduced to address the crucial but difficult task of parameters determination in LSSVR （e.g., hyper and kernel function parameters）. With the Chinese hydropower consumption as sample data, the empirical study has statistically confirmed the superiority of the novel FA-based LSSVR model to other benchmark models （including existing popular traditional econometric models, AI models and similar hybrid LSSVRs with other popular parameter searching tools）~ in terms of level and direc- tional accuracy. The empirical results also imply that the hybrid FA-based LSSVR learning paradigm with powerful forecasting tool and parameters optimization method can be employed as an effective forecasting tool for not only hydropower consumption but also other complex data.
基金Projects(70671039,71071052) supported by the National Natural Science Foundation of ChinaProjects(10QX44,09QX68) supported by the Fundamental Research Funds for the Central Universities in China
文摘Short-term forecasting is a difficult problem because of the influence of non-linear factors and irregular events.A novel short-term forecasting method named TIK was proposed,in which ARMA forecasting model was used to consider the load time series trend forecasting,intelligence forecasting DESVR model was applied to estimate the non-linear influence,and knowledge mining methods were applied to correct the errors caused by irregular events.In order to prove the effectiveness of the proposed model,an application of the daily maximum load forecasting was evaluated.The experimental results show that the DESVR model improves the mean absolute percentage error(MAPE) from 2.82% to 2.55%,and the knowledge rules can improve the MAPE from 2.55% to 2.30%.Compared with the single ARMA forecasting method and ARMA combined SVR forecasting method,it can be proved that TIK method gains the best performance in short-term load forecasting.
基金This project was supported by the National Natural Science Foundation of China (60573159)the Natural Science Foundation of Guangdong Province (05200302).
文摘Sale prediction plays a significant role in business management. By using support vector machine Regression （ε-SVR）, a method using to predict sale is illustrated. It takes historical data and current context data as inputs and presents results, i.e. sale tendency in the future and the forecasting sales, according to the user＇s specification of accuracy and time cycles. Some practical data experiments and the comparative tests with other algorithms show the advantages of the proposed approach in computation time and correctness.
基金Projects(61001188,1161140319)supported by the National Natural Science Foundation of ChinaProject(2012ZX03001034)supported by the National Science and Technology Major ProjectProject(YETP1202)supported by Beijing Higher Education Young Elite Teacher Project,China
文摘Objective speech quality is difficult to be measured without the input reference speech.Mapping methods using data mining are investigated and designed to improve the output-based speech quality assessment algorithm.The degraded speech is firstly separated into three classes(unvoiced,voiced and silence),and then the consistency measurement between the degraded speech signal and the pre-trained reference model for each class is calculated and mapped to an objective speech quality score using data mining.Fuzzy Gaussian mixture model(GMM)is used to generate the artificial reference model trained on perceptual linear predictive(PLP)features.The mean opinion score(MOS)mapping methods including multivariate non-linear regression(MNLR),fuzzy neural network(FNN)and support vector regression(SVR)are designed and compared with the standard ITU-T P.563 method.Experimental results show that the assessment methods with data mining perform better than ITU-T P.563.Moreover,FNN and SVR are more efficient than MNLR,and FNN performs best with 14.50% increase in the correlation coefficient and 32.76% decrease in the root-mean-square MOS error.
