In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the...In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the reconstructed phase space, the local support vector machine prediction method is used to predict the traffic measurement data, and the BIC-based neighbouring point selection method is used to choose the number of the nearest neighbouring points for the local support vector machine regression model. The experimental results show that the local support vector machine prediction method whose neighbouring points are optimized can effectively predict the small-time scale traffic measurement data and can reproduce the statistical features of real traffic measurements.展开更多
A novel data-driven, soft sensor based on support vector regression （SVR） integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization （HDS） process. A wid...A novel data-driven, soft sensor based on support vector regression （SVR） integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization （HDS） process. A wide range of experimental data was taken from a HDS setup to train and test the SVR model. Hyper-parameter tuning is one of the main challenges to improve predictive accuracy of the SVR model. Therefore, a hybrid approach using a combination of genetic algorithm （GA） and sequential quadratic programming （SQP） methods （GA-SQP） was developed. Performance of different optimization algorithms including GA-SQP, GA, pattern search （PS）, and grid search （GS） indicated that the best average absolute relative error （AARE）, squared correlation coefficient （R2）, and computation time （CT） （AARE = 0.0745, R2 = 0.997 and CT = 56 s） was accomplished by the hybrid algorithm. Moreover, to reduce the CT and improve the accuracy of the SVR model, the vector quantization （VQ） technique was used. The results also showed that the VQ technique can decrease the training time and improve prediction performance of the SVR model. The proposed method can provide a robust, soft sensor in a wide range of sulfur contents with good accuracy.展开更多
Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive so...Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive soft sensors for prediction of naphtha initial boiling point(IBP)and end boiling point(EBP)in crude distillation unit.In this work,adaptive inferential sensors with linear and non-linear local models are reported based on recursive just in time learning(JITL)approach.The different types of local models designed are locally weighted regression(LWR),multiple linear regression(MLR),partial least squares regression(PLS)and support vector regression(SVR).In addition to model development,the effect of relevant dataset size on model prediction accuracy and model computation time is also investigated.Results show that the JITL model based on support vector regression with iterative single data algorithm optimization(ISDA)local model(JITL-SVR:ISDA)yielded best prediction accuracy in reasonable computation time.展开更多
A method of multiple outputs least squares support vector regression （LS-SVR） was developed and described in detail, with the radial basis function （RBF） as the kernel function. The method was applied to predict t...A method of multiple outputs least squares support vector regression （LS-SVR） was developed and described in detail, with the radial basis function （RBF） as the kernel function. The method was applied to predict the future state of the power-shift steering transmission （PSST）. A prediction model of PSST was gotten with multiple outputs LS-SVR. The model performance was greatly influenced by the penalty parameter γ and kernel parameter σ2 which were optimized using cross validation method. The training and prediction of the model were done with spectrometric oil analysis data. The predictive and actual values were compared and a fault in the second PSST was found. The research proved that this method had good accuracy in PSST fault prediction, and any possible problem in PSST could be found through a comparative analysis.展开更多
In this paper a new continuous variable called core-ratio is defined to describe the probability for a residue to be in a binding site, thereby replacing the previous binary description of the interface residue using ...In this paper a new continuous variable called core-ratio is defined to describe the probability for a residue to be in a binding site, thereby replacing the previous binary description of the interface residue using 0 and 1. So we can use the support vector machine regression method to fit the core-ratio value and predict the protein binding sites. We also design a new group of physical and chemical descriptors to characterize the binding sites. The new descriptors are more effective, with an averaging procedure used. Our test shows that much better prediction results can be obtained by the support vector regression （SVR） method than by the support vector classification method.展开更多
Support vector regression （SVR） combined with particle swarm optimization for its parameter optimization is employed to establish a model for predicting the Henry constants of multi-walled carbon nanotubes （MWNTs）...Support vector regression （SVR） combined with particle swarm optimization for its parameter optimization is employed to establish a model for predicting the Henry constants of multi-walled carbon nanotubes （MWNTs） for adsorption of volatile organic compounds （VOCs）. The prediction performance of SVR is compared with those of the model of theoretical linear salvation energy relationship （TLSER）. By using leave-one-out cross validation of SVR test Henry constants for adsorption of 35 VOCs on MWNTs, the root mean square error is 0.080, the mean absolute percentage error is only 1.19~, and the correlation coefficient （R2） is as high as 0.997. Compared with the results of the TLSER model, it is shown that the estimated errors by SVR are ali smaller than those achieved by TLSER. It reveals that the generalization ability of SVR is superior to that of the TLSER model Meanwhile, multifactor analysis is adopted for investigation of the influences of each molecular structure descriptor on the Henry constants. According to the TLSER model, the adsorption mechanism of adsorption of carbon nanotubes of VOCs is mainly a result of van der Waals and interactions of hydrogen bonds. These can provide the theoretical support for the application of carbon nanotube adsorption of VOCs and can make up for the lack of experimental data.展开更多
Aiming at reducing the deficiency of the traditional fire pre-warning algorithms and the intelligent fire pre-warning algorithms such as artificial neural network,and then to improve the accuracy of fire prewarning fo...Aiming at reducing the deficiency of the traditional fire pre-warning algorithms and the intelligent fire pre-warning algorithms such as artificial neural network,and then to improve the accuracy of fire prewarning for high-rise buildings,a composite fire pre-warning controller is designed according to the characteristic（ nonlinear,less historical data,many influence factors）,also a high-rise building fire pre-warning model is set up based on the support vector regression（ SV R）. Then the wood fire standard history data is applied to make empirical analysis. The research results can provide a reliable decision support framework for high-rise building fire pre-warning.展开更多
The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FS...The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FSA-LSSVR,is proposed.Compared with the previously approximate algorithms,it not only adopts the partial reduction strategy but considers the influence between the previously selected support vectors and the willselected support vector during the process of computing the supporting weights.As a result,I2FSA-LSSVR reduces the number of support vectors and enhances the real-time.To confirm the feasibility and effectiveness of the proposed algorithm,experiments on benchmark data sets are conducted,whose results support the presented I2FSA-LSSVR.展开更多
In our study, support vector value contourlet transform is constructed by using support vector regression model and directional filter banks. The transform is then used to decompose source images at multi-scale, multi...In our study, support vector value contourlet transform is constructed by using support vector regression model and directional filter banks. The transform is then used to decompose source images at multi-scale, multi-direction and multi-resolution. After that, the super-resolved multi-spectral image is reconstructed by utilizing the strong learning ability of support vector regression and the correlation between multi-spectral image and panchromatic image. Finally, the super-resolved multi- spectral image and the panchromatic image are fused based on regions at different levels. Our experi- ments show that, the learning method based on support vector regression can improve the effect of super-resolution of multi-spectral image. The fused image preserves both high space resolution and spectrum information of multi-spectral image.展开更多
An approach was proposed for optimizing beamforming that was based on Support Vector Regression (SVR). After studying the mathematical principal of the SVR algorithm and its primal cost function, the modified cost fun...An approach was proposed for optimizing beamforming that was based on Support Vector Regression (SVR). After studying the mathematical principal of the SVR algorithm and its primal cost function, the modified cost function was first applied to uniform array beamforming, and then the corresponding parameters of the beamforming were optimized. The framework of SVR uniform array beamforming was then established. Simulation results show that SVR beamforming can not only approximate the performance of conventional beamforming in the area without noise and with small data sets, but also improve the generalization ability and reduce the computation burden. Also, the side lobe level of both linear and circular arrays by the SVR algorithm is improved sharply through comparison with the conventional one. SVR beamforming is superior to the conventional method in both linear and circular arrays, under single source or double non-coherent sources.展开更多
The purpose of this paper is to study the theory of conservative estimating functions in nonlinear regression model with aggregated data. In this model, a quasi-score function with aggregated data is defined. When thi...The purpose of this paper is to study the theory of conservative estimating functions in nonlinear regression model with aggregated data. In this model, a quasi-score function with aggregated data is defined. When this function happens to be conservative, it is projection of the true score function onto a class of estimation functions. By constructing, the potential function for the projected score with aggregated data is obtained, which have some properties of log-likelihood function.展开更多
The distribution of data has a significant impact on the results of classification.When the distribution of one class is insignificant compared to the distribution of another class,data imbalance occurs.This will resu...The distribution of data has a significant impact on the results of classification.When the distribution of one class is insignificant compared to the distribution of another class,data imbalance occurs.This will result in rising outlier values and noise.Therefore,the speed and performance of classification could be greatly affected.Given the above problems,this paper starts with the motivation and mathematical representing of classification,puts forward a new classification method based on the relationship between different classification formulations.Combined with the vector characteristics of the actual problem and the choice of matrix characteristics,we firstly analyze the orderly regression to introduce slack variables to solve the constraint problem of the lone point.Then we introduce the fuzzy factors to solve the problem of the gap between the isolated points on the basis of the support vector machine.We introduce the cost control to solve the problem of sample skew.Finally,based on the bi-boundary support vector machine,a twostep weight setting twin classifier is constructed.This can help to identify multitasks with feature-selected patterns without the need for additional optimizers,which solves the problem of large-scale classification that can’t deal effectively with the very low category distribution gap.展开更多
针对以往船舶备件需求预测精度不高,无法满足船舶综合保障的实际问题,文章建立一种基于改进红狐优化算法(improved red fox optimization,IRFO)的支持向量机回归(support vector regression,SVR)的船舶备件预测模型。为进一步提高红狐...针对以往船舶备件需求预测精度不高,无法满足船舶综合保障的实际问题,文章建立一种基于改进红狐优化算法(improved red fox optimization,IRFO)的支持向量机回归(support vector regression,SVR)的船舶备件预测模型。为进一步提高红狐优化算法(red fox optimization,RFO)的寻优精度,重构其全局搜索公式,并融合精英反向学习策略。采用基准测试函数对IRFO算法进行仿真实验,实验表明,IRFO算法比RFO算法、粒子群算法、灰狼优化算法寻优能力更强,综合性能更优。基于船舶备件历史数据,建立IRFO-SVR船舶备件预测模型,通过对比其他模型的预测结果,表明IRFO-SVR的预测效果更佳。展开更多
基金Project supported by the National Natural Science Foundation of China (Grant No 60573065)the Natural Science Foundation of Shandong Province,China (Grant No Y2007G33)the Key Subject Research Foundation of Shandong Province,China(Grant No XTD0708)
文摘In this paper we apply the nonlinear time series analysis method to small-time scale traffic measurement data. The prediction-based method is used to determine the embedding dimension of the traffic data. Based on the reconstructed phase space, the local support vector machine prediction method is used to predict the traffic measurement data, and the BIC-based neighbouring point selection method is used to choose the number of the nearest neighbouring points for the local support vector machine regression model. The experimental results show that the local support vector machine prediction method whose neighbouring points are optimized can effectively predict the small-time scale traffic measurement data and can reproduce the statistical features of real traffic measurements.
文摘A novel data-driven, soft sensor based on support vector regression （SVR） integrated with a data compression technique was developed to predict the product quality for the hydrodesulfurization （HDS） process. A wide range of experimental data was taken from a HDS setup to train and test the SVR model. Hyper-parameter tuning is one of the main challenges to improve predictive accuracy of the SVR model. Therefore, a hybrid approach using a combination of genetic algorithm （GA） and sequential quadratic programming （SQP） methods （GA-SQP） was developed. Performance of different optimization algorithms including GA-SQP, GA, pattern search （PS）, and grid search （GS） indicated that the best average absolute relative error （AARE）, squared correlation coefficient （R2）, and computation time （CT） （AARE = 0.0745, R2 = 0.997 and CT = 56 s） was accomplished by the hybrid algorithm. Moreover, to reduce the CT and improve the accuracy of the SVR model, the vector quantization （VQ） technique was used. The results also showed that the VQ technique can decrease the training time and improve prediction performance of the SVR model. The proposed method can provide a robust, soft sensor in a wide range of sulfur contents with good accuracy.
文摘Prediction of primary quality variables in real time with adaptation capability for varying process conditions is a critical task in process industries.This article focuses on the development of non-linear adaptive soft sensors for prediction of naphtha initial boiling point(IBP)and end boiling point(EBP)in crude distillation unit.In this work,adaptive inferential sensors with linear and non-linear local models are reported based on recursive just in time learning(JITL)approach.The different types of local models designed are locally weighted regression(LWR),multiple linear regression(MLR),partial least squares regression(PLS)and support vector regression(SVR).In addition to model development,the effect of relevant dataset size on model prediction accuracy and model computation time is also investigated.Results show that the JITL model based on support vector regression with iterative single data algorithm optimization(ISDA)local model(JITL-SVR:ISDA)yielded best prediction accuracy in reasonable computation time.
基金Supported by the Ministerial Level Advanced Research Foundation(3031030)the"111"Project(B08043)
文摘A method of multiple outputs least squares support vector regression （LS-SVR） was developed and described in detail, with the radial basis function （RBF） as the kernel function. The method was applied to predict the future state of the power-shift steering transmission （PSST）. A prediction model of PSST was gotten with multiple outputs LS-SVR. The model performance was greatly influenced by the penalty parameter γ and kernel parameter σ2 which were optimized using cross validation method. The training and prediction of the model were done with spectrometric oil analysis data. The predictive and actual values were compared and a fault in the second PSST was found. The research proved that this method had good accuracy in PSST fault prediction, and any possible problem in PSST could be found through a comparative analysis.
基金Project supported by the National Natural Science Foundation of China (Grant Nos. 10674172 and 10874229)
文摘In this paper a new continuous variable called core-ratio is defined to describe the probability for a residue to be in a binding site, thereby replacing the previous binary description of the interface residue using 0 and 1. So we can use the support vector machine regression method to fit the core-ratio value and predict the protein binding sites. We also design a new group of physical and chemical descriptors to characterize the binding sites. The new descriptors are more effective, with an averaging procedure used. Our test shows that much better prediction results can be obtained by the support vector regression （SVR） method than by the support vector classification method.
基金Supported by the Innovative Talent Funds for Project 985 under Grant No WLYJSBJRCTD201102the Fundamental Research Funds for the Central Universities under Grant No CQDXWL-2013-014+1 种基金the Natural Science Foundation of Chongqing under Grant No CSTC2006BB5240the Program for New Century Excellent Talents in Universities of China under Grant No NCET-07-0903
文摘Support vector regression （SVR） combined with particle swarm optimization for its parameter optimization is employed to establish a model for predicting the Henry constants of multi-walled carbon nanotubes （MWNTs） for adsorption of volatile organic compounds （VOCs）. The prediction performance of SVR is compared with those of the model of theoretical linear salvation energy relationship （TLSER）. By using leave-one-out cross validation of SVR test Henry constants for adsorption of 35 VOCs on MWNTs, the root mean square error is 0.080, the mean absolute percentage error is only 1.19~, and the correlation coefficient （R2） is as high as 0.997. Compared with the results of the TLSER model, it is shown that the estimated errors by SVR are ali smaller than those achieved by TLSER. It reveals that the generalization ability of SVR is superior to that of the TLSER model Meanwhile, multifactor analysis is adopted for investigation of the influences of each molecular structure descriptor on the Henry constants. According to the TLSER model, the adsorption mechanism of adsorption of carbon nanotubes of VOCs is mainly a result of van der Waals and interactions of hydrogen bonds. These can provide the theoretical support for the application of carbon nanotube adsorption of VOCs and can make up for the lack of experimental data.
基金Supported by the National Natural Science Foundation of China(11072035)
文摘Aiming at reducing the deficiency of the traditional fire pre-warning algorithms and the intelligent fire pre-warning algorithms such as artificial neural network,and then to improve the accuracy of fire prewarning for high-rise buildings,a composite fire pre-warning controller is designed according to the characteristic（ nonlinear,less historical data,many influence factors）,also a high-rise building fire pre-warning model is set up based on the support vector regression（ SV R）. Then the wood fire standard history data is applied to make empirical analysis. The research results can provide a reliable decision support framework for high-rise building fire pre-warning.
基金Supported by the National Natural Science Foundation of China(51006052)
文摘The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FSA-LSSVR,is proposed.Compared with the previously approximate algorithms,it not only adopts the partial reduction strategy but considers the influence between the previously selected support vectors and the willselected support vector during the process of computing the supporting weights.As a result,I2FSA-LSSVR reduces the number of support vectors and enhances the real-time.To confirm the feasibility and effectiveness of the proposed algorithm,experiments on benchmark data sets are conducted,whose results support the presented I2FSA-LSSVR.
基金Supported by the National Natural Science Foundation of China(61172127)Key Research Project of Education Department of Anhui Province(KJ2010A021)
文摘In our study, support vector value contourlet transform is constructed by using support vector regression model and directional filter banks. The transform is then used to decompose source images at multi-scale, multi-direction and multi-resolution. After that, the super-resolved multi-spectral image is reconstructed by utilizing the strong learning ability of support vector regression and the correlation between multi-spectral image and panchromatic image. Finally, the super-resolved multi- spectral image and the panchromatic image are fused based on regions at different levels. Our experi- ments show that, the learning method based on support vector regression can improve the effect of super-resolution of multi-spectral image. The fused image preserves both high space resolution and spectrum information of multi-spectral image.
基金the Foundation of Returned Scholar of Shaanxi Province(SLZ2008006)
文摘An approach was proposed for optimizing beamforming that was based on Support Vector Regression (SVR). After studying the mathematical principal of the SVR algorithm and its primal cost function, the modified cost function was first applied to uniform array beamforming, and then the corresponding parameters of the beamforming were optimized. The framework of SVR uniform array beamforming was then established. Simulation results show that SVR beamforming can not only approximate the performance of conventional beamforming in the area without noise and with small data sets, but also improve the generalization ability and reduce the computation burden. Also, the side lobe level of both linear and circular arrays by the SVR algorithm is improved sharply through comparison with the conventional one. SVR beamforming is superior to the conventional method in both linear and circular arrays, under single source or double non-coherent sources.
文摘The purpose of this paper is to study the theory of conservative estimating functions in nonlinear regression model with aggregated data. In this model, a quasi-score function with aggregated data is defined. When this function happens to be conservative, it is projection of the true score function onto a class of estimation functions. By constructing, the potential function for the projected score with aggregated data is obtained, which have some properties of log-likelihood function.
基金Hebei Province Key Research and Development Project(No.20313701D)Hebei Province Key Research and Development Project(No.19210404D)+13 种基金Mobile computing and universal equipment for the Beijing Key Laboratory Open Project,The National Social Science Fund of China(17AJL014)Beijing University of Posts and Telecommunications Construction of World-Class Disciplines and Characteristic Development Guidance Special Fund “Cultural Inheritance and Innovation”Project(No.505019221)National Natural Science Foundation of China(No.U1536112)National Natural Science Foundation of China(No.81673697)National Natural Science Foundation of China(61872046)The National Social Science Fund Key Project of China(No.17AJL014)“Blue Fire Project”(Huizhou)University of Technology Joint Innovation Project(CXZJHZ201729)Industry-University Cooperation Cooperative Education Project of the Ministry of Education(No.201902218004)Industry-University Cooperation Cooperative Education Project of the Ministry of Education(No.201902024006)Industry-University Cooperation Cooperative Education Project of the Ministry of Education(No.201901197007)Industry-University Cooperation Collaborative Education Project of the Ministry of Education(No.201901199005)The Ministry of Education Industry-University Cooperation Collaborative Education Project(No.201901197001)Shijiazhuang science and technology plan project(236240267A)Hebei Province key research and development plan project(20312701D)。
文摘The distribution of data has a significant impact on the results of classification.When the distribution of one class is insignificant compared to the distribution of another class,data imbalance occurs.This will result in rising outlier values and noise.Therefore,the speed and performance of classification could be greatly affected.Given the above problems,this paper starts with the motivation and mathematical representing of classification,puts forward a new classification method based on the relationship between different classification formulations.Combined with the vector characteristics of the actual problem and the choice of matrix characteristics,we firstly analyze the orderly regression to introduce slack variables to solve the constraint problem of the lone point.Then we introduce the fuzzy factors to solve the problem of the gap between the isolated points on the basis of the support vector machine.We introduce the cost control to solve the problem of sample skew.Finally,based on the bi-boundary support vector machine,a twostep weight setting twin classifier is constructed.This can help to identify multitasks with feature-selected patterns without the need for additional optimizers,which solves the problem of large-scale classification that can’t deal effectively with the very low category distribution gap.
文摘针对以往船舶备件需求预测精度不高,无法满足船舶综合保障的实际问题,文章建立一种基于改进红狐优化算法(improved red fox optimization,IRFO)的支持向量机回归(support vector regression,SVR)的船舶备件预测模型。为进一步提高红狐优化算法(red fox optimization,RFO)的寻优精度,重构其全局搜索公式,并融合精英反向学习策略。采用基准测试函数对IRFO算法进行仿真实验,实验表明,IRFO算法比RFO算法、粒子群算法、灰狼优化算法寻优能力更强,综合性能更优。基于船舶备件历史数据,建立IRFO-SVR船舶备件预测模型,通过对比其他模型的预测结果,表明IRFO-SVR的预测效果更佳。
