By adopting the chaotic searching to improve the global searching performance of the particle swarm optimization (PSO), and using the improved PSO to optimize the key parameters of the support vector machine (SVM) for...By adopting the chaotic searching to improve the global searching performance of the particle swarm optimization (PSO), and using the improved PSO to optimize the key parameters of the support vector machine (SVM) forecasting model, an improved SVM model named CPSO-SVM model was proposed. The new model was applied to predicting the short term load, and the improved effect of the new model was proved. The simulation results of the South China Power Market’s actual data show that the new method can effectively improve the forecast accuracy by 2.23% and 3.87%, respectively, compared with the PSO-SVM and SVM methods. Compared with that of the PSO-SVM and SVM methods, the time cost of the new model is only increased by 3.15 and 4.61 s, respectively, which indicates that the CPSO-SVM model gains significant improved effects.展开更多
A new support vector machine （SVM） optimized by an improved particle swarm optimization （PSO） combined with simulated annealing algorithm （SA） was proposed. By incorporating with the simulated annealing method, ...A new support vector machine （SVM） optimized by an improved particle swarm optimization （PSO） combined with simulated annealing algorithm （SA） was proposed. By incorporating with the simulated annealing method, the global searching capacity of the particle swarm optimization（SAPSO） was enchanced, and the searching capacity of the particle swarm optimization was studied. Then, the improyed particle swarm optimization algorithm was used to optimize the parameters of SVM （c,σ and ε）. Based on the operational data provided by a regional power grid in north China, the method was used in the actual short term load forecasting. The results show that compared to the PSO-SVM and the traditional SVM, the average time of the proposed method in the experimental process reduces by 11.6 s and 31.1 s, and the precision of the proposed method increases by 1.24% and 3.18%, respectively. So, the improved method is better than the PSO-SVM and the traditional SVM.展开更多
In order to improve the recognition rate and accuracy rate of projectiles in six sky-screens intersection test system,this work proposes a new recognition method of projectiles by combining particle swarm optimization...In order to improve the recognition rate and accuracy rate of projectiles in six sky-screens intersection test system,this work proposes a new recognition method of projectiles by combining particle swarm optimization support vector and spatial-temporal constrain of six sky-screens detection sensor.Based on the measurement principle of the six sky-screens intersection test system and the characteristics of the output signal of the sky-screen,we analyze the existing problems regarding the recognition of projectiles.In order to optimize the projectile recognition effect,we use the support vector machine and basic particle swarm algorithm to form a new recognition algorithm.We set up the particle swarm algorithm optimization support vector projectile information recognition model that conforms to the six sky-screens intersection test system.We also construct a spatial-temporal constrain matching model based on the spatial geometric relationship of six sky-screen intersection,and form a new projectile signal recognition algorithm with six sky-screens spatial-temporal information constraints under the signal classification mechanism of particle swarm optimization algorithm support vector machine.Based on experiments,we obtain the optimal penalty and kernel function radius parameters in the PSO-SVM algorithm;we adjust the parameters of the support vector machine model,train the test signal data of every sky-screen,and gain the projectile signal classification results.Afterwards,according to the signal classification results,we calculate the coordinate parameters of the real projectile by using the spatial-temporal constrain of six sky-screens detection sensor,which verifies the feasibility of the proposed algorithm.展开更多
The support vector machine （SVM） is a novel machine learning method, which has the ability to approximate nonlinear functions with arbitrary accuracy. Setting parameters well is very crucial for SVM learning results...The support vector machine （SVM） is a novel machine learning method, which has the ability to approximate nonlinear functions with arbitrary accuracy. Setting parameters well is very crucial for SVM learning results and generalization ability, and now there is no systematic, general method for parameter selection. In this article, the SVM parameter selection for function approximation is regarded as a compound optimization problem and a mutative scale chaos optimization algorithm is employed to search for optimal paraxneter values. The chaos optimization algorithm is an effective way for global optimal and the mutative scale chaos algorithm could improve the search efficiency and accuracy. Several simulation examples show the sensitivity of the SVM parameters and demonstrate the superiority of this proposed method for nonlinear function approximation.展开更多
An improved particle swarm optimization（PSO） algorithm is proposed to train the fuzzy support vector machine（FSVM） for pattern multi-classification.In the improved algorithm,the particles studies not only from its...An improved particle swarm optimization（PSO） algorithm is proposed to train the fuzzy support vector machine（FSVM） for pattern multi-classification.In the improved algorithm,the particles studies not only from itself and the best one but also from the mean value of some other particles.In addition,adaptive mutation was introduced to reduce the rate of premature convergence.The experimental results on the synthetic aperture radar（SAR） target recognition of moving and stationary target acquisition and recognition（MSTAR） dataset and character recognition of MNIST database show that the improved algorithm is feasible and effective for fuzzy multi-class SVM training.展开更多
A relevance vector machine (RVM) based fault diagnosis method was presented for non-linear circuits. In order to simplify RVM classifier, parameters selection based on particle swarm optimization (PSO) and preprocessi...A relevance vector machine (RVM) based fault diagnosis method was presented for non-linear circuits. In order to simplify RVM classifier, parameters selection based on particle swarm optimization (PSO) and preprocessing technique based on the kurtosis and entropy of signals were used. Firstly, sinusoidal inputs with different frequencies were applied to the circuit under test (CUT). Then, the resulting frequency responses were sampled to generate features. The frequency response was sampled to compute its kurtosis and entropy, which can show the information capacity of signal. By analyzing the output signals, the proposed method can detect and identify faulty components in circuits. The results indicate that the fault classes can be classified correctly for at least 99% of the test data in example circuit. And the proposed method can diagnose hard and soft faults.展开更多
A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established...A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established by black-box identification. And a quadratic objective function with receding horizon was selected to obtain the controller output. By solving a nonlinear optimization problem with equality constraint of model output and boundary constraint of controller output using Nelder-Mead simplex direct search method, a sub-optimal control law was achieved in feature space. The effect of the controller was demonstrated on a recognized benchmark problem and a continuous-stirred tank reactor. The simulation results show that the multi-step-ahead predictive controller can be well applied to nonlinear system, with better performance in following reference trajectory and disturbance-rejection.展开更多
An improved particle swarm optimization (PSO) algorithm based on ensemble technique is presented. The algorithm combines some previous best positions (pbest) of the particles to get an ensemble position (Epbest), whic...An improved particle swarm optimization (PSO) algorithm based on ensemble technique is presented. The algorithm combines some previous best positions (pbest) of the particles to get an ensemble position (Epbest), which is used to replace the global best position (gbest). It is compared with the standard PSO algorithm invented by Kennedy and Eberhart and some improved PSO algorithms based on three different benchmark functions. The simulation results show that the improved PSO based on ensemble technique can get better solutions than the standard PSO and some other improved algorithms under all test cases.展开更多
Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very la...Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very large quadratic programming problem. Traditional optimization methods cannot be directly applied due to memory restrictions. Up to now, several approaches exist for circumventing the above shortcomings and work well. Another learning algorithm, particle swarm optimization, for training SVM is introduted. The method is tested on UCI datasets.展开更多
Based on KKT complementary condition in optimization theory, an unconstrained non-differential optimization model for support vector machine is proposed. An adjustable entropy function method is given to deal with the...Based on KKT complementary condition in optimization theory, an unconstrained non-differential optimization model for support vector machine is proposed. An adjustable entropy function method is given to deal with the proposed optimization problem and the Newton algorithm is used to figure out the optimal solution. The proposed method can find an optimal solution with a relatively small parameter p, which avoids the numerical overflow in the traditional entropy function methods. It is a new approach to solve support vector machine. The theoretical analysis and experimental results illustrate the feasibility and efficiency of the proposed algorithm.展开更多
Fault diagnosis technology plays an important role in the industries due to the emergency fault of a machine could bring the heavy lost for the people and the company. A fault diagnosis model based on multi-manifold l...Fault diagnosis technology plays an important role in the industries due to the emergency fault of a machine could bring the heavy lost for the people and the company. A fault diagnosis model based on multi-manifold learning and particle swarm optimization support vector machine(PSO-SVM) is studied. This fault diagnosis model is used for a rolling bearing experimental of three kinds faults. The results are verified that this model based on multi-manifold learning and PSO-SVM is good at the fault sensitive features acquisition with effective accuracy.展开更多
To improve the cooling performance, shape optimization of a laidback fan-shaped film cooling hole was performed. Three geometric parameters, including hole length, lateral expansion angle and forward expansion angle, ...To improve the cooling performance, shape optimization of a laidback fan-shaped film cooling hole was performed. Three geometric parameters, including hole length, lateral expansion angle and forward expansion angle, were selected as the design parameters. Numerical model of the film cooling system was established, validated, and used to generate 32 groups of training samples. Least square support vector machine(LS-SVM) was applied for surrogate model, and the optimal design parameters were determined by a kind of chaotic optimization algorithm. As hole length, lateral expansion angle and forward expansion angle are 90 mm, 20° and 5°, the area-averaged film cooling effectiveness can reach its maximum value in the design space. LS-SVM coupled with chaotic optimization algorithm is a promising scheme for the optimization of shaped film cooling holes.展开更多
According to the characteristics of large underground caverns, by using the safety factor of surrounding rock mass point as the control standard of cavern stability, RandWPSO-LSSVM optimization feedback method and flo...According to the characteristics of large underground caverns, by using the safety factor of surrounding rock mass point as the control standard of cavern stability, RandWPSO-LSSVM optimization feedback method and flow process of large underground cavern anchor parameters were established. By applying the optimization feedback method to actual project, the best anchor parameters of large surge shaft five-tunnel area underground cavern of the Nuozhadu hydropower station were obtained through optimization. The results show that the predicted effect of LSSVM prediction model obtained through RandWPSO optimization is good, reasonable and reliable. Combination of the best anchor parameters obtained is 114131312, that is, the locked anchor bar spacing is 1 m x 1 m, pre-stress is 100 kN, elevation 580.45-586.50 m section anchor bar diameter is 36.00 mm, length is 4.50 m, spacing is 1.5 m × 2.5 m; anchor bar diameter at the five-tunnel area side wall is 25.00 mm, length is 7.50 m, spacing is 1 m× 1.5 m, and the shotcrete thickness is 0.15 m. The feedback analyses show that the optimization feedback method of large underground cavern anchor parameters is reasonable and reliable, which has important guiding significance for ensuring the stability of large underground caverns and for saving project investment.展开更多
Support vector machines （SVMs） are initially designed for binary classification. How to effectively extend them for multiclass classification is still an ongoing research topic. A multiclass classifier is constructe...Support vector machines （SVMs） are initially designed for binary classification. How to effectively extend them for multiclass classification is still an ongoing research topic. A multiclass classifier is constructed by combining SVM^light algorithm with directed acyclic graph SVM （DAGSVM） method, named DAGSVM^light A new method is proposed to select the working set which is identical to the working set selected by SVM^light approach. Experimental results indicate DAGSVM^light is competitive with DAGSMO. It is more suitable for practice use. It may be an especially useful tool for large-scale multiclass classification problems and lead to more widespread use of SVMs in the engineering community due to its good performance.展开更多
The radial deformation design of turbine disk seriously influences the control of gas turbine high pressure turbine(HPT) blade-tip radial running clearance(BTRRC). To improve the design of BTRRC under continuous opera...The radial deformation design of turbine disk seriously influences the control of gas turbine high pressure turbine(HPT) blade-tip radial running clearance(BTRRC). To improve the design of BTRRC under continuous operation, the nonlinear dynamic reliability optimization of disk radial deformation was implemented based on extremum response surface method(ERSM), including ERSM-based quadratic function(QF-ERSM) and ERSM-based support vector machine of regression(SR-ERSM). The mathematical models of the two methods were established and the framework of reliability-based dynamic design optimization was developed. The numerical experiments demonstrate that the proposed optimization methods have the promising potential in reducing additional design samples and improving computational efficiency with acceptable precision, in which the SR-ERSM emerges more obviously. Through the case study, we find that disk radial deformation is reduced by about 6.5×10–5 m; δ=1.31×10–3 m is optimal for turbine disk radial deformation design and the proposed methods are verified again. The presented efforts provide an effective optimization method for the nonlinear transient design of motion structures for further research, and enrich mechanical reliability design theory.展开更多
基金Project(70572090) supported by the National Natural Science Foundation of China
文摘By adopting the chaotic searching to improve the global searching performance of the particle swarm optimization (PSO), and using the improved PSO to optimize the key parameters of the support vector machine (SVM) forecasting model, an improved SVM model named CPSO-SVM model was proposed. The new model was applied to predicting the short term load, and the improved effect of the new model was proved. The simulation results of the South China Power Market’s actual data show that the new method can effectively improve the forecast accuracy by 2.23% and 3.87%, respectively, compared with the PSO-SVM and SVM methods. Compared with that of the PSO-SVM and SVM methods, the time cost of the new model is only increased by 3.15 and 4.61 s, respectively, which indicates that the CPSO-SVM model gains significant improved effects.
基金Project(50579101) supported by the National Natural Science Foundation of China
文摘A new support vector machine （SVM） optimized by an improved particle swarm optimization （PSO） combined with simulated annealing algorithm （SA） was proposed. By incorporating with the simulated annealing method, the global searching capacity of the particle swarm optimization（SAPSO） was enchanced, and the searching capacity of the particle swarm optimization was studied. Then, the improyed particle swarm optimization algorithm was used to optimize the parameters of SVM （c,σ and ε）. Based on the operational data provided by a regional power grid in north China, the method was used in the actual short term load forecasting. The results show that compared to the PSO-SVM and the traditional SVM, the average time of the proposed method in the experimental process reduces by 11.6 s and 31.1 s, and the precision of the proposed method increases by 1.24% and 3.18%, respectively. So, the improved method is better than the PSO-SVM and the traditional SVM.
基金supported by Project of the National Natural Science Foundation of China(Grant No.62073256)in part by Shaanxi Provincial Science and Technology Department(Grant No.2020GY-125)。
文摘In order to improve the recognition rate and accuracy rate of projectiles in six sky-screens intersection test system,this work proposes a new recognition method of projectiles by combining particle swarm optimization support vector and spatial-temporal constrain of six sky-screens detection sensor.Based on the measurement principle of the six sky-screens intersection test system and the characteristics of the output signal of the sky-screen,we analyze the existing problems regarding the recognition of projectiles.In order to optimize the projectile recognition effect,we use the support vector machine and basic particle swarm algorithm to form a new recognition algorithm.We set up the particle swarm algorithm optimization support vector projectile information recognition model that conforms to the six sky-screens intersection test system.We also construct a spatial-temporal constrain matching model based on the spatial geometric relationship of six sky-screen intersection,and form a new projectile signal recognition algorithm with six sky-screens spatial-temporal information constraints under the signal classification mechanism of particle swarm optimization algorithm support vector machine.Based on experiments,we obtain the optimal penalty and kernel function radius parameters in the PSO-SVM algorithm;we adjust the parameters of the support vector machine model,train the test signal data of every sky-screen,and gain the projectile signal classification results.Afterwards,according to the signal classification results,we calculate the coordinate parameters of the real projectile by using the spatial-temporal constrain of six sky-screens detection sensor,which verifies the feasibility of the proposed algorithm.
基金the National Nature Science Foundation of China (60775047, 60402024)
文摘The support vector machine （SVM） is a novel machine learning method, which has the ability to approximate nonlinear functions with arbitrary accuracy. Setting parameters well is very crucial for SVM learning results and generalization ability, and now there is no systematic, general method for parameter selection. In this article, the SVM parameter selection for function approximation is regarded as a compound optimization problem and a mutative scale chaos optimization algorithm is employed to search for optimal paraxneter values. The chaos optimization algorithm is an effective way for global optimal and the mutative scale chaos algorithm could improve the search efficiency and accuracy. Several simulation examples show the sensitivity of the SVM parameters and demonstrate the superiority of this proposed method for nonlinear function approximation.
基金supported by the National Natural Science Foundation of China (60873086)the Aeronautical Science Foundation of China(20085153013)the Fundamental Research Found of Northwestern Polytechnical Unirersity (JC200942)
文摘An improved particle swarm optimization（PSO） algorithm is proposed to train the fuzzy support vector machine（FSVM） for pattern multi-classification.In the improved algorithm,the particles studies not only from itself and the best one but also from the mean value of some other particles.In addition,adaptive mutation was introduced to reduce the rate of premature convergence.The experimental results on the synthetic aperture radar（SAR） target recognition of moving and stationary target acquisition and recognition（MSTAR） dataset and character recognition of MNIST database show that the improved algorithm is feasible and effective for fuzzy multi-class SVM training.
基金Project(Z132012)supported by the Second Five Technology-based in Science and Industry Bureau of ChinaProject(YWF1103Q062)supported by the Fundemental Research Funds for the Central Universities in China
文摘A relevance vector machine (RVM) based fault diagnosis method was presented for non-linear circuits. In order to simplify RVM classifier, parameters selection based on particle swarm optimization (PSO) and preprocessing technique based on the kurtosis and entropy of signals were used. Firstly, sinusoidal inputs with different frequencies were applied to the circuit under test (CUT). Then, the resulting frequency responses were sampled to generate features. The frequency response was sampled to compute its kurtosis and entropy, which can show the information capacity of signal. By analyzing the output signals, the proposed method can detect and identify faulty components in circuits. The results indicate that the fault classes can be classified correctly for at least 99% of the test data in example circuit. And the proposed method can diagnose hard and soft faults.
文摘A support vector machine with guadratic polynomial kernel function based nonlinear model multi-step-ahead optimizing predictive controller was presented. A support vector machine based predictive model was established by black-box identification. And a quadratic objective function with receding horizon was selected to obtain the controller output. By solving a nonlinear optimization problem with equality constraint of model output and boundary constraint of controller output using Nelder-Mead simplex direct search method, a sub-optimal control law was achieved in feature space. The effect of the controller was demonstrated on a recognized benchmark problem and a continuous-stirred tank reactor. The simulation results show that the multi-step-ahead predictive controller can be well applied to nonlinear system, with better performance in following reference trajectory and disturbance-rejection.
文摘An improved particle swarm optimization (PSO) algorithm based on ensemble technique is presented. The algorithm combines some previous best positions (pbest) of the particles to get an ensemble position (Epbest), which is used to replace the global best position (gbest). It is compared with the standard PSO algorithm invented by Kennedy and Eberhart and some improved PSO algorithms based on three different benchmark functions. The simulation results show that the improved PSO based on ensemble technique can get better solutions than the standard PSO and some other improved algorithms under all test cases.
文摘Support vector machine has become an increasingly popular tool for machine learning tasks involving classification, regression or novelty detection. Training a support vector machine requires the solution of a very large quadratic programming problem. Traditional optimization methods cannot be directly applied due to memory restrictions. Up to now, several approaches exist for circumventing the above shortcomings and work well. Another learning algorithm, particle swarm optimization, for training SVM is introduted. The method is tested on UCI datasets.
基金the National Natural Science Foundation of China (60574075)
文摘Based on KKT complementary condition in optimization theory, an unconstrained non-differential optimization model for support vector machine is proposed. An adjustable entropy function method is given to deal with the proposed optimization problem and the Newton algorithm is used to figure out the optimal solution. The proposed method can find an optimal solution with a relatively small parameter p, which avoids the numerical overflow in the traditional entropy function methods. It is a new approach to solve support vector machine. The theoretical analysis and experimental results illustrate the feasibility and efficiency of the proposed algorithm.
基金Beijing Natural Science Foundation(KZ201211232039)National Natural Science Foundation of China(51275052)+1 种基金Funding Project for Academic Human Resources Development in Institutions of Higher Learning under the Jurisdiction of Beijing Municipalipality(PHR201106132)PXM2014_014224_000080
文摘Fault diagnosis technology plays an important role in the industries due to the emergency fault of a machine could bring the heavy lost for the people and the company. A fault diagnosis model based on multi-manifold learning and particle swarm optimization support vector machine(PSO-SVM) is studied. This fault diagnosis model is used for a rolling bearing experimental of three kinds faults. The results are verified that this model based on multi-manifold learning and PSO-SVM is good at the fault sensitive features acquisition with effective accuracy.
基金Project(U1508212)supported by the National Natural Science Foundation of ChinaProject(2015M570448)supported by the Postdoctoral Science Foundation of China
文摘To improve the cooling performance, shape optimization of a laidback fan-shaped film cooling hole was performed. Three geometric parameters, including hole length, lateral expansion angle and forward expansion angle, were selected as the design parameters. Numerical model of the film cooling system was established, validated, and used to generate 32 groups of training samples. Least square support vector machine(LS-SVM) was applied for surrogate model, and the optimal design parameters were determined by a kind of chaotic optimization algorithm. As hole length, lateral expansion angle and forward expansion angle are 90 mm, 20° and 5°, the area-averaged film cooling effectiveness can reach its maximum value in the design space. LS-SVM coupled with chaotic optimization algorithm is a promising scheme for the optimization of shaped film cooling holes.
基金Project(50911130366) supported by the National Natural Science Foundation of China
文摘According to the characteristics of large underground caverns, by using the safety factor of surrounding rock mass point as the control standard of cavern stability, RandWPSO-LSSVM optimization feedback method and flow process of large underground cavern anchor parameters were established. By applying the optimization feedback method to actual project, the best anchor parameters of large surge shaft five-tunnel area underground cavern of the Nuozhadu hydropower station were obtained through optimization. The results show that the predicted effect of LSSVM prediction model obtained through RandWPSO optimization is good, reasonable and reliable. Combination of the best anchor parameters obtained is 114131312, that is, the locked anchor bar spacing is 1 m x 1 m, pre-stress is 100 kN, elevation 580.45-586.50 m section anchor bar diameter is 36.00 mm, length is 4.50 m, spacing is 1.5 m × 2.5 m; anchor bar diameter at the five-tunnel area side wall is 25.00 mm, length is 7.50 m, spacing is 1 m× 1.5 m, and the shotcrete thickness is 0.15 m. The feedback analyses show that the optimization feedback method of large underground cavern anchor parameters is reasonable and reliable, which has important guiding significance for ensuring the stability of large underground caverns and for saving project investment.
文摘Support vector machines （SVMs） are initially designed for binary classification. How to effectively extend them for multiclass classification is still an ongoing research topic. A multiclass classifier is constructed by combining SVM^light algorithm with directed acyclic graph SVM （DAGSVM） method, named DAGSVM^light A new method is proposed to select the working set which is identical to the working set selected by SVM^light approach. Experimental results indicate DAGSVM^light is competitive with DAGSMO. It is more suitable for practice use. It may be an especially useful tool for large-scale multiclass classification problems and lead to more widespread use of SVMs in the engineering community due to its good performance.
基金Project(51275024)supported by the National Natural Science Foundations of ChinaProject(2015M580037)supported by China’s Postdoctoral Science FundingProjects(XJ2015002,G-YZ90)supported by Hong Kong Scholars Program Foundations,China
文摘The radial deformation design of turbine disk seriously influences the control of gas turbine high pressure turbine(HPT) blade-tip radial running clearance(BTRRC). To improve the design of BTRRC under continuous operation, the nonlinear dynamic reliability optimization of disk radial deformation was implemented based on extremum response surface method(ERSM), including ERSM-based quadratic function(QF-ERSM) and ERSM-based support vector machine of regression(SR-ERSM). The mathematical models of the two methods were established and the framework of reliability-based dynamic design optimization was developed. The numerical experiments demonstrate that the proposed optimization methods have the promising potential in reducing additional design samples and improving computational efficiency with acceptable precision, in which the SR-ERSM emerges more obviously. Through the case study, we find that disk radial deformation is reduced by about 6.5×10–5 m; δ=1.31×10–3 m is optimal for turbine disk radial deformation design and the proposed methods are verified again. The presented efforts provide an effective optimization method for the nonlinear transient design of motion structures for further research, and enrich mechanical reliability design theory.
