Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel...Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.展开更多
In this paper, we propose a multidimensional version of recurrent least squares support vector machines （MDRLS- SVM） to solve the problem about the prediction of chaotic system. To acquire better prediction performa...In this paper, we propose a multidimensional version of recurrent least squares support vector machines （MDRLS- SVM） to solve the problem about the prediction of chaotic system. To acquire better prediction performance, the high-dimensional space, which provides more information on the system than the scalar time series, is first reconstructed utilizing Takens＇s embedding theorem. Then the MDRLS-SVM instead of traditional RLS-SVM is used in the high- dimensional space, and the prediction performance can be improved from the point of view of reconstructed embedding phase space. In addition, the MDRLS-SVM algorithm is analysed in the context of noise, and we also find that the MDRLS-SVM has lower sensitivity to noise than the RLS-SVM.展开更多
Coal mines require various kinds of machinery. The fault diagnosis of this equipment has a great impact on mine production. The problem of incorrect classification of noisy data by traditional support vector machines ...Coal mines require various kinds of machinery. The fault diagnosis of this equipment has a great impact on mine production. The problem of incorrect classification of noisy data by traditional support vector machines is addressed by a proposed Probability Least Squares Support Vector Classification Machine (PLSSVCM). Samples that cannot be definitely determined as belonging to one class will be assigned to a class by the PLSSVCM based on a probability value. This gives the classification results both a qualitative explanation and a quantitative evaluation. Simulation results of a fault diagnosis show that the correct rate of the PLSSVCM is 100%. Even though samples are noisy, the PLSSVCM still can effectively realize multi-class fault diagnosis of a roller bearing. The generalization property of the PLSSVCM is better than that of a neural network and a LSSVCM.展开更多
Least squares support vector machine （LS-SVM） is applied in gas path fault diagnosis for aero engines. Firstly, the deviation data of engine cruise are analyzed. Then, model selection is conducted using pattern sear...Least squares support vector machine （LS-SVM） is applied in gas path fault diagnosis for aero engines. Firstly, the deviation data of engine cruise are analyzed. Then, model selection is conducted using pattern search method. Finally, by decoding aircraft communication addressing and reporting system （ACARS） report, a real-time cruise data set is acquired, and the diagnosis model is adopted to process data. In contrast to the radial basis function （RBF） neutral network, LS-SVM is more suitable for real-time diagnosis of gas turbine engine.展开更多
In order to improve the firing efficiency of projectiles,it is required to use the universal firing table for gun weapon system equipped with a variety of projectiles.Moreover,the foundation of sharing the universal f...In order to improve the firing efficiency of projectiles,it is required to use the universal firing table for gun weapon system equipped with a variety of projectiles.Moreover,the foundation of sharing the universal firing table is the ballistic matching for two types of projectiles.Therefore,a method is proposed in the process of designing new type of projectile.The least squares support vector machine is utilized to build the ballistic trajectory model of the original projectile,thus it is viable to compare the two trajectories.Then the particle swarm optimization is applied to find the combination of trajectory parameters which meet the criterion of ballistic matching best.Finally,examples show the proposed method is valid and feasible.展开更多
A simple and effective mechanism is proposed to realize the parsimoniousness of the online least squares support vector regression （LS-SVR）, and the approach is called the OPLS-SVR for short. Hence, the response tim...A simple and effective mechanism is proposed to realize the parsimoniousness of the online least squares support vector regression （LS-SVR）, and the approach is called the OPLS-SVR for short. Hence, the response time is curtailed. Besides, an OPLS-SVR based analytical redundancy technique is presented to cope with the sensor failure and drift problems to guarantee that the provided signals for the aeroengine controller are correct and acceptable. Experiments on the sensor failure and drift show the effectiveness and the validity of the proposed analytical redundancy.展开更多
A thrust estimator with high precision and excellent real-time performance is needed to mitigate perfor- mance deterioration for future aero-engines. A weight least squares support vector regression is proposed using ...A thrust estimator with high precision and excellent real-time performance is needed to mitigate perfor- mance deterioration for future aero-engines. A weight least squares support vector regression is proposed using a novel weighting strategy. Then a thrust estimator based on the proposed regression is designed for the perfor- mance deterioration. Compared with the existing weighting strategy, the novel one not only satisfies the require- ment of precision but also enhances the real-time performance. Finally, numerical experiments demonstrate the effectiveness and feasibility of the proposed weighted least squares support vector regression for thrust estimator. Key words ： intelligent engine control; least squares ; support vector machine ; performance deterioration展开更多
In order to realize direct thrust control instead of conventional sensors-based control for aero-engine, a thrust estimator with high accuracy is designed by using the boosting technique to improve the performance of ...In order to realize direct thrust control instead of conventional sensors-based control for aero-engine, a thrust estimator with high accuracy is designed by using the boosting technique to improve the performance of least squares support vector regression （LSSVR）. There exist two distinct features compared with the conven- tional boosting technique： （1） Sampling without replacement is used to avoid numerical instability for modeling LSSVR. （2） To realize the sparseness of LSSVR and reduce the computational complexity, only a subset of the training samples is used to construct LSSVR. Thus, this boosting method for LSSVR is called the boosting sparse LSSVR （BSLSSVR）. Finally, simulation results show that BSLSSVR-based thrust estimator can satisfy the requirement of direct thrust control, i.e. , maximum absolute value of relative error of thrust estimation is not more than 5‰.展开更多
The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used t...The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.展开更多
Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel i...Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel in SVM is drawn in a more natural way by using the fuzzy logic method proposed in this paper. This method provides easy hardware implementation and straightforward interpretability. Experiments on two typical chaotic time series predictions have been carried out and the obtained results show that the average CPU time can be reduced significantly at the cost of a small decrease in prediction accuracy, which is favourable for the hardware implementation for chaotic time series prediction.展开更多
The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FS...The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FSA-LSSVR,is proposed.Compared with the previously approximate algorithms,it not only adopts the partial reduction strategy but considers the influence between the previously selected support vectors and the willselected support vector during the process of computing the supporting weights.As a result,I2FSA-LSSVR reduces the number of support vectors and enhances the real-time.To confirm the feasibility and effectiveness of the proposed algorithm,experiments on benchmark data sets are conducted,whose results support the presented I2FSA-LSSVR.展开更多
A method of applying support vector machine (SVM) in speech recognition was proposed, and a speech recognition system for mandarin digits was built up by SVMs. In the system, vectors were linearly extracted from speec...A method of applying support vector machine (SVM) in speech recognition was proposed, and a speech recognition system for mandarin digits was built up by SVMs. In the system, vectors were linearly extracted from speech feature sequence to make up time-aligned input patterns for SVM, and the decisions of several 2-class SVM classifiers were employed for constructing an N-class classifier. Four kinds of SVM kernel functions were compared in the experiments of speaker-independent speech recognition of mandarin digits. And the kernel of radial basis function has the highest accurate rate of 99.33%, which is better than that of the baseline system based on hidden Markov models (HMM) (97.08%). And the experiments also show that SVM can outperform HMM especially when the samples for learning were very limited.展开更多
Conventional machine learning(CML)methods have been successfully applied for gas reservoir prediction.Their prediction accuracy largely depends on the quality of the sample data;therefore,feature optimization of the i...Conventional machine learning(CML)methods have been successfully applied for gas reservoir prediction.Their prediction accuracy largely depends on the quality of the sample data;therefore,feature optimization of the input samples is particularly important.Commonly used feature optimization methods increase the interpretability of gas reservoirs;however,their steps are cumbersome,and the selected features cannot sufficiently guide CML models to mine the intrinsic features of sample data efficiently.In contrast to CML methods,deep learning(DL)methods can directly extract the important features of targets from raw data.Therefore,this study proposes a feature optimization and gas-bearing prediction method based on a hybrid fusion model that combines a convolutional neural network(CNN)and an adaptive particle swarm optimization-least squares support vector machine(APSO-LSSVM).This model adopts an end-to-end algorithm structure to directly extract features from sensitive multicomponent seismic attributes,considerably simplifying the feature optimization.A CNN was used for feature optimization to highlight sensitive gas reservoir information.APSO-LSSVM was used to fully learn the relationship between the features extracted by the CNN to obtain the prediction results.The constructed hybrid fusion model improves gas-bearing prediction accuracy through two processes of feature optimization and intelligent prediction,giving full play to the advantages of DL and CML methods.The prediction results obtained are better than those of a single CNN model or APSO-LSSVM model.In the feature optimization process of multicomponent seismic attribute data,CNN has demonstrated better gas reservoir feature extraction capabilities than commonly used attribute optimization methods.In the prediction process,the APSO-LSSVM model can learn the gas reservoir characteristics better than the LSSVM model and has a higher prediction accuracy.The constructed CNN-APSO-LSSVM model had lower errors and a better fit on the test dataset than the other individual models.This method proves the effectiveness of DL technology for the feature extraction of gas reservoirs and provides a feasible way to combine DL and CML technologies to predict gas reservoirs.展开更多
随着电网中新能源渗透率的增加,传统火电机组调频已无法满足电能质量需求。针对多源场景中传统自动发电控制系统区域控制误差较大的问题,提出一种基于Stackelberg博弈与改进深度神经网络(Stackelberg game and improved deep neural net...随着电网中新能源渗透率的增加,传统火电机组调频已无法满足电能质量需求。针对多源场景中传统自动发电控制系统区域控制误差较大的问题,提出一种基于Stackelberg博弈与改进深度神经网络(Stackelberg game and improved deep neural network,S-DNN)的多源调频协调策略。首先,设计一种改进多层次深度神经网络(deep neural network,DNN),由DNN层、自然梯度提升层、最小二乘支持向量机层顺序递进完成预测、评价、执行动作,输出总调频功率指令。该多层次总调频功率输出模型考虑新能源渗透率对调频系统的动态影响,充分学习历史信息与实时状态中更多的特征,提高了时序调频指令精度。然后基于Stackelberg博弈理论,考虑多源调频特征与协同作用,优化各调频源间的功率分配,提高系统二次调频的经济性。最后,通过算例分析验证了提出的多源调频协调策略的有效性。与传统调频方法相比,所提出的S-DNN多源调频协调策略可有效降低区域控制误差与频率偏差,并降低调频成本。展开更多
基金Sponsored by the National Natural Science Foundation of China(51006052)
文摘Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.
基金Project supported by the National Natural Science Foundation of China （Grant No 90207012）.
文摘In this paper, we propose a multidimensional version of recurrent least squares support vector machines （MDRLS- SVM） to solve the problem about the prediction of chaotic system. To acquire better prediction performance, the high-dimensional space, which provides more information on the system than the scalar time series, is first reconstructed utilizing Takens＇s embedding theorem. Then the MDRLS-SVM instead of traditional RLS-SVM is used in the high- dimensional space, and the prediction performance can be improved from the point of view of reconstructed embedding phase space. In addition, the MDRLS-SVM algorithm is analysed in the context of noise, and we also find that the MDRLS-SVM has lower sensitivity to noise than the RLS-SVM.
基金supported by the Program for New Century Excellent Talents in University (NoNCET- 08-0836)the National Natural Science Foundation of China (Nos60804022, 60974050 and 61072094)+1 种基金the Fok Ying-Tung Education Foundation for Young Teachers (No121066)by the Natural Science Foundation of Jiangsu Province (No.BK2008126)
文摘Coal mines require various kinds of machinery. The fault diagnosis of this equipment has a great impact on mine production. The problem of incorrect classification of noisy data by traditional support vector machines is addressed by a proposed Probability Least Squares Support Vector Classification Machine (PLSSVCM). Samples that cannot be definitely determined as belonging to one class will be assigned to a class by the PLSSVCM based on a probability value. This gives the classification results both a qualitative explanation and a quantitative evaluation. Simulation results of a fault diagnosis show that the correct rate of the PLSSVCM is 100%. Even though samples are noisy, the PLSSVCM still can effectively realize multi-class fault diagnosis of a roller bearing. The generalization property of the PLSSVCM is better than that of a neural network and a LSSVCM.
基金The National High Technology Research and Development Program of China (No.2006AA12A108)
文摘Least squares support vector machine （LS-SVM） is applied in gas path fault diagnosis for aero engines. Firstly, the deviation data of engine cruise are analyzed. Then, model selection is conducted using pattern search method. Finally, by decoding aircraft communication addressing and reporting system （ACARS） report, a real-time cruise data set is acquired, and the diagnosis model is adopted to process data. In contrast to the radial basis function （RBF） neutral network, LS-SVM is more suitable for real-time diagnosis of gas turbine engine.
基金supported by the National Natural Science Foundation of China(No.51006052)
文摘In order to improve the firing efficiency of projectiles,it is required to use the universal firing table for gun weapon system equipped with a variety of projectiles.Moreover,the foundation of sharing the universal firing table is the ballistic matching for two types of projectiles.Therefore,a method is proposed in the process of designing new type of projectile.The least squares support vector machine is utilized to build the ballistic trajectory model of the original projectile,thus it is viable to compare the two trajectories.Then the particle swarm optimization is applied to find the combination of trajectory parameters which meet the criterion of ballistic matching best.Finally,examples show the proposed method is valid and feasible.
基金Supported by the National Natural Science Foundation of China(50576033)the Aeronautical ScienceFoundation of China(04C52019)~~
文摘A simple and effective mechanism is proposed to realize the parsimoniousness of the online least squares support vector regression （LS-SVR）, and the approach is called the OPLS-SVR for short. Hence, the response time is curtailed. Besides, an OPLS-SVR based analytical redundancy technique is presented to cope with the sensor failure and drift problems to guarantee that the provided signals for the aeroengine controller are correct and acceptable. Experiments on the sensor failure and drift show the effectiveness and the validity of the proposed analytical redundancy.
基金Supported by the National Natural Science Foundation of China(51006052)the Nanjing University of Science and Technology Outstanding Scholar Supporting Program~~
文摘A thrust estimator with high precision and excellent real-time performance is needed to mitigate perfor- mance deterioration for future aero-engines. A weight least squares support vector regression is proposed using a novel weighting strategy. Then a thrust estimator based on the proposed regression is designed for the perfor- mance deterioration. Compared with the existing weighting strategy, the novel one not only satisfies the require- ment of precision but also enhances the real-time performance. Finally, numerical experiments demonstrate the effectiveness and feasibility of the proposed weighted least squares support vector regression for thrust estimator. Key words ： intelligent engine control; least squares ; support vector machine ; performance deterioration
基金Supported by the National Natural Science Foundation of China(50576033)the Aeronautical Science Foundation of China(04C52019)~~
文摘In order to realize direct thrust control instead of conventional sensors-based control for aero-engine, a thrust estimator with high accuracy is designed by using the boosting technique to improve the performance of least squares support vector regression （LSSVR）. There exist two distinct features compared with the conven- tional boosting technique： （1） Sampling without replacement is used to avoid numerical instability for modeling LSSVR. （2） To realize the sparseness of LSSVR and reduce the computational complexity, only a subset of the training samples is used to construct LSSVR. Thus, this boosting method for LSSVR is called the boosting sparse LSSVR （BSLSSVR）. Finally, simulation results show that BSLSSVR-based thrust estimator can satisfy the requirement of direct thrust control, i.e. , maximum absolute value of relative error of thrust estimation is not more than 5‰.
基金Supported by the National Natural Science Foundation of China(60473035)~~
文摘The relationship among Mercer kernel, reproducing kernel and positive definite kernel in support vector machine （SVM） is proved and their roles in SVM are discussed. The quadratic form of the kernel matrix is used to confirm the positive definiteness and their construction. Based on the Bochner theorem, some translation invariant kernels are checked in their Fourier domain. Some rotation invariant radial kernels are inspected according to the Schoenberg theorem. Finally, the construction of discrete scaling and wavelet kernels, the kernel selection and the kernel parameter learning are discussed.
文摘Support vector machines （SVM） have been widely used in chaotic time series predictions in recent years. In order to enhance the prediction efficiency of this method and implement it in hardware, the sigmoid kernel in SVM is drawn in a more natural way by using the fuzzy logic method proposed in this paper. This method provides easy hardware implementation and straightforward interpretability. Experiments on two typical chaotic time series predictions have been carried out and the obtained results show that the average CPU time can be reduced significantly at the cost of a small decrease in prediction accuracy, which is favourable for the hardware implementation for chaotic time series prediction.
基金Supported by the National Natural Science Foundation of China(51006052)
文摘The solution of normal least squares support vector regression(LSSVR)is lack of sparseness,which limits the real-time and hampers the wide applications to a certain degree.To overcome this obstacle,a scheme,named I2FSA-LSSVR,is proposed.Compared with the previously approximate algorithms,it not only adopts the partial reduction strategy but considers the influence between the previously selected support vectors and the willselected support vector during the process of computing the supporting weights.As a result,I2FSA-LSSVR reduces the number of support vectors and enhances the real-time.To confirm the feasibility and effectiveness of the proposed algorithm,experiments on benchmark data sets are conducted,whose results support the presented I2FSA-LSSVR.
文摘A method of applying support vector machine (SVM) in speech recognition was proposed, and a speech recognition system for mandarin digits was built up by SVMs. In the system, vectors were linearly extracted from speech feature sequence to make up time-aligned input patterns for SVM, and the decisions of several 2-class SVM classifiers were employed for constructing an N-class classifier. Four kinds of SVM kernel functions were compared in the experiments of speaker-independent speech recognition of mandarin digits. And the kernel of radial basis function has the highest accurate rate of 99.33%, which is better than that of the baseline system based on hidden Markov models (HMM) (97.08%). And the experiments also show that SVM can outperform HMM especially when the samples for learning were very limited.
基金funded by the Natural Science Foundation of Shandong Province (ZR2021MD061ZR2023QD025)+3 种基金China Postdoctoral Science Foundation (2022M721972)National Natural Science Foundation of China (41174098)Young Talents Foundation of Inner Mongolia University (10000-23112101/055)Qingdao Postdoctoral Science Foundation (QDBSH20230102094)。
文摘Conventional machine learning(CML)methods have been successfully applied for gas reservoir prediction.Their prediction accuracy largely depends on the quality of the sample data;therefore,feature optimization of the input samples is particularly important.Commonly used feature optimization methods increase the interpretability of gas reservoirs;however,their steps are cumbersome,and the selected features cannot sufficiently guide CML models to mine the intrinsic features of sample data efficiently.In contrast to CML methods,deep learning(DL)methods can directly extract the important features of targets from raw data.Therefore,this study proposes a feature optimization and gas-bearing prediction method based on a hybrid fusion model that combines a convolutional neural network(CNN)and an adaptive particle swarm optimization-least squares support vector machine(APSO-LSSVM).This model adopts an end-to-end algorithm structure to directly extract features from sensitive multicomponent seismic attributes,considerably simplifying the feature optimization.A CNN was used for feature optimization to highlight sensitive gas reservoir information.APSO-LSSVM was used to fully learn the relationship between the features extracted by the CNN to obtain the prediction results.The constructed hybrid fusion model improves gas-bearing prediction accuracy through two processes of feature optimization and intelligent prediction,giving full play to the advantages of DL and CML methods.The prediction results obtained are better than those of a single CNN model or APSO-LSSVM model.In the feature optimization process of multicomponent seismic attribute data,CNN has demonstrated better gas reservoir feature extraction capabilities than commonly used attribute optimization methods.In the prediction process,the APSO-LSSVM model can learn the gas reservoir characteristics better than the LSSVM model and has a higher prediction accuracy.The constructed CNN-APSO-LSSVM model had lower errors and a better fit on the test dataset than the other individual models.This method proves the effectiveness of DL technology for the feature extraction of gas reservoirs and provides a feasible way to combine DL and CML technologies to predict gas reservoirs.
文摘随着电网中新能源渗透率的增加,传统火电机组调频已无法满足电能质量需求。针对多源场景中传统自动发电控制系统区域控制误差较大的问题,提出一种基于Stackelberg博弈与改进深度神经网络(Stackelberg game and improved deep neural network,S-DNN)的多源调频协调策略。首先,设计一种改进多层次深度神经网络(deep neural network,DNN),由DNN层、自然梯度提升层、最小二乘支持向量机层顺序递进完成预测、评价、执行动作,输出总调频功率指令。该多层次总调频功率输出模型考虑新能源渗透率对调频系统的动态影响,充分学习历史信息与实时状态中更多的特征,提高了时序调频指令精度。然后基于Stackelberg博弈理论,考虑多源调频特征与协同作用,优化各调频源间的功率分配,提高系统二次调频的经济性。最后,通过算例分析验证了提出的多源调频协调策略的有效性。与传统调频方法相比,所提出的S-DNN多源调频协调策略可有效降低区域控制误差与频率偏差,并降低调频成本。
