A novel algorithm for constructing support vector machine regression ensemble is proposed. As to regression prediction, support vector machine regression (SVMR) ensemble is proposed by resampling from given training...A novel algorithm for constructing support vector machine regression ensemble is proposed. As to regression prediction, support vector machine regression (SVMR) ensemble is proposed by resampling from given training data sets repeatedly and aggregating several independent SVMRs, each of which is trained to use a replicated training set. After training, several independently trained SVMRs need to be aggregated in an appropriate combination manner. Generally, the linear weighting is usually used like expert weighting score in Boosting Regression and it is without optimization capacity. Three combination techniques are proposed, including simple arithmetic mean, linear least square error weighting and nonlinear hierarchical combining that uses another upper-layer SVMR to combine several lower-layer SVMRs. Finally, simulation experiments demonstrate the accuracy and validity of the presented algorithm.展开更多
Rockburst prediction is of vital significance to the design and construction of underground hard rock mines.A rockburst database consisting of 102 case histories,i.e.,1998−2011 period data from 14 hard rock mines was ...Rockburst prediction is of vital significance to the design and construction of underground hard rock mines.A rockburst database consisting of 102 case histories,i.e.,1998−2011 period data from 14 hard rock mines was examined for rockburst prediction in burst-prone mines by three tree-based ensemble methods.The dataset was examined with six widely accepted indices which are:the maximum tangential stress around the excavation boundary(MTS),uniaxial compressive strength(UCS)and uniaxial tensile strength(UTS)of the intact rock,stress concentration factor(SCF),rock brittleness index(BI),and strain energy storage index(EEI).Two boosting(AdaBoost.M1,SAMME)and bagging algorithms with classification trees as baseline classifier on ability to learn rockburst were evaluated.The available dataset was randomly divided into training set(2/3 of whole datasets)and testing set(the remaining datasets).Repeated 10-fold cross validation(CV)was applied as the validation method for tuning the hyper-parameters.The margin analysis and the variable relative importance were employed to analyze some characteristics of the ensembles.According to 10-fold CV,the accuracy analysis of rockburst dataset demonstrated that the best prediction method for the potential of rockburst is bagging when compared to AdaBoost.M1,SAMME algorithms and empirical criteria methods.展开更多
PM_(2.5) forecasting technology can provide a scientific and effective way to assist environmental governance and protect public health.To forecast PM_(2.5),an enhanced hybrid ensemble deep learning model is proposed ...PM_(2.5) forecasting technology can provide a scientific and effective way to assist environmental governance and protect public health.To forecast PM_(2.5),an enhanced hybrid ensemble deep learning model is proposed in this research.The whole framework of the proposed model can be generalized as follows:the original PM_(2.5) series is decomposed into 8 sub-series with different frequency characteristics by variational mode decomposition(VMD);the long short-term memory(LSTM)network,echo state network(ESN),and temporal convolutional network(TCN)are applied for parallel forecasting for 8 different frequency PM_(2.5) sub-series;the gradient boosting decision tree(GBDT)is applied to assemble and reconstruct the forecasting results of LSTM,ESN and TCN.By comparing the forecasting data of the models over 3 PM_(2.5) series collected from Shenyang,Changsha and Shenzhen,the conclusions can be drawn that GBDT is a more effective method to integrate the forecasting result than traditional heuristic algorithms;MAE values of the proposed model on 3 PM_(2.5) series are 1.587,1.718 and 1.327μg/m3,respectively and the proposed model achieves more accurate results for all experiments than sixteen alternative forecasting models which contain three state-of-the-art models.展开更多
To accelerate the selection process of feature subsets in the rough set theory (RST), an ensemble elitist roles based quantum game (EERQG) algorithm is proposed for feature selec- tion. Firstly, the multilevel eli...To accelerate the selection process of feature subsets in the rough set theory (RST), an ensemble elitist roles based quantum game (EERQG) algorithm is proposed for feature selec- tion. Firstly, the multilevel elitist roles based dynamics equilibrium strategy is established, and both immigration and emigration of elitists are able to be self-adaptive to balance between exploration and exploitation for feature selection. Secondly, the utility matrix of trust margins is introduced to the model of multilevel elitist roles to enhance various elitist roles' performance of searching the optimal feature subsets, and the win-win utility solutions for feature selec- tion can be attained. Meanwhile, a novel ensemble quantum game strategy is designed as an intriguing exhibiting structure to perfect the dynamics equilibrium of multilevel elitist roles. Finally, the en- semble manner of multilevel elitist roles is employed to achieve the global minimal feature subset, which will greatly improve the fea- sibility and effectiveness. Experiment results show the proposed EERQG algorithm has superiority compared to the existing feature selection algorithms.展开更多
Target maneuver trajectory prediction is an important prerequisite for air combat situation awareness and maneuver decision-making.However,how to use a large amount of trajectory data generated by air combat confronta...Target maneuver trajectory prediction is an important prerequisite for air combat situation awareness and maneuver decision-making.However,how to use a large amount of trajectory data generated by air combat confrontation training to achieve real-time and accurate prediction of target maneuver trajectory is an urgent problem to be solved.To solve this problem,in this paper,a hybrid algorithm based on transfer learning,online learning,ensemble learning,regularization technology,target maneuvering segmentation point recognition algorithm,and Volterra series,abbreviated as AERTrOS-Volterra is proposed.Firstly,the model makes full use of a large number of trajectory sample data generated by air combat confrontation training,and constructs a Tr-Volterra algorithm framework suitable for air combat target maneuver trajectory prediction,which realizes the extraction of effective information from the historical trajectory data.Secondly,in order to improve the real-time online prediction accuracy and robustness of the prediction model in complex electromagnetic environments,on the basis of the TrVolterra algorithm framework,a robust regularized online Sequential Volterra prediction model is proposed by integrating online learning method,regularization technology and inverse weighting calculation method based on the priori error.Finally,inspired by the preferable performance of models ensemble,ensemble learning scheme is also incorporated into our proposed algorithm,which adaptively updates the ensemble prediction model according to the performance of the model on real-time samples and the recognition results of target maneuvering segmentation points,including the adaptation of model weights;adaptation of parameters;and dynamic inclusion and removal of models.Compared with many existing time series prediction methods,the newly proposed target maneuver trajectory prediction algorithm can fully mine the prior knowledge contained in the historical data to assist the current prediction.The rationality and effectiveness of the proposed algorithm are verified by simulation on three sets of chaotic time series data sets and a set of real target maneuver trajectory data sets.展开更多
Fault diagnosis plays an important role in complicated industrial process.It is a challenging task to detect,identify and locate faults quickly and accurately for large-scale process system.To solve the problem,a nove...Fault diagnosis plays an important role in complicated industrial process.It is a challenging task to detect,identify and locate faults quickly and accurately for large-scale process system.To solve the problem,a novel Multi Boost-based integrated ENN(extension neural network) fault diagnosis method is proposed.Fault data of complicated chemical process have some difficult-to-handle characteristics,such as high-dimension,non-linear and non-Gaussian distribution,so we use margin discriminant projection(MDP) algorithm to reduce dimensions and extract main features.Then,the affinity propagation(AP) clustering method is used to select core data and boundary data as training samples to reduce memory consumption and shorten learning time.Afterwards,an integrated ENN classifier based on Multi Boost strategy is constructed to identify fault types.The artificial data sets are tested to verify the effectiveness of the proposed method and make a detailed sensitivity analysis for the key parameters.Finally,a real industrial system—Tennessee Eastman(TE) process is employed to evaluate the performance of the proposed method.And the results show that the proposed method is efficient and capable to diagnose various types of faults in complicated chemical process.展开更多
Because most ensemble learning algorithms use the centralized model, and the training instances must be centralized on a single station, it is difficult to centralize the training data on a station. A distributed ense...Because most ensemble learning algorithms use the centralized model, and the training instances must be centralized on a single station, it is difficult to centralize the training data on a station. A distributed ensemble learning algorithm is proposed which has two kinds of weight genes of instances that denote the global distribution and the local distribution. Instead of the repeated sampling method in the standard ensemble learning, non-balance sampling from each station is used to train the base classifier set of each station. The concept of the effective nearby region for local integration classifier is proposed, and is used for the dynamic integration method of multiple classifiers in distributed environment. The experiments show that the ensemble learning algorithm in distributed environment proposed could reduce the time of training the base classifiers effectively, and ensure the classify performance is as same as the centralized learning method.展开更多
Underwater acoustic signal processing is one of the research hotspots in underwater acoustics.Noise reduction of underwater acoustic signals is the key to underwater acoustic signal processing.Owing to the complexity ...Underwater acoustic signal processing is one of the research hotspots in underwater acoustics.Noise reduction of underwater acoustic signals is the key to underwater acoustic signal processing.Owing to the complexity of marine environment and the particularity of underwater acoustic channel,noise reduction of underwater acoustic signals has always been a difficult challenge in the field of underwater acoustic signal processing.In order to solve the dilemma,we proposed a novel noise reduction technique for underwater acoustic signals based on complete ensemble empirical mode decomposition with adaptive noise(CEEMDAN),minimum mean square variance criterion(MMSVC) and least mean square adaptive filter(LMSAF).This noise reduction technique,named CEEMDAN-MMSVC-LMSAF,has three main advantages:(i) as an improved algorithm of empirical mode decomposition(EMD) and ensemble EMD(EEMD),CEEMDAN can better suppress mode mixing,and can avoid selecting the number of decomposition in variational mode decomposition(VMD);(ii) MMSVC can identify noisy intrinsic mode function(IMF),and can avoid selecting thresholds of different permutation entropies;(iii) for noise reduction of noisy IMFs,LMSAF overcomes the selection of deco mposition number and basis function for wavelet noise reduction.Firstly,CEEMDAN decomposes the original signal into IMFs,which can be divided into noisy IMFs and real IMFs.Then,MMSVC and LMSAF are used to detect identify noisy IMFs and remove noise components from noisy IMFs.Finally,both denoised noisy IMFs and real IMFs are reconstructed and the final denoised signal is obtained.Compared with other noise reduction techniques,the validity of CEEMDAN-MMSVC-LMSAF can be proved by the analysis of simulation signals and real underwater acoustic signals,which has the better noise reduction effect and has practical application value.CEEMDAN-MMSVC-LMSAF also provides a reliable basis for the detection,feature extraction,classification and recognition of underwater acoustic signals.展开更多
The density functional theory and its extension to ensembles of excited states can be formalized as thermodynamics. However, these theories are not unique because one of their key quantities, the kinetic energy densit...The density functional theory and its extension to ensembles of excited states can be formalized as thermodynamics. However, these theories are not unique because one of their key quantities, the kinetic energy density,can be defined in several ways. Usually, the everywhere positive gradient form is applied; however, other forms are also acceptable, provided they integrate to the true kinetic energy. Recently, a kinetic energy density of the ground-state theory maximizing the information entropy has been proposed. Here, ensemble kinetic energy density, leading to extremum information entropy, is derived via constrained search. The corresponding ensemble temperature is found to be constant.展开更多
The concept of connected vehicles is with great potentials for enhancing the road transportation systems in the future. To support the functions and applications under the connected vehicles frame, the estimation of d...The concept of connected vehicles is with great potentials for enhancing the road transportation systems in the future. To support the functions and applications under the connected vehicles frame, the estimation of dynamic states of the vehicles under the cooperative environments is a fundamental issue. By integrating multiple sensors, localization modules in OBUs(on-board units) require effective estimation solutions to cope with various operation conditions. Based on the filtering estimation framework for sensor fusion, an ensemble Kalman filter(En KF) is introduced to estimate the vehicle's state with observations from navigation satellites and neighborhood vehicles, and the original En KF solution is improved by using the cubature transformation to fulfill the requirements of the nonlinearity approximation capability, where the conventional ensemble analysis operation in En KF is modified to enhance the estimation performance without increasing the computational burden significantly. Simulation results from a nonlinear case and the cooperative vehicle localization scenario illustrate the capability of the proposed filter, which is crucial to realize the active safety of connected vehicles in future intelligent transportation.展开更多
An improved particle swarm optimization (PSO) algorithm based on ensemble technique is presented. The algorithm combines some previous best positions (pbest) of the particles to get an ensemble position (Epbest), whic...An improved particle swarm optimization (PSO) algorithm based on ensemble technique is presented. The algorithm combines some previous best positions (pbest) of the particles to get an ensemble position (Epbest), which is used to replace the global best position (gbest). It is compared with the standard PSO algorithm invented by Kennedy and Eberhart and some improved PSO algorithms based on three different benchmark functions. The simulation results show that the improved PSO based on ensemble technique can get better solutions than the standard PSO and some other improved algorithms under all test cases.展开更多
基金The project was supported by the National Science Foundation of China (70572045)
文摘A novel algorithm for constructing support vector machine regression ensemble is proposed. As to regression prediction, support vector machine regression (SVMR) ensemble is proposed by resampling from given training data sets repeatedly and aggregating several independent SVMRs, each of which is trained to use a replicated training set. After training, several independently trained SVMRs need to be aggregated in an appropriate combination manner. Generally, the linear weighting is usually used like expert weighting score in Boosting Regression and it is without optimization capacity. Three combination techniques are proposed, including simple arithmetic mean, linear least square error weighting and nonlinear hierarchical combining that uses another upper-layer SVMR to combine several lower-layer SVMRs. Finally, simulation experiments demonstrate the accuracy and validity of the presented algorithm.
基金Projects(41807259,51604109)supported by the National Natural Science Foundation of ChinaProject(2020CX040)supported by the Innovation-Driven Project of Central South University,ChinaProject(2018JJ3693)supported by the Natural Science Foundation of Hunan Province,China。
文摘Rockburst prediction is of vital significance to the design and construction of underground hard rock mines.A rockburst database consisting of 102 case histories,i.e.,1998−2011 period data from 14 hard rock mines was examined for rockburst prediction in burst-prone mines by three tree-based ensemble methods.The dataset was examined with six widely accepted indices which are:the maximum tangential stress around the excavation boundary(MTS),uniaxial compressive strength(UCS)and uniaxial tensile strength(UTS)of the intact rock,stress concentration factor(SCF),rock brittleness index(BI),and strain energy storage index(EEI).Two boosting(AdaBoost.M1,SAMME)and bagging algorithms with classification trees as baseline classifier on ability to learn rockburst were evaluated.The available dataset was randomly divided into training set(2/3 of whole datasets)and testing set(the remaining datasets).Repeated 10-fold cross validation(CV)was applied as the validation method for tuning the hyper-parameters.The margin analysis and the variable relative importance were employed to analyze some characteristics of the ensembles.According to 10-fold CV,the accuracy analysis of rockburst dataset demonstrated that the best prediction method for the potential of rockburst is bagging when compared to AdaBoost.M1,SAMME algorithms and empirical criteria methods.
基金Project(52072412)supported by the National Natural Science Foundation of ChinaProject(2019CX005)supported by the Innovation Driven Project of the Central South University,China。
文摘PM_(2.5) forecasting technology can provide a scientific and effective way to assist environmental governance and protect public health.To forecast PM_(2.5),an enhanced hybrid ensemble deep learning model is proposed in this research.The whole framework of the proposed model can be generalized as follows:the original PM_(2.5) series is decomposed into 8 sub-series with different frequency characteristics by variational mode decomposition(VMD);the long short-term memory(LSTM)network,echo state network(ESN),and temporal convolutional network(TCN)are applied for parallel forecasting for 8 different frequency PM_(2.5) sub-series;the gradient boosting decision tree(GBDT)is applied to assemble and reconstruct the forecasting results of LSTM,ESN and TCN.By comparing the forecasting data of the models over 3 PM_(2.5) series collected from Shenyang,Changsha and Shenzhen,the conclusions can be drawn that GBDT is a more effective method to integrate the forecasting result than traditional heuristic algorithms;MAE values of the proposed model on 3 PM_(2.5) series are 1.587,1.718 and 1.327μg/m3,respectively and the proposed model achieves more accurate results for all experiments than sixteen alternative forecasting models which contain three state-of-the-art models.
基金supported by the National Natural Science Foundation of China(6113900261171132+4 种基金61300167)the Natural Science Foundation of Jiangsu Education Department(12KJB520013)the Open Project Program of Jiangsu Provincial Key Laboratory of Computer Information Processing Technologythe Qing Lan Project of Jiangsu Provincethe Starting Foundation for Doctoral Scientific Research,Nantong University(14B20)
文摘To accelerate the selection process of feature subsets in the rough set theory (RST), an ensemble elitist roles based quantum game (EERQG) algorithm is proposed for feature selec- tion. Firstly, the multilevel elitist roles based dynamics equilibrium strategy is established, and both immigration and emigration of elitists are able to be self-adaptive to balance between exploration and exploitation for feature selection. Secondly, the utility matrix of trust margins is introduced to the model of multilevel elitist roles to enhance various elitist roles' performance of searching the optimal feature subsets, and the win-win utility solutions for feature selec- tion can be attained. Meanwhile, a novel ensemble quantum game strategy is designed as an intriguing exhibiting structure to perfect the dynamics equilibrium of multilevel elitist roles. Finally, the en- semble manner of multilevel elitist roles is employed to achieve the global minimal feature subset, which will greatly improve the fea- sibility and effectiveness. Experiment results show the proposed EERQG algorithm has superiority compared to the existing feature selection algorithms.
基金the support of the Fundamental Research Funds for the Air Force Engineering University under Grant No.XZJK2019040。
文摘Target maneuver trajectory prediction is an important prerequisite for air combat situation awareness and maneuver decision-making.However,how to use a large amount of trajectory data generated by air combat confrontation training to achieve real-time and accurate prediction of target maneuver trajectory is an urgent problem to be solved.To solve this problem,in this paper,a hybrid algorithm based on transfer learning,online learning,ensemble learning,regularization technology,target maneuvering segmentation point recognition algorithm,and Volterra series,abbreviated as AERTrOS-Volterra is proposed.Firstly,the model makes full use of a large number of trajectory sample data generated by air combat confrontation training,and constructs a Tr-Volterra algorithm framework suitable for air combat target maneuver trajectory prediction,which realizes the extraction of effective information from the historical trajectory data.Secondly,in order to improve the real-time online prediction accuracy and robustness of the prediction model in complex electromagnetic environments,on the basis of the TrVolterra algorithm framework,a robust regularized online Sequential Volterra prediction model is proposed by integrating online learning method,regularization technology and inverse weighting calculation method based on the priori error.Finally,inspired by the preferable performance of models ensemble,ensemble learning scheme is also incorporated into our proposed algorithm,which adaptively updates the ensemble prediction model according to the performance of the model on real-time samples and the recognition results of target maneuvering segmentation points,including the adaptation of model weights;adaptation of parameters;and dynamic inclusion and removal of models.Compared with many existing time series prediction methods,the newly proposed target maneuver trajectory prediction algorithm can fully mine the prior knowledge contained in the historical data to assist the current prediction.The rationality and effectiveness of the proposed algorithm are verified by simulation on three sets of chaotic time series data sets and a set of real target maneuver trajectory data sets.
基金Project (61203021) supported by the National Natural Science Foundation of ChinaProject (2011216011) supported by the Key Science and Technology Program of Liaoning Province,China+1 种基金Project (2013020024) supported by the Natural Science Foundation of Liaoning Province,ChinaProject (LJQ2015061) supported by the Program for Liaoning Excellent Talents in Universities,China
文摘Fault diagnosis plays an important role in complicated industrial process.It is a challenging task to detect,identify and locate faults quickly and accurately for large-scale process system.To solve the problem,a novel Multi Boost-based integrated ENN(extension neural network) fault diagnosis method is proposed.Fault data of complicated chemical process have some difficult-to-handle characteristics,such as high-dimension,non-linear and non-Gaussian distribution,so we use margin discriminant projection(MDP) algorithm to reduce dimensions and extract main features.Then,the affinity propagation(AP) clustering method is used to select core data and boundary data as training samples to reduce memory consumption and shorten learning time.Afterwards,an integrated ENN classifier based on Multi Boost strategy is constructed to identify fault types.The artificial data sets are tested to verify the effectiveness of the proposed method and make a detailed sensitivity analysis for the key parameters.Finally,a real industrial system—Tennessee Eastman(TE) process is employed to evaluate the performance of the proposed method.And the results show that the proposed method is efficient and capable to diagnose various types of faults in complicated chemical process.
基金the Natural Science Foundation of Shaan’xi Province (2005F51).
文摘Because most ensemble learning algorithms use the centralized model, and the training instances must be centralized on a single station, it is difficult to centralize the training data on a station. A distributed ensemble learning algorithm is proposed which has two kinds of weight genes of instances that denote the global distribution and the local distribution. Instead of the repeated sampling method in the standard ensemble learning, non-balance sampling from each station is used to train the base classifier set of each station. The concept of the effective nearby region for local integration classifier is proposed, and is used for the dynamic integration method of multiple classifiers in distributed environment. The experiments show that the ensemble learning algorithm in distributed environment proposed could reduce the time of training the base classifiers effectively, and ensure the classify performance is as same as the centralized learning method.
基金The authors gratefully acknowledge the support of the National Natural Science Foundation of China(No.11574250).
文摘Underwater acoustic signal processing is one of the research hotspots in underwater acoustics.Noise reduction of underwater acoustic signals is the key to underwater acoustic signal processing.Owing to the complexity of marine environment and the particularity of underwater acoustic channel,noise reduction of underwater acoustic signals has always been a difficult challenge in the field of underwater acoustic signal processing.In order to solve the dilemma,we proposed a novel noise reduction technique for underwater acoustic signals based on complete ensemble empirical mode decomposition with adaptive noise(CEEMDAN),minimum mean square variance criterion(MMSVC) and least mean square adaptive filter(LMSAF).This noise reduction technique,named CEEMDAN-MMSVC-LMSAF,has three main advantages:(i) as an improved algorithm of empirical mode decomposition(EMD) and ensemble EMD(EEMD),CEEMDAN can better suppress mode mixing,and can avoid selecting the number of decomposition in variational mode decomposition(VMD);(ii) MMSVC can identify noisy intrinsic mode function(IMF),and can avoid selecting thresholds of different permutation entropies;(iii) for noise reduction of noisy IMFs,LMSAF overcomes the selection of deco mposition number and basis function for wavelet noise reduction.Firstly,CEEMDAN decomposes the original signal into IMFs,which can be divided into noisy IMFs and real IMFs.Then,MMSVC and LMSAF are used to detect identify noisy IMFs and remove noise components from noisy IMFs.Finally,both denoised noisy IMFs and real IMFs are reconstructed and the final denoised signal is obtained.Compared with other noise reduction techniques,the validity of CEEMDAN-MMSVC-LMSAF can be proved by the analysis of simulation signals and real underwater acoustic signals,which has the better noise reduction effect and has practical application value.CEEMDAN-MMSVC-LMSAF also provides a reliable basis for the detection,feature extraction,classification and recognition of underwater acoustic signals.
文摘The density functional theory and its extension to ensembles of excited states can be formalized as thermodynamics. However, these theories are not unique because one of their key quantities, the kinetic energy density,can be defined in several ways. Usually, the everywhere positive gradient form is applied; however, other forms are also acceptable, provided they integrate to the true kinetic energy. Recently, a kinetic energy density of the ground-state theory maximizing the information entropy has been proposed. Here, ensemble kinetic energy density, leading to extremum information entropy, is derived via constrained search. The corresponding ensemble temperature is found to be constant.
基金Project(4144081)supported by Beijing Natural Science Foundation,ChinaProjects(61403021,U1334211,61490705)supported by the National Natural Science Foundation of China+1 种基金Project(2015RC015)supported by the Fundamental Research Funds for Central Universities,ChinaProject supported by the Foundation of Beijing Key Laboratory for Cooperative Vehicle Infrastructure Systems and Safety Control,China
文摘The concept of connected vehicles is with great potentials for enhancing the road transportation systems in the future. To support the functions and applications under the connected vehicles frame, the estimation of dynamic states of the vehicles under the cooperative environments is a fundamental issue. By integrating multiple sensors, localization modules in OBUs(on-board units) require effective estimation solutions to cope with various operation conditions. Based on the filtering estimation framework for sensor fusion, an ensemble Kalman filter(En KF) is introduced to estimate the vehicle's state with observations from navigation satellites and neighborhood vehicles, and the original En KF solution is improved by using the cubature transformation to fulfill the requirements of the nonlinearity approximation capability, where the conventional ensemble analysis operation in En KF is modified to enhance the estimation performance without increasing the computational burden significantly. Simulation results from a nonlinear case and the cooperative vehicle localization scenario illustrate the capability of the proposed filter, which is crucial to realize the active safety of connected vehicles in future intelligent transportation.
文摘An improved particle swarm optimization (PSO) algorithm based on ensemble technique is presented. The algorithm combines some previous best positions (pbest) of the particles to get an ensemble position (Epbest), which is used to replace the global best position (gbest). It is compared with the standard PSO algorithm invented by Kennedy and Eberhart and some improved PSO algorithms based on three different benchmark functions. The simulation results show that the improved PSO based on ensemble technique can get better solutions than the standard PSO and some other improved algorithms under all test cases.