The fuzzy C-means clustering algorithm(FCM) to the fuzzy kernel C-means clustering algorithm(FKCM) to effectively perform cluster analysis on the diversiform structures are extended, such as non-hyperspherical data, d...The fuzzy C-means clustering algorithm(FCM) to the fuzzy kernel C-means clustering algorithm(FKCM) to effectively perform cluster analysis on the diversiform structures are extended, such as non-hyperspherical data, data with noise, data with mixture of heterogeneous cluster prototypes, asymmetric data, etc. Based on the Mercer kernel, FKCM clustering algorithm is derived from FCM algorithm united with kernel method. The results of experiments with the synthetic and real data show that the FKCM clustering algorithm is universality and can effectively unsupervised analyze datasets with variform structures in contrast to FCM algorithm. It is can be imagined that kernel-based clustering algorithm is one of important research direction of fuzzy clustering analysis.展开更多
A support vector machine time series forecasting model based on rough set data preprocessing was proposed by combining rough set attribute reduction and support vector machine regression algorithm. First, remove the r...A support vector machine time series forecasting model based on rough set data preprocessing was proposed by combining rough set attribute reduction and support vector machine regression algorithm. First, remove the redundant attribute for forecasting from condition attribute by rough set method; then use the minimum condition attribute set obtained after the reduction and the corresponding initial data, reform a new training sample set which only retain the important attributes influencing the forecasting accuracy; study and train the support vector machine with the training sample obtained after reduction, and then input the reformed testing sample set according to the minimum condition attribute and corresponding initial data. The model was tested and the mapping relation was got between the condition attribute and forecasting variable. Eventually, power supply and demand were forecasted in this model. The average absolute error rates of power consumption of the whole society and yearly maximum load are respectively 14.21% and 13.23%. It shows that RS-SVM time series forecasting model has high forecasting accuracy.展开更多
An h-adaptivity analysis scheme based on multiple scale reproducing kernel particle method was proposed, and two node refinement strategies were constructed using searching-neighbor-nodes(SNN) and local-Delaunay-trian...An h-adaptivity analysis scheme based on multiple scale reproducing kernel particle method was proposed, and two node refinement strategies were constructed using searching-neighbor-nodes(SNN) and local-Delaunay-triangulation(LDT) tech-niques, which were suitable and effective for h-adaptivity analysis on 2-D problems with the regular or irregular distribution of the nodes. The results of multiresolution and h-adaptivity analyses on 2-D linear elastostatics and bending plate problems demonstrate that the improper high-gradient indicator will reduce the convergence property of the h-adaptivity analysis, and that the efficiency of the LDT node refinement strategy is better than SNN, and that the presented h-adaptivity analysis scheme is provided with the validity, stability and good convergence property.展开更多
The high-speed development of space defense technology demands a high state estimation capacity for spacecraft tracking methods.However,reentry flight is accompanied by complex flight environments,which brings to the ...The high-speed development of space defense technology demands a high state estimation capacity for spacecraft tracking methods.However,reentry flight is accompanied by complex flight environments,which brings to the uncertain,complex,and strongly coupled non-Gaussian detection noise.As a result,there are several intractable considerations on the problem of state estimation tasks corrupted by complex non-Gaussian outliers for non-linear dynamics systems in practical application.To address these issues,a new iterated rational quadratic(RQ)kernel high-order unscented Kalman filtering(IRQHUKF)algorithm via capturing the statistics to break through the limitations of the Gaussian assumption is proposed.Firstly,the characteristic analysis of the RQ kernel is investigated in detail,which is the first attempt to carry out an exploration of the heavy-tailed characteristic and the ability on capturing highorder moments of the RQ kernel.Subsequently,the RQ kernel method is first introduced into the UKF algorithm as an error optimization criterion,termed the iterated RQ kernel-UKF(RQ-UKF)algorithm by derived analytically,which not only retains the high-order moments propagation process but also enhances the approximation capacity in the non-Gaussian noise problem for its ability in capturing highorder moments and heavy-tailed characteristics.Meanwhile,to tackle the limitations of the Gaussian distribution assumption in the linearization process of the non-linear systems,the high-order Sigma Points(SP)as a subsidiary role in propagating the state high-order statistics is devised by the moments matching method to improve the RQ-UKF.Finally,to further improve the flexibility of the IRQ-HUKF algorithm in practical application,an adaptive kernel parameter is derived analytically grounded in the Kullback-Leibler divergence(KLD)method and parametric sensitivity analysis of the RQ kernel.The simulation results demonstrate that the novel IRQ-HUKF algorithm is more robust and outperforms the existing advanced UKF with respect to the kernel method in reentry vehicle tracking scenarios under various noise environments.展开更多
The kernel energy method(KEM) has been shown to provide fast and accurate molecular energy calculations for molecules at their equilibrium geometries.KEM breaks a molecule into smaller subsets,called kernels,for the p...The kernel energy method(KEM) has been shown to provide fast and accurate molecular energy calculations for molecules at their equilibrium geometries.KEM breaks a molecule into smaller subsets,called kernels,for the purposes of calculation.The results from the kernels are summed according to an expression characteristic of KEM to obtain the full molecule energy.A generalization of the kernel expansion to density matrices provides the full molecule density matrix and orbitals.In this study,the kernel expansion for the density matrix is examined in the context of density functional theory(DFT) Kohn-Sham(KS) calculations.A kernel expansion for the one-body density matrix analogous to the kernel expansion for energy is defined,and is then converted into a normalizedprojector by using the Clinton algorithm.Such normalized projectors are factorizable into linear combination of atomic orbitals(LCAO) matrices that deliver full-molecule Kohn-Sham molecular orbitals in the atomic orbital basis.Both straightforward KEM energies and energies from a normalized,idempotent density matrix obtained from a density matrix kernel expansion to which the Clinton algorithm has been applied are compared to reference energies obtained from calculations on the full system without any kernel expansion.Calculations were performed both for a simple proof-of-concept system consisting of three atoms in a linear configuration and for a water cluster consisting of twelve water molecules.In the case of the proof-of-concept system,calculations were performed using the STO-3 G and6-31 G(d,p) bases over a range of atomic separations,some very far from equilibrium.The water cluster was calculated in the 6-31 G(d,p) basis at an equilibrium geometry.The normalized projector density energies are more accurate than the straightforward KEM energy results in nearly all cases.In the case of the water cluster,the energy of the normalized projector is approximately four times more accurate than the straightforward KEM energy result.The KS density matrices of this study are applicable to quantum crystallography.展开更多
The meshless method is a new numerical technology presented in recent years.It uses the moving least square(MLS) approximation as its shape function,and it is determined by the basic function and weight function.The w...The meshless method is a new numerical technology presented in recent years.It uses the moving least square(MLS) approximation as its shape function,and it is determined by the basic function and weight function.The weight function is the mainly determining factor,so it greatly affects the accuracy of the computational results.The process of cylinder compression was analyzed by using rigid-plastic meshless variational principle and programming reproducing kernel partial method(RKPM),the influence of node number,weight functions and size factor on the solution was discussed and the suitable range of size factor was obtained.Compared with the finite element method(FEM),the feasibility and validity of the method were verified,which proves a good supplement of FEM in this field and provides a good guidance for the application of meshless in actual engineering.展开更多
Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is...Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is to learn the kernel from the data automatically. A general regularized risk functional （RRF） criterion for kernel matrix learning is proposed. Compared with the RRF criterion, general RRF criterion takes into account the geometric distributions of the embedding data points. It is proven that the distance between different geometric distdbutions can be estimated by their centroid distance in the reproducing kernel Hilbert space. Using this criterion for kernel matrix learning leads to a convex quadratically constrained quadratic programming （QCQP） problem. For several commonly used loss functions, their mathematical formulations are given. Experiment results on a collection of benchmark data sets demonstrate the effectiveness of the proposed method.展开更多
A recursive Kernel eigenspace updating algorithm was proposed to build the soft sensor for end-product quality.The updating procedure was composed of two sub-stages,i.e.firstly performing forward increasing updating a...A recursive Kernel eigenspace updating algorithm was proposed to build the soft sensor for end-product quality.The updating procedure was composed of two sub-stages,i.e.firstly performing forward increasing updating and then followed by backward decreasing updating,which drastically decreased the required computation workload.Further,the whole Kernel matrix did not need to be stored.Simulation study on the Tennessee Eastman process showed that the consequent impurity component model had satisfying precision under both normal and faulty operations,which was obviously superior to the offline batch model and meanwhile approximated the performance of model obtained by successively applying the time-consuming traditional eigenvalue numerical algorithm.展开更多
Driven by the challenge of integrating large amount of experimental data, classification technique emerges as one of the major and popular tools in computational biology and bioinformatics research. Machine learning m...Driven by the challenge of integrating large amount of experimental data, classification technique emerges as one of the major and popular tools in computational biology and bioinformatics research. Machine learning methods, especially kernel methods with Support Vector Machines （SVMs） are very popular and effective tools. In the perspective of kernel matrix, a technique namely Eigen- matrix translation has been introduced for protein data classification. The Eigen-matrix translation strategy has a lot of nice properties which deserve more exploration. This paper investigates the major role of Eigen-matrix translation in classification. The authors propose that its importance lies in the dimension reduction of predictor attributes within the data set. This is very important when the dimension of features is huge. The authors show by numerical experiments on real biological data sets that the proposed framework is crucial and effective in improving classification accuracy. This can therefore serve as a novel perspective for future research in dimension reduction problems.展开更多
Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel...Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.展开更多
文摘The fuzzy C-means clustering algorithm(FCM) to the fuzzy kernel C-means clustering algorithm(FKCM) to effectively perform cluster analysis on the diversiform structures are extended, such as non-hyperspherical data, data with noise, data with mixture of heterogeneous cluster prototypes, asymmetric data, etc. Based on the Mercer kernel, FKCM clustering algorithm is derived from FCM algorithm united with kernel method. The results of experiments with the synthetic and real data show that the FKCM clustering algorithm is universality and can effectively unsupervised analyze datasets with variform structures in contrast to FCM algorithm. It is can be imagined that kernel-based clustering algorithm is one of important research direction of fuzzy clustering analysis.
基金Project(70373017) supported by the National Natural Science Foundation of China
文摘A support vector machine time series forecasting model based on rough set data preprocessing was proposed by combining rough set attribute reduction and support vector machine regression algorithm. First, remove the redundant attribute for forecasting from condition attribute by rough set method; then use the minimum condition attribute set obtained after the reduction and the corresponding initial data, reform a new training sample set which only retain the important attributes influencing the forecasting accuracy; study and train the support vector machine with the training sample obtained after reduction, and then input the reformed testing sample set according to the minimum condition attribute and corresponding initial data. The model was tested and the mapping relation was got between the condition attribute and forecasting variable. Eventually, power supply and demand were forecasted in this model. The average absolute error rates of power consumption of the whole society and yearly maximum load are respectively 14.21% and 13.23%. It shows that RS-SVM time series forecasting model has high forecasting accuracy.
基金Project supported by the National Natural Science Foundation of China (No.10202018)
文摘An h-adaptivity analysis scheme based on multiple scale reproducing kernel particle method was proposed, and two node refinement strategies were constructed using searching-neighbor-nodes(SNN) and local-Delaunay-triangulation(LDT) tech-niques, which were suitable and effective for h-adaptivity analysis on 2-D problems with the regular or irregular distribution of the nodes. The results of multiresolution and h-adaptivity analyses on 2-D linear elastostatics and bending plate problems demonstrate that the improper high-gradient indicator will reduce the convergence property of the h-adaptivity analysis, and that the efficiency of the LDT node refinement strategy is better than SNN, and that the presented h-adaptivity analysis scheme is provided with the validity, stability and good convergence property.
基金supported by the National Natural Science Foundation of China under Grant No.12072090.
文摘The high-speed development of space defense technology demands a high state estimation capacity for spacecraft tracking methods.However,reentry flight is accompanied by complex flight environments,which brings to the uncertain,complex,and strongly coupled non-Gaussian detection noise.As a result,there are several intractable considerations on the problem of state estimation tasks corrupted by complex non-Gaussian outliers for non-linear dynamics systems in practical application.To address these issues,a new iterated rational quadratic(RQ)kernel high-order unscented Kalman filtering(IRQHUKF)algorithm via capturing the statistics to break through the limitations of the Gaussian assumption is proposed.Firstly,the characteristic analysis of the RQ kernel is investigated in detail,which is the first attempt to carry out an exploration of the heavy-tailed characteristic and the ability on capturing highorder moments of the RQ kernel.Subsequently,the RQ kernel method is first introduced into the UKF algorithm as an error optimization criterion,termed the iterated RQ kernel-UKF(RQ-UKF)algorithm by derived analytically,which not only retains the high-order moments propagation process but also enhances the approximation capacity in the non-Gaussian noise problem for its ability in capturing highorder moments and heavy-tailed characteristics.Meanwhile,to tackle the limitations of the Gaussian distribution assumption in the linearization process of the non-linear systems,the high-order Sigma Points(SP)as a subsidiary role in propagating the state high-order statistics is devised by the moments matching method to improve the RQ-UKF.Finally,to further improve the flexibility of the IRQ-HUKF algorithm in practical application,an adaptive kernel parameter is derived analytically grounded in the Kullback-Leibler divergence(KLD)method and parametric sensitivity analysis of the RQ kernel.The simulation results demonstrate that the novel IRQ-HUKF algorithm is more robust and outperforms the existing advanced UKF with respect to the kernel method in reentry vehicle tracking scenarios under various noise environments.
文摘The kernel energy method(KEM) has been shown to provide fast and accurate molecular energy calculations for molecules at their equilibrium geometries.KEM breaks a molecule into smaller subsets,called kernels,for the purposes of calculation.The results from the kernels are summed according to an expression characteristic of KEM to obtain the full molecule energy.A generalization of the kernel expansion to density matrices provides the full molecule density matrix and orbitals.In this study,the kernel expansion for the density matrix is examined in the context of density functional theory(DFT) Kohn-Sham(KS) calculations.A kernel expansion for the one-body density matrix analogous to the kernel expansion for energy is defined,and is then converted into a normalizedprojector by using the Clinton algorithm.Such normalized projectors are factorizable into linear combination of atomic orbitals(LCAO) matrices that deliver full-molecule Kohn-Sham molecular orbitals in the atomic orbital basis.Both straightforward KEM energies and energies from a normalized,idempotent density matrix obtained from a density matrix kernel expansion to which the Clinton algorithm has been applied are compared to reference energies obtained from calculations on the full system without any kernel expansion.Calculations were performed both for a simple proof-of-concept system consisting of three atoms in a linear configuration and for a water cluster consisting of twelve water molecules.In the case of the proof-of-concept system,calculations were performed using the STO-3 G and6-31 G(d,p) bases over a range of atomic separations,some very far from equilibrium.The water cluster was calculated in the 6-31 G(d,p) basis at an equilibrium geometry.The normalized projector density energies are more accurate than the straightforward KEM energy results in nearly all cases.In the case of the water cluster,the energy of the normalized projector is approximately four times more accurate than the straightforward KEM energy result.The KS density matrices of this study are applicable to quantum crystallography.
基金Project(02103) supported by the National Education Department of ChinaProject(200509) supported by the Central South University of Forestry and Technology+1 种基金Project(07031B) supported by Scientific Research Fund of Central South University of Forestry and TechnologyProject supported by the Rewarding Project for Excellent PhD Thesis of Hunan Province,China
文摘The meshless method is a new numerical technology presented in recent years.It uses the moving least square(MLS) approximation as its shape function,and it is determined by the basic function and weight function.The weight function is the mainly determining factor,so it greatly affects the accuracy of the computational results.The process of cylinder compression was analyzed by using rigid-plastic meshless variational principle and programming reproducing kernel partial method(RKPM),the influence of node number,weight functions and size factor on the solution was discussed and the suitable range of size factor was obtained.Compared with the finite element method(FEM),the feasibility and validity of the method were verified,which proves a good supplement of FEM in this field and provides a good guidance for the application of meshless in actual engineering.
基金supported by the National Natural Science Fundation of China (60736021)the Joint Funds of NSFC-Guangdong Province(U0735003)
文摘Kernel-based methods work by embedding the data into a feature space and then searching linear hypothesis among the embedding data points. The performance is mostly affected by which kernel is used. A promising way is to learn the kernel from the data automatically. A general regularized risk functional （RRF） criterion for kernel matrix learning is proposed. Compared with the RRF criterion, general RRF criterion takes into account the geometric distributions of the embedding data points. It is proven that the distance between different geometric distdbutions can be estimated by their centroid distance in the reproducing kernel Hilbert space. Using this criterion for kernel matrix learning leads to a convex quadratically constrained quadratic programming （QCQP） problem. For several commonly used loss functions, their mathematical formulations are given. Experiment results on a collection of benchmark data sets demonstrate the effectiveness of the proposed method.
文摘A recursive Kernel eigenspace updating algorithm was proposed to build the soft sensor for end-product quality.The updating procedure was composed of two sub-stages,i.e.firstly performing forward increasing updating and then followed by backward decreasing updating,which drastically decreased the required computation workload.Further,the whole Kernel matrix did not need to be stored.Simulation study on the Tennessee Eastman process showed that the consequent impurity component model had satisfying precision under both normal and faulty operations,which was obviously superior to the offline batch model and meanwhile approximated the performance of model obtained by successively applying the time-consuming traditional eigenvalue numerical algorithm.
基金supported by Research Grants Council of Hong Kong under Grant No.17301214HKU CERG Grants,Fundamental Research Funds for the Central Universities+2 种基金the Research Funds of Renmin University of ChinaHung Hing Ying Physical Research Grantthe Natural Science Foundation of China under Grant No.11271144
文摘Driven by the challenge of integrating large amount of experimental data, classification technique emerges as one of the major and popular tools in computational biology and bioinformatics research. Machine learning methods, especially kernel methods with Support Vector Machines （SVMs） are very popular and effective tools. In the perspective of kernel matrix, a technique namely Eigen- matrix translation has been introduced for protein data classification. The Eigen-matrix translation strategy has a lot of nice properties which deserve more exploration. This paper investigates the major role of Eigen-matrix translation in classification. The authors propose that its importance lies in the dimension reduction of predictor attributes within the data set. This is very important when the dimension of features is huge. The authors show by numerical experiments on real biological data sets that the proposed framework is crucial and effective in improving classification accuracy. This can therefore serve as a novel perspective for future research in dimension reduction problems.
基金Sponsored by the National Natural Science Foundation of China(51006052)
文摘Extreme learning machine(ELM) has attracted much attention in recent years due to its fast convergence and good performance.Merging both ELM and support vector machine is an important trend,thus yielding an ELM kernel.ELM kernel based methods are able to solve the nonlinear problems by inducing an explicit mapping compared with the commonly-used kernels such as Gaussian kernel.In this paper,the ELM kernel is extended to the least squares support vector regression(LSSVR),so ELM-LSSVR was proposed.ELM-LSSVR can be used to reduce the training and test time simultaneously without extra techniques such as sequential minimal optimization and pruning mechanism.Moreover,the memory space for the training and test was relieved.To confirm the efficacy and feasibility of the proposed ELM-LSSVR,the experiments are reported to demonstrate that ELM-LSSVR takes the advantage of training and test time with comparable accuracy to other algorithms.
