In machine learning,randomness is a crucial factor in the success of ensemble learning,and it can be injected into tree-based ensembles by rotating the feature space.However,it is a common practice to rotate the featu...In machine learning,randomness is a crucial factor in the success of ensemble learning,and it can be injected into tree-based ensembles by rotating the feature space.However,it is a common practice to rotate the feature space randomly.Thus,a large number of trees are required to ensure the performance of the ensemble model.This random rotation method is theoretically feasible,but it requires massive computing resources,potentially restricting its applications.A multimodal genetic algorithm based rotation forest(MGARF)algorithm is proposed in this paper to solve this problem.It is a tree-based ensemble learning algorithm for classification,taking advantage of the characteristic of trees to inject randomness by feature rotation.However,this algorithm attempts to select a subset of more diverse and accurate base learners using the multimodal optimization method.The classification accuracy of the proposed MGARF algorithm was evaluated by comparing it with the original random forest and random rotation ensemble methods on 23 UCI classification datasets.Experimental results show that the MGARF method outperforms the other methods,and the number of base learners in MGARF models is much fewer.展开更多
针对传统灰狼优化算法位置更新时勘探与开发失衡,收敛速度慢且陷入局部最优的问题,提出一种改进的灰狼算法(balanced grey wolf algorithm based on fitness back learning,BGWO),引入非线性控制参数,增强算法前期勘探能力,加速收敛;在...针对传统灰狼优化算法位置更新时勘探与开发失衡,收敛速度慢且陷入局部最优的问题,提出一种改进的灰狼算法(balanced grey wolf algorithm based on fitness back learning,BGWO),引入非线性控制参数,增强算法前期勘探能力,加速收敛;在种群迭代阶段采用重心反向学习的最优适应度权重更新策略,平衡算法的勘探与开发。16组基准函数测试结果表明,改进后算法能自适应跳出局部最优,在加快算法收敛速度的同时提高全局收敛能力与精度。将BGWO应用于PV型旋风分离器粒级效率GBDT(gradient boosting decision tree)的建模,提高了GBDT的精度,模型相关系数0.980,均方误差0.00079,BGWO-GBDT与GBDT、PSO-GBDT和GWO-GBDT相对比,建模精度和稳定性明显提高,验证了BGWO的有效性。展开更多
基金Project(61603274)supported by the National Natural Science Foundation of ChinaProject(2017KJ249)supported by the Research Project of Tianjin Municipal Education Commission,China。
文摘In machine learning,randomness is a crucial factor in the success of ensemble learning,and it can be injected into tree-based ensembles by rotating the feature space.However,it is a common practice to rotate the feature space randomly.Thus,a large number of trees are required to ensure the performance of the ensemble model.This random rotation method is theoretically feasible,but it requires massive computing resources,potentially restricting its applications.A multimodal genetic algorithm based rotation forest(MGARF)algorithm is proposed in this paper to solve this problem.It is a tree-based ensemble learning algorithm for classification,taking advantage of the characteristic of trees to inject randomness by feature rotation.However,this algorithm attempts to select a subset of more diverse and accurate base learners using the multimodal optimization method.The classification accuracy of the proposed MGARF algorithm was evaluated by comparing it with the original random forest and random rotation ensemble methods on 23 UCI classification datasets.Experimental results show that the MGARF method outperforms the other methods,and the number of base learners in MGARF models is much fewer.
文摘针对传统灰狼优化算法位置更新时勘探与开发失衡,收敛速度慢且陷入局部最优的问题,提出一种改进的灰狼算法(balanced grey wolf algorithm based on fitness back learning,BGWO),引入非线性控制参数,增强算法前期勘探能力,加速收敛;在种群迭代阶段采用重心反向学习的最优适应度权重更新策略,平衡算法的勘探与开发。16组基准函数测试结果表明,改进后算法能自适应跳出局部最优,在加快算法收敛速度的同时提高全局收敛能力与精度。将BGWO应用于PV型旋风分离器粒级效率GBDT(gradient boosting decision tree)的建模,提高了GBDT的精度,模型相关系数0.980,均方误差0.00079,BGWO-GBDT与GBDT、PSO-GBDT和GWO-GBDT相对比,建模精度和稳定性明显提高,验证了BGWO的有效性。
