摘要
针对大数据聚类算法计算效率与聚类性能较低的问题,提出了一种基于改进人工蜂群算法与MapReduce的大数据聚类算法。将灰狼优化算法与人工蜂群算法结合,同时提高人工蜂群算法的搜索能力与开发能力,该策略能够有效地提高聚类处理的性能;采用混沌映射与反向学习作为ABC种群的初始化策略,提高搜索的解质量;将聚类算法基于Hadoop的MapReduce编程模型实现,通过最小化类内距离的平方和实现对大数据的聚类处理。实验结果表明,该算法有效地提高了大数据集的聚类质量,同时加快了聚类速度。
Aiming at the problems of low computational efficiency and low clustering performance of clustering algorithms for big data,this paper proposed a clustering algorithm of big data based on the improved ABC algorithm and MapReduce. This algorithm combined the grey wolf optimizer algorithm and ABC algorithm,and improved the exploration and exploitation of the ABC algorithm simultaneously,it could help to improve the clustering performance effectively. The algorithm utilized the chaotic map and backward learning as the initial strategy of ABC colony to improve the solution quality of search procedure. It realized the clustering algorithm based on MapReduce programming model,and realized the clustering process for big data by minimizing the quadratic sum of inner class distances. Experimental results demonstrate that the proposed algorithm improves the clustering quality of big data,and speedups the clustering procedure.
作者
孙倩
陈昊
李超
Sun Qian;Chen Hao;Li Chao(Informationization Management Department,Hubei University,Wuhan 430062,China;School of Computer Science&Information Engineering,Hubei University,Wuhan 430062,China)
出处
《计算机应用研究》
CSCD
北大核心
2020年第6期1707-1710,1764,共5页
Application Research of Computers
基金
湖北省教育厅科学技术研究重点项目(D20141005)。
关键词
数据分析
聚类算法
人工蜂群算法
灰狼优化算法
云计算
分布式计算
data analysis
clustering algorithm
artificial bee colony algorithm(ABC)
grey wolf optimizer algorithm(GWO)
cloud computing
distributed computing
作者简介
孙倩(1980-),女,山东文登人,高级实验师,硕士,主要研究方向为信息安全、系统分析与集成(sunqianaro@126.com);陈昊(1977-),男,教授,博士,主要研究方向为软件工程、智能计算;李超(1965-),男,湖北新洲人,高级实验师,主要研究方向为信息安全、计算机网络.
