摘要
尝试将ELK框架在大规模日志实时处理方面的能力抽离出来,将其优势能力与地理信息技术相结合,提供一种基于ELK框架的地理信息动态时空数据获取与挖掘方法。该方法通过建立机制动态采集海量级非结构化数据,并实时筛取与地理要素相关的时空信息,从而实现海量级分析样本下的地理信息时空数据的实时动态分析与挖掘。最后以上海市快速路交通流量作为研究对象验证该方法模型,试验结果能够反映一定的社会潜在规律并提供相关指导价值,证明方法可行,并对方法的优缺点进行了记录与分析。
This paper attempts to extract the ability of ELK inprocessing large-scale and real-time log files,combines its superiority with geographic information technology,and provides a dynamic spatial-temporal data acquisition and mining method based on ELK stack.The method dynamically collects massive unstructured data and screens spatial-temporal information related to geographic elements in real time,so as to realize real-time dynamic analysis and mining of spatial-temporal geo-information data under massive analysis samples,and takes the traffic flow of Shanghai expressway which is used to verify the method model as a research object.The experimental results can reflect certain social potential laws and provide relevant guidance value,prove the method is feasible,and the advantages and disadvantages of the method are recorded and analyzed.
作者
吴嘉琪
WU Jiaqi(Shanghai Institute of Surveying and Mapping,Shanghai 200063,China)
出处
《测绘通报》
CSCD
北大核心
2020年第1期45-49,81,共6页
Bulletin of Surveying and Mapping
关键词
ELK
动态时空数据
实时数据获取与挖掘
非结构化
交通流量
ELK
dynamic spatial-temporal data
real-time data acquisition and mining
unstructured
traffic flow
作者简介
吴嘉琪(1992—),男,硕士,助理工程师,研究方向为地理信息系统。E-mail:jiaqismi@163.com
