期刊文献+

基于直方图的数据流降载策略研究 被引量:2

Histogram strategy for load shedding over data streams
原文传递
导出
摘要 提出了基于直方图的降载策略,能很好地减缓在过载发生时系统性能的下降.降载的目标在于删除过载数据的同时尽可能地保持数据流的特征.为了处理大量被延迟的数据,构建了一种塔形矩阵的数据存储结构,利用其对过载数据分桶,每桶提取一个代表数据并删除该桶中其余数据,将每个桶的代表数据组成新的数据流参与查询操作.实验结果表明:这种降载方法能有效减少系统负担,生成的新数据流参与数据流查询后所得查询结果错误率较低,其性能优于其他已有算法. A technique for gracefully degraded performance via load shedding was examined,which was histogram strategy.The goal was to load shedding,as much as possible to preserve feature and improve the latency of the overloaded system.In order to deal with large amount of delayed data,a pyramid metric storage structure was conceived.With this data structure,how to split the data stream to buckets,extract the representative data from these buckets and drop the remaining data from every bucket could be found out.New data streams involved in the data streams query was generated by these representative data.Several experiments on data streams were performed.The results prove that the new method do well in percentage error of query result,and this new load shedding method has super performance compared with the existing strategies.
作者 魏霞 李国徽
出处 《华中科技大学学报(自然科学版)》 EI CAS CSCD 北大核心 2014年第9期24-27,共4页 Journal of Huazhong University of Science and Technology(Natural Science Edition)
基金 国家自然科学基金资助项目(61173049)
关键词 数据流 降载 直方图 塔形矩阵 过载 data streams load shedding histogram pyramid metric overload
作者简介 魏霞(1976-),女,博士,E—mail:119075307@qq.com.
  • 相关文献

参考文献14

  • 1Tatbul N,Cetintemel U,Zdonik S.Load shedding in a data stream manager[C]∥Processings of the 29th VLDB.Berlin:ACM,2003:309-320.
  • 2Bai Yijian,Wang Haixun,Zaniolo C.Load shedding in classifying multi-source streaming data:a Bayes risk approach[C]∥Processings of Data Mining and Knowledge Discovery.Minneapolis:[s.n.],2007:26-28.
  • 3Mohammed K,Byung S.Load shedding for temporal queries over data streams[J].Journal of Computing Science and Engineering,2011,5(4):294-304.
  • 4Babcock B,Datar M,Motwani R.Load shedding for aggregation queries over data streams[C]∥Proc of ICDE.Washington:IEEE,2004:350-361.
  • 5Abadi D,Carney D,Cetintemel U,et a1.Aurora:a new model and architecture for data stream management[J].VIDB Journal,2003,12(2):120-139.
  • 6Chen J,Dewitt D,Tian F.NiagaraCQ:a scalable continuous query system for internet databases[C]∥Processings of the 19th ACM SIGMOD Intl Conf.New York:ACM,2000:379-390.
  • 7Gedik B,Wu K I.CPU load shedding for binary stream joins[J].Knowledge and Information Systems,2007,13(3):271-303.
  • 8Gedik B,Wu K L,Liu L,et a1.Adaptive load shedding for windowed stream joins[C]∥Proc of the 3th ACM CIKM Conf.New York:ACM,2005:171-178.
  • 9The STREAM Group.Stream:the Stanford stream data manager[J].IEEE Data Engineering Bulletin,2003,26(1):19-26.
  • 10Motwani R,Widom J,Arasu A,et al.Query processing,resource management,and approximation in a data stream management system[C]∥First Biennial Conference on Innovative Data Systems Research.Asilomar:[s.n.],2003:140-151.

同被引文献14

引证文献2

二级引证文献19

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部