期刊文献+

一种基于容器的自组织存储模型 被引量:1

Container-based self-organizing storage model
在线阅读 下载PDF
导出
摘要 针对互联网Web应用特别是Web2.0应用的特殊存储需求,提出一种基于容器的自组织存储模型(CSS-M).CSS-M使用容器管理存储空间,聚簇存放用户文件,提高用户数据备份、迁移和恢复效率.一方面模型通过文件唯一标识提供文件的快速访问,另一方面它采用文件集来组织用户文件成树状,提供灵活的文件管理功能.模型使用容器作为数据定位和复制的基本单元,并利用对等覆盖网络技术自组织地维护容器元数据.另外,主从容器复制技术和基于容器状态的容器恢复技术保证了数据的可靠性和一致性.利用CSS-M实现了一个存储系统原型,初步的实验结果表明,CSS-M提供良好的性能和可扩展性,能够满足互联网WEB应用的存储需求. A container-based self-organizing storage model (CSS-M) was presented for web2.0 applications. Based on the concept of container,CSS-M clustered the user file together on disk to explore the file access locality and enable the fast data backup,migration and recovery. CSS-M employed ID based access interface to boost the access efficiency,and provided the flexible file management by using collections to organize files into trees. CSS-M maintained the container metadata as soft-state and distributed the metadata across all storage nodes using peer to peer technology. Data reliability and consistency were guaranteed by using the primary-copy replication and the state-based container recovery. Experimental results show that CSS-M provides high scalability and throughput in file operation services.
出处 《浙江大学学报(工学版)》 EI CAS CSCD 北大核心 2010年第5期915-922,共8页 Journal of Zhejiang University:Engineering Science
基金 国家自然科学基金资助项目(60603044) 浙江省重大软件专项资助项目(2006c11108) 长江学者和创新团队发展计划资助项目(IRT0652)
关键词 分布式存储系统 对等覆盖网络 文件容器 distributed storage system peer to peer overlay network file container
作者简介 余利华(1982-),男,浙江温岭人,博士生,从事分布式系统、存储系统研究.Email:peterylh@163.com 通信联系人:陈刚,男,教授,博导.E-mail:cg@zju.edu.cn
  • 相关文献

参考文献19

  • 1LIAN Q, CHEN W, ZHANG Z. On the impact of replica placement to the reliability of distributed brick storage systems [C] // Proceedings of 25th International Conference on Distributed Computing Systems. Columbus: IEEE, 2005:187 - 196.
  • 2ROWSTRON A, DRUSCHEL P. Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems [C] // Proceedings of International Conference on Distributed Systems Platforms. Heidelberg: Springer, 2001 : 329 - 350.
  • 3DABEK F, ZHAO B Y, DRUSCHEL P, et al. Towards a common API for structured peer-to-peer overlays [C]// Proceedings of 2nd International Workshop on Peer-to-Peer Systems. Berkeley: Springer, 2003:33-44.
  • 4GUPTA A, LISKOV B, RODRIGUES R. One hop lookups for peer-to-peer overlays [C] // Proceedings of 9th Workshop on Hot Topics in Operating Systems. Hawaii: USENIX, 2003: 7- 12.
  • 5XIN Q, MILLER E L, SCHWARZ T J E, et al. Reliability mechanisms for very large storage systems [C]// Proceedings of IEEE Symposium on Mass Storage Systems. San Diego, IEEE, 2003:146 - 156.
  • 6CARNS P H, LIGON Ⅲ W B, ROSS R B, et al. PVFS: A parallel file system for Linux clusters [C]// Proceedings of the 4th Annual Linux Showcase and Conference.Atlanta: Usenix, 2000:317-327.
  • 7杜聪,徐志伟.COSMOS文件系统的性能分析[J].计算机学报,2001,24(7):702-709. 被引量:5
  • 8XIONG J, MENG S D, SUN N, et al. Design and performance of the dawning cluster file system [C]//Proceedings of 2003 IEEE International Conference on Cluster Computing. Hongkong: IEEE, 2003: 232-239.
  • 9KUBIATOWICZ J, BINDEL D, CHEN Y, et al. Oceanstore: an architecture for global-scale persistent storage [C]//Proceedings of International Conference on Architectural Support for Programming Languages and Operating Systems. Cambrige: ACM, 2000: 190-201.
  • 10田敬,代亚非.P2P持久存储研究[J].软件学报,2007,18(6):1379-1399. 被引量:52

二级参考文献75

  • 1庞丽萍,何飞跃,岳建辉,徐婕.并行文件系统集中式元数据管理高可用系统设计[J].计算机工程与科学,2004,26(11):87-88. 被引量:6
  • 2黄铠 徐志伟.可扩展并行计算技术、结构与编程[M].北京:机械工业出版社,2000..
  • 3Du Cong,Proc 7th Int Conference on Parallel and Distributed Processing Techniques and Applications,2000年,1933页
  • 4黄铠(译),结构与编程,2000年
  • 5Wang Jianyong,Proc 6th Int Conference on Parallel and Distributed Processing Techniques and Applications,1999年,1277页
  • 6Zhang Z,Lin S,Lian Q,Jin C.RepStore:A self-managing and self-tuning storage backend with smart bricks.In:Proc.of the Int'l Conf.on Autonomic Computing.2004.122-129.http://ieeexplore.ieee.org/xpl/freeabs_all.jsp-arnumber=1301355&fromcon
  • 7Stoica I,Morris R,Karger D,Kaashoek M,Balakrishnan H.Chord:A scalable peer-to-peer lookup service for internet applications.Proc.of the 2001 SIGCOMM Conf.,2001,31(4):149-160.
  • 8Zhao B,Kubiatowicz J,Joseph A.Tapestry:An infrastructure for fault-tolerant wide-area location and routing.Technical Report,UCB//CSD-01-1141,Berkeley Computer Science Division,University of California,2001.
  • 9Ratnasamy S,Francis P,Handley M,Karp R,Schenker S.A scalable content-addressable network.In:Proc.of the ACM SIGCOMM Symp.on Communication,Architecture,and Protocols.ACM SIGCOMM,2001.161-172.http://www.acm.org/sigs/ sigcomm/sigcomm/sigcomm2001/p13-ratnasamy.pdf
  • 10Rowstron A,Druschel P.Pastry:Scalable,distributed object location and routing for large-scale peer-to-peer systems.In:Proc.of the IFIP/ACM Int'l Conf.on Distributed Systems Platforms (Middleware).2001.329-350.http://citeseer.ist.psu.edu/ rowstron01pastry.html

共引文献64

同被引文献8

引证文献1

相关作者

内容加载中请稍等...

相关机构

内容加载中请稍等...

相关主题

内容加载中请稍等...

浏览历史

内容加载中请稍等...
;
使用帮助 返回顶部