摘要
数据压缩是有效处理大数据的关键技术,在飞腾处理器平台上基于zlib库的数据压缩通常采用软件的方式实现,在数据处理量大而且实时性要求较高的情况下,已经难以满足需求。针对这个问题,通过研究zlib编程函数库,结合飞腾处理器的特性,完成了飞腾平台中硬件数据压缩的驱动设计与实现,其中提出了双向DMA传输技术和基于一致性内存的命令环机制,从而进一步提高了基于硬件的数据压缩的效率。通过实验证实了飞腾平台中采用硬件数据压缩改进的有效性。
Data compression is the key technology in effective big data handling,the zlib-based data compression on FT processing platform is usually implemented in the way of software,in the circumstances of large data processing capacity and high demand in real-time property,it can no longer meet the requirement. To address this issue,through studying zlib programming functions library and combining the characteristics of FT processor,we complete the design and implementation of hardware-based data compression drive for FT platform,in it we present the technology of bidirectional DMA transmission and the consistency memory-based command ring mechanism,so that further improve the efficiency of hardware-based data compression. Moreover,we also validate through the experiments the effectiveness of the improvement in data compression with hardware on FT platform.
出处
《计算机应用与软件》
CSCD
2015年第3期20-22,49,共4页
Computer Applications and Software
基金
国家核高基项目(2012zx01040001)
关键词
大数据
zlib函数库
数据压缩
一致性内存
双向DMA
命令环
Big data zlib functions library Data compression Consistency memory Bidirectional DMA Command ring
作者简介
刘刚，硕士生，主研领域：计算机软件与理论。
吴庆波，研究员。
邵立松，副研究员。
谭郁松，副研究员。
