摘要
为了高效快速的开发和使用Hadoop远程通信功能,对Hadoop远程过程调用(Remote Procedure Call,RPC)机制进行分析,提出独立调用Hadoop RPC实现多客户端并发通信和大数据传输的机制,既继承Hadoop PRC框架,又在通信中增加数据文件传输,并采用线程池模拟多客户线程的测试方案。通过测试发现Hadoop远程过程调用在通信数据负载量和数据传输量的大致范围,测试方案和结论可用于Hadoop RPC应用的配置和开发。
In order to develop and use Hadoop remote communication efficiently and rapidly,the program is designed to implement multi-client and data transmission after analyzing Hadoop RPC(Remote Procedure Call) mechanism.It extends the Hadoop RPC framework,transfers data files and simulates multi-client threads using thread pool.The report is given to reveal the range of the data load and transmission of remote communication according to Hadoop RPC test.Test program and conclusions can be used in distributed applications and configuration by using Hadoop RPC.
出处
《西安邮电学院学报》
2012年第6期74-77,共4页
Journal of Xi'an Institute of Posts and Telecommunications
基金
陕西省教育厅自然科学基金资助项目(11JK1069)
作者简介
王博(1976-)男,讲师,硕士,从事分布式计算及软件测试研究。E-mail:wangbo@xupt.edu.cn
陈莉君(1964-)女,教授,硕士,从事分布式计算及linux内核研究。E-mail.cljcore@126.com