通信论文并行系统高效多通道通信技术的研究.docVIP

并行系统高效多通道通信技术的研究 并行系统高效多通道通信技术的研究 research on high performance multi-networking communication in parallel system【中文摘要】 自90年代以来,并行计算得以空前的飞速发展,并行系统的体系结构趋于成熟,数据传输网络的标准化和传输速率的大幅提升,为研制并行系统创造了有利条件。集群系统近些年逐渐成为并行计算实现载体的主流。随着计算结点性能的不断提高,集群系统的通信系统已成为影响并行计算性能的一个重要因素。为了满足集群对性能、可靠性和可维护性等的要求,就要提高通信系统的性能。但是新型高速网络通常价格昂贵,而传统的低效网络因不能满足高性能通信需要而得不到有效利用,有必要引入并行的思想将已有的通信资源充分利用起来。多通道通信技术就是利用多条网络通信链路进行通信,提高集群系统的通信性能和可靠性。本文是辽宁省科学技术基金博士启动项目:并行系统高性能多通道通信技术的研究(20051058)的重要组成部分,围绕着并行系统的通信系统展开研究工作,主要内容包括:1.分析了通信系统的主要构成和当今用于集群系统流行的通信硬件。同时介绍了并行计算编程工具mpi的基本理论,阐述了通信系统对于并行计算的重要性。2.根据mpich-1.2.5和linux-2.4.32内核代码具体分析了mpich整个通信过程的三个层次:应用层、内核层、网络设备层。从mpich的收发函数开始,到内核中的套接字和tcp协议的实现过程,最后到网络设备接口将数据在主机和网络之间传输。并从三个方面阐述了通信系统对并行计算性能提高的重要性,同时给出了提高通信性能的途径。3.在现有的实验环境基础上,本文提出了基于bonding技术的优化最轻负载选择法(optimization lightest load selection arithmetic)。此算法可根据网卡当前的负载状态,建立网卡负载索引,缩短查找最轻负载网卡的时间,实现了动态选择通信通道,整个系统的性能得到了优化。最后使用mpbench测试工具对广播通信、带宽和回路延迟进行了测试,结果证明本文算法与单通道通信和原bonding技术相比,三方面性能都有所提高。【英文摘要】 since 1990s, parallel computing has developed unprecedented rapidly, structure of parallel computer system has matured, data transmission network has become standardization and transmission rate has lifted , which all have created advantaged conditions for the development of parallel system. cluster systems have become the main achievements of parallel computing. as the performance of nodes calculation improving continuously, communication system in cluser has become an important factor for parallel computing performance. to satisfy clusters demand for performance, reliability, maintainability and other requirements, it is necessary to improve the communication systems performance. the new high-speed networks are usually expensive, while the traditional low-speed networks are not fully utilized because they are not meeting the needs of high-performance communication. it is necessary to take the idea of parallel processing to make the best use of available communication resources. multi-networking communication(mnc) technology focuses on exploiting multiple networks to improve communication performance and reliability.this paper is one important part of liaoning science technology fund doctor startup project: research on high performance multi-networking communication in parallel system(no. 20051058). this mainly studies communication system of parallel system, the main content includes:1. it analyzes the major components of the communication system, the basic theory of mpi, which is the most important parallel computing programming tool, and the importance of that the communication system to the whole cluster performance.2. basing on the codes of mpich-1.2.5 and linux-2.4.32, it specific analyses the mpichs communication process, which including three layers: application layer, kernel layer and nic layer. from the send and receive functions of mpich layer to the process of socket and tcp protocol in kernel layer, and finally the nic transmits data between the nodes and network. and it expatiates importance of communication system on parallel computing performance from three sides, gives the approaches how to improve the communication performance.3.on the existing experimental environment, this paper proposes the optimization lightest load selection arithmetic(olls), which is basic on the bonding technology. this arithmetic generates an index according to the nics current load status, which shorts the time for finding the lightest load nic, realizes the dynamic choice of networking communication, optimizes the performance of the entire system. finally uses the mpbench testing the broadcast communication, bandwidth and roundtrip, the results show that the optimization lightest load selection arithmetic is better than bonding technology and one-networking communication. 【中文关键词】 并行系统; 集群; 通信系统; 多通道通信; bonding技术 【英文关键词】 parallel system; cluster system; communication system; multi-networking communication; bonding technology 【毕业论文目录】摘要 3-4 abstract 4-5 第一章 绪论 8-12 1.1 选题的背景和现实意义 8-9 1.2 国内外研究与发展现状 9-10 1.3 本文主要工作 10-12 第二章 并行计算通信系统 12-18 2.1 并行计算通信系统 12-15 2.1.1 并行计算通信系统构成 12-13 2.1.2 当今流行的通信硬件 13-15 2.1.2.1 ethernet 以太网技术 13-14 2.1.2.2 myrinet 技术 14 2.1.2.3 infiniband 技术 14-15 2.2 消息传递接口mpi 15-17 2.2.1 mpi 的定义和特点 15-16 2.2.2 mpi 的四种通信模式 16-17 2.3 通信系统对并行计算的影响 17-18 第三章 并行计算的通信过程分析 18-38 3.1 通信过程的三个层次 18-32 3.1.1 mpich 层通信 18-24 3.1.1.1 mpich 层的传输接口 18-19 3.1.1.2 mpich 层的三种传输协议 19-24 3.1.2 bsd socket 和tcp 层通信 24-30 3.1.2.1 套接字 24-26 3.1.2.2 套接字的建立 26-28 3.1.2.3 套接字的发送 28-29 3.1.2.4 套接字的接收 29-30 3.1.3 网络接口层通信 30-32 3.1.3.1 初始化网络设备 31 3.1.3.2 发送数据 31-32 3.1.3.3 接收数据 32 3.2 影响并行通信的主要因素 32-34 3.2.1 系统因素 32-33 3.2.2 应用需求 33 3.2.3 通信系统的限制 33-34 3.3 提高通信的主要途径 34-38 3.3.1 开发新型高速网络硬件 34 3.3.2 提高通信软件性能 34-36 3.3.3 多通道通信技术 36-38 第四章 多通道通信的优化最轻负载选择法 38-54 4.1 多通道通信的调度机制 38-41 4.1.1 调度机制 38-40 4.1.2 bonding 技术的调度算法 40-41 4.2 优化最轻负载选择法 41-49 4.2.1 优化