高性能计算机集群软件安装手册

1、高性能计算机集群软件安装手册 intel软件的安装前提：l 软件都是开源下载的，下载软件及license网址：/cd/software/products/apac/zho/343156.html 将软件的序列号文件（*.lic文件）拷贝到/opt/intel/licenses下（此目录需要手动建立）。1 intel c+编译器的安装：1. 复制源码包：使用cp命令复制intel c+的源码包l_cproc_p_11.0.083_intel64.tgz到root目录下2. 解压缩：tar zxvf l_cproc_p_11.1.072_intel64.tgz

2、cd l_cproc_p_11.1.072_intel643. 安装：./install.sh如下图所示，需要经历7steps安装过程，基本都是默认选项回车进行下一步。press enter key to continue or q to quit: 回车please type a selection or press enter to accept default choice 1:回车（view the license agreement (required)）type accept to continue or decline to back to the previous menu:a

3、cceptplease type a selection or press enter to accept default choice 1:回车（use existing license）please type a selection or press enter to accept default choice 1:回车（typical install (recommended)）please type a selection or press enter to accept default choice 1:回车（install）please type a selection or pr

4、ess enter to accept default choice q:回车（quit）至此，已安装成功，默认的安装路径为/opt/intel/compiler/版本号/ 的路径下，4. 设置环境变量：vi /root/.bashrc /编辑.bashrc文件，在文档最后加入以下内容：source /opt/intel/compiler/11.1/072/bin/intel64/iccvars_intel64.sh /（：wq）保存退出source /root/.bashrc /source使其生效which icc /查看是否环境变量设置正确2 intel fortran编译器的安装：1.

5、 复制源码包：使用cp命令复制intel fortran的源码包l_cprof_p_11.0.083_intel64.tgz到root目录下2. 解压缩：tar zxvf l_ l_cprof_p_11.1.072_intel64.tgzcd l_cprof_p_11.1.072_intel643. 安装：./install.sh如下图所示，需要经历7steps安装过程，基本都是默认选项回车进行下一步。press enter key to continue or q to quit: 回车please type a selection or press enter to accept defa

6、ult choice 1:回车（view the license agreement (required)）type accept to continue or decline to back to the previous menu:acceptplease type a selection or press enter to accept default choice 1:回车（use existing license）please type a selection or press enter to accept default choice 1:回车（typical install (

7、recommended)）please type a selection or press enter to accept default choice 1:回车（install）please type a selection or press enter to accept default choice q:回车（quit）4. 设置环境变量：vi /root/.bashrc /编辑.bashrc文件，在文档最后加入以下内容：source /opt/intel/compiler/11.1/072/bin/intel64/ifortvars_intel64.sh /（：wq）保存退出sourc

8、e /root/.bashrc /source使其生效which ifort /查看是否环境变量设置正确3 intel mpi的安装：1. 复制源码包：使用cp命令复制intel mpi的源码包l_mpi_p_28.tgz到root目录下2. 解压缩：tar zxvf l_mpi_p_28.tgzcd l_mpi_p_283. 安装：./install.shplease type a selection (1/2/x) 1:回车（install cluster node software on an automounted shared file sy

9、stem）press enter to continue. 回车enter accept to continue, reject to exit: (accept/reject): acceptplease specify installation prefix /opt/intel/mpi/3.0: 回车preparing packages for el-mpi-em64t-3.0p-043installation successful.to uninstall this package, run /opt/intel/mpi/3.0/uninstall.co

10、mpleted cluster installation successfully.4. 设置环境变量：vi /root/.bashrc /编辑.bashrc文件，在文档最后加入以下内容：source /opt/intel/impi/28/intel64/bin/mpivars.sh /（：wq）保存退出source /root/.bashrc /source使其生效which mpirun /查看是否环境变量设置正确5. mpd环境初始化设置：在每个节点的终端下运行以下命令：touch /root/.mpd.confchmod 600 /root/.mpd.confecho m

11、pd_secretword=mr45-j9z /root/.mpd.conftouch /etc/mpd.confchmod 600 /etc/mpd.confecho mpd_secretword=111111 /etc/mpd.conf快捷运行命令：假设所有计算节点ip为192.168.100.* （*从1到100）for(i=1,i= 1) 1 # of panels in recursion 2 ndivs 1 # of recursive panel fact. 1 0 2 rfacts (0=left, 1=crout, 2=right) 1 # of broadcast 0 bc

12、asts (0=1rg,1=1rm,2=2rg,3=2rm,4=lng,5=lnm) 1 # of lookahead depth 0 depths (=0) 2 swap (0=bin-exch,1=long,2=mix) 256 swapping threshold 1 l1 in (0=transposed,1=no-transposed) form 1 u in (0=transposed,1=no-transposed) form 0 equilibration (0=no,1=yes) 8 memory alignment in double ( 0) 主要注意n，nb，p和q的值

13、 n 是矩阵的大小，其公式为：n*n*8=总内存*80% ，在intel nehalem以上的cpu, n*n*8=总内存*90% 测试的效果会更好些。 nb 是求解矩阵分块大小，一般为192,224 p和q 要满足：p*q=进程数；pq这2个关系 4. 运行linpack mpdboot mpiexec machinefile hosts n 12 ./xhpl 5. 看输出结果，并算出效率。 一台双路服务器配置了2颗xeon x56502.66ghz的理论峰值为2.66（主频）*4 (每个时钟执行4次浮点运算)*2（2颗cpu）*6 (每颗cpu有6个核)=127.68 gflops 实测的一组输出结果： = t/v n nb p q time gflops - wr00c2l2 50760 224 2 6 720.91 1.210e+02 - |ax-b|_oo/(eps*(|a|_oo*|x|_oo+|b|_oo)*n)= 0.0024948 . passed = finished 8 tests with the