Oracle RAC 11gR2三节点ASM+MultiPath安装部署实施步骤.doc

Oracle RAC 11gR2三节点安装部署实施步骤(一) 集群规划1. 硬件环境服务器3台:DELL PowerEdge R620,2*Xeon E5-2680v2,128G内存，2*160G SSD硬盘，2*8Gbps HBA卡存储:DELL PowerVoult MD3660f,48*1TB 7.2k SAS硬盘，双控制器，8光纤口连接方式：通过SAN交换机，每台服务器双光纤接入到SAN交换机，MD3660f采用8光纤接入到SAN交换机。2. 软件环境数据库:oracle11.2.0.3_Linux-x86-64集群件:oracle11.2.0.3_grid-x86-64操作系统:oracle linux server6.5(二) IP 规划每个节点一个 public IP每个节点一个 public VIP每个节点一个 private IP一个用于集群的 SCAN 名称和一到三个和 public IP 同网段的 IP,本处用一个public IP,VIP 和 private IP 写入/etc/hosts 文件scan配置本地/etc/hosts解析主机名IP名对应网卡IP用途rac21rac21bond010.0.31.5publicrac21-vip10.0.31.15VIPrac21-privbond110.0.50.5privaterac22rac22bond010.0.31.6publicrac22-vip10.0.31.16VIPrac22-privbond110.0.50.6privaterac23rac23bond010.0.31.7publicrac23-vip10.0.31.17VIPrac23-privbond110.0.50.7privateScanIPrac2-scanbond010.0.31.102Scan IP(三) 安装目录规划建立/opt/oracle 文件系统用来安装 grid、datbase 程序。Oracle 用户:ORACLE_BASE= /opt/oracle/appORACLE_HOME=$ORACLE_BASE/product/11.2.0Grid 用户:ORACLE_BASE= /opt/oracle/grid/appORACLE_HOME= /opt/oracle/grid/11.2.0(四) 存储规划RAID GROUPRaid类型 LUN编号 Stripe Size(KB)LUN大小 (GB) 映射主机 RG4(7D+1P)RAID 5 40128500RAC2-Group41128500RAC2-Group42128500RAC2-Group43128500RAC2-Group44128500RAC2-Group45128500RAC2-Group46128500RAC2-Group47128500RAC2-Group48128500RAC2-Group49128500RAC2-Group50128500RAC2-Group51128500RAC2-Group52128500RAC2-GroupRG5(7D+1P)RAID 5 53128500RAC2-Group54128500RAC2-Group55128500RAC2-Group56128500RAC2-Group57128500RAC2-Group58128500RAC2-Group59128500RAC2-Group60128500RAC2-Group61128500RAC2-Group62128500RAC2-Group63128500RAC2-Group64128500RAC2-Group65128500RAC2-GroupRG6(2D+2P)RAID10RAC2-OCR1711281RAC2-GroupRAC2-OCR2721281RAC2-GroupRAC2-OCR3731281RAC2-GroupRAC2-VOT1741281RAC2-GroupRAC2-VOT2751281RAC2-GroupRAC2-REDO179128300RAC2-GroupRAC2-REDO280128300RAC2-GroupRAC2-REDO381128300RAC2-Group(五) 安装实施1. 安装前准备存储环境准备将主机、存储等接入 SAN 交换机,按需划分相应的 zone; 清理所有设备的 WWN 号; 在存储端添加数据库主机,将两节点绑定为一个 Host set; 存储划分 VV,并分配给数据库 Host set。 2. 主机环境准备操作系统安装分别在两个节点安装 oracle linux server6.5 操作系统。2块SSD硬盘设置成RAID1镜像。安装参数如下:系统分区/50G/boot500Mswap16G/opt79G操作系统安装过程略。3. 在每个节点上(rac21/rac22/rac23)执行 1) 配置 IP1、增加绑定配置# vi /etc/modprobe.d/bonding.confalias bond0 bondingalias bond1 bonding2、加载绑定模块#modprobe bonding3、编辑/etc/sysconfig/network-script/ifcfg-bond0文件# vi /etc/sysconfig/network-scripts/ifcfg-bond0DEVICE=bond0TYPE=EthernetONBOOT=yesBOOTPROTO=noneIPADDR=10.0.31.5 (rac22改成10.0.31.6，rac23改成10.0.31.7)PREFIX=24NETMASK=255.255.255.0NETWORK=10.0.31.0GATEWAY=10.0.31.254DNS1=114.114.114.114DEFROUTE=yesUSERCTL=noBONDING_OPTS=mode=4 miimon=100NAME=bond04、编辑/etc/sysconfig/network-script/ifcfg-bond1文件# vi /etc/sysconfig/network-scripts/ifcfg-bond1DEVICE=bond1TYPE=EthernetONBOOT=yesBOOTPROTO=noneIPADDR=10.0.50.5 (rac22改成10.0.50.6，rac23改成10.0.50.7)PREFIX=24NETMASK=255.255.255.0NETWORK=10.0.50.0BOARDCAST=10.0.50.255USERCTL=noBONDING_OPTS=mode=0 miimon=100NAME=bond15、编辑/etc/sysconfig/network-script/ifcfg-em1文件# vi /etc/sysconfig/network-scripts/ifcfg-em1DEVICE=em1TYPE=EthernetONBOOT=yesBOOTPROTO=noneIPV4_FAILURE_FATAL=yesIPV6INIT=noUSERCTL=noMASTER=bond0SLAVE=yesNAME=System em16、编辑/etc/sysconfig/network-script/ifcfg-em2文件# vi /etc/sysconfig/network-scripts/ifcfg-em2DEVICE=em2TYPE=EthernetONBOOT=yesBOOTPROTO=noneIPV4_FAILURE_FATAL=yesIPV6INIT=noUSERCTL=noMASTER=bond0SLAVE=yesNAME=System em27、编辑/etc/sysconfig/network-script/ifcfg-em3文件# vi /etc/sysconfig/network-scripts/ifcfg-em3DEVICE=em3TYPE=EthernetONBOOT=yesBOOTPROTO=noneIPV4_FAILURE_FATAL=yesIPV6INIT=noUSERCTL=noMASTER=bond1SLAVE=yesNAME=System em38、编辑/etc/sysconfig/network-script/ifcfg-em4文件# vi /etc/sysconfig/network-scripts/ifcfg-em4DEVICE=em4TYPE=EthernetONBOOT=yesBOOTPROTO=noneIPV4_FAILURE_FATAL=yesIPV6INIT=noUSERCTL=noMASTER=bond1SLAVE=yesNAME=System em49、编辑/etc/sysconfig/network文件# vi /etc/sysconfig/networkNETWORKING=yesHOSTNAME=rac21 (节点2改成rac22，节点3改成rac23)GATEWAY=10.0.31.25410、配置完成后重启网络服务:#service network restart 2) 编辑/etc/hosts文件# vi /etc/hosts127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4:1 localhost localhost.localdomain localhost6 localhost6.localdomain610.0.31.8 goldengate10.0.31.5 rac2110.0.31.15 rac21-vip10.0.50.5 rac21-priv10.0.31.6 rac2210.0.31.16 rac22-vip10.0.50.6 rac22-priv10.0.31.7 rac2310.0.31.17 rac23-vip10.0.50.7 rac23-priv10.0.31.102 rac2-scan3) 安装必要的软件包挂载光盘安装软件:迚入操作系统光盘/Server/Packages/目录下,找到下列文件,拷至/root/patch 目录中:binutils-2.20.51.0.2-5.36.el6.x86_64.rpmcompat-libstdc+-33-3.2.3-69.el6.i686.rpmcompat-libstdc+-33-3.2.3-69.el6.x86_64.rpmelfutils-libelf-0.152-1.el6.i686.rpmelfutils-libelf-0.152-1.el6.x86_64.rpmelfutils-libelf-devel-0.152-1.el6.i686.rpmelfutils-libelf-devel-0.152-1.el6.x86_64.rpmgcc-4.4.7-4.el6.x86_64.rpmgcc-c+-4.4.7-4.el6.x86_64.rpmglibc-2.12-1.132.el6.i686.rpmglibc-2.12-1.132.el6.x86_64.rpmglibc-common-2.12-1.132.el6.x86_64.rpmglibc-devel-2.12-1.132.el6.i686.rpmglibc-devel-2.12-1.132.el6.x86_64.rpmksh-20120801-10.el6.x86_64.rpmlibaio-0.3.107-10.el6.i686.rpmlibaio-0.3.107-10.el6.x86_64.rpmlibaio-devel-0.3.107-10.el6.i686.rpmlibaio-devel-0.3.107-10.el6.x86_64.rpmlibgcc-4.4.7-4.el6.i686.rpmlibgcc-4.4.7-4.el6.x86_64.rpmlibstdc+-4.4.7-4.el6.i686.rpmlibstdc+-4.4.7-4.el6.x86_64.rpmlibstdc+-devel-4.4.7-4.el6.i686.rpmlibstdc+-devel-4.4.7-4.el6.x86_64.rpmlibstdc+-docs-4.4.7-4.el6.x86_64.rpmmake-3.81-20.el6.x86_64.rpmnumactl-devel-2.0.7-8.el6.i686.rpmnumactl-devel-2.0.7-8.el6.x86_64.rpmsysstat-9.0.4-22.el6.x86_64.rpmunix2dos-2.2-35.el6.x86_64.rpmunixODBC-2.2.14-12.el6_3.i686.rpmunixODBC-2.2.14-12.el6_3.x86_64.rpmunixODBC-devel-2.2.14-12.el6_3.i686.rpmunixODBC-devel-2.2.14-12.el6_3.x86_64.rpm将上述补丁包和软件上传到/tmp/patch 目录中,并在该目录中执行如下命令进行安装:# rpm -ivh -nodeps -force /root/patch/* 4) 修改内核参数# vi /etc/sysctl.confkernel.shmmax = 4398046511104kernel.shmall = 1073741824kernel.shmmni = 4096kernel.sem = 250 32000 100 128 net.ipv4.ip_local_port_range = 9000 65500 net.core.rmem_default = 262144 net.core.rmem_max = 4194304 net.core.wmem_default = 262144 net.core.wmem_max = 1048576fs.aio-max-nr = 1048576fs.file-max = 68157445) 修改 oracle 用户限制vi /etc/security/limits.conf 末尾添加:#for Oracle Installoraclesoftnofile2047oraclehardnofile65536oraclesoftnproc2047oraclehardnproc16384oraclesoftstack10240oraclehardstack32768gridsoftnofile2047gridhardnofile65536gridsoftnproc2047gridhardnproc16384gridsoftstack10240gridhardstack327686) 修改/etc/pam.d/login#vi /etc/pam.d/login 末尾添加:Session reauired /lib64/security/pam_limits.so7) 关闭防火墙的 selinux在每个节点上以root用户执行：1、停掉 iptables、selinux 服务:#service iptables stop #chkconfig iptables off #setenforce 0#getenforce2、修改配置文件:#vi /etc/selinux/configSELINUX=disabledSELINUXTYPE=targeted8) 停用 ntp 服务# service ntpd stop# chkconfig ntpd off# mv /etc/ntp.conf /etc/ntp.conf.bak # rm -rf /etc/ntp.conf9) 更改安装所有者的 ulimit 设置#vi /etc/profile 末尾添加:if /$USER = oracle ; thenif /$SHELL = /bin/ksh ; then ulimit -p 16384 ulimit -n 65536 else ulimit -u 16384 -n 65536 fiumask 022 fiexport NLS_LANG=American_America.ZHS16GBK10) 添加 Oracle 用户创建用户:#/usr/sbin/groupadd -g 501 oinstall#/usr/sbin/groupadd -g 502 dba#/usr/sbin/groupadd -g 503 oper#/usr/sbin/groupadd -g 504 asmadmin#/usr/sbin/groupadd -g 505 asmoper#/usr/sbin/groupadd -g 506 asmdba#/usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle#/usr/sbin/useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid11) 设置 oracle、grid 用户密码#passwd oracle (设置密码为nebula)#passwd grid (设置密码为nebula)12) 创建 oracle 安装目录#mkdir p /opt/oracle#chown R oracle:oinstall /opt/oracle#mkdir p /opt/oracle/grid/app#mkdir p /opt/oracle/grid/11.2.0#chown R grid:oinstall /opt/oracle/grid#mkdir p /opt/oracle/app/product/11.2.0#chown R oracle:oinstall /opt/oracle/app#chmod R 755 /opt/oracle13) 设置 oracle 用户环境变量以oracle用户登录$ vi .bash_profileumask 022export ORACLE_BASE=/opt/oracle/appexport ORACLE_HOME=$ORACLE_BASE/product/11.2.0export ORACLE_SID=APPDBexport NLS_LANG=AMERICAN_AMERICA.UTF8export NLS_DATE_FORMAT=yyyy-mm-dd hh24:mi:ssexport PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/binexport PATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/binexport PATH=$PATH:$ORACLE_BASE/common/oracle/binexport ORACLE_PATH=$PATH:$ORACLE_BASE/common/oracle/sql:.:$ORACLE_HOME/rdbms/adminexport ORACLE_TERM=xtermexport TNS_ADMIN=$ORACLE_HOME/network/adminexport LD_LIBRARY_PATH=$ORACLE_HOME/libexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$ORACLE_HOME/oracm/libexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/lib:/usr/lib:/usr/local/libexport CLASSPATH=$ORACLE_HOME/JREexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/jlibexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/rdbms/jlibexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/network/jlibexport THREADS_FLAG=nativeexport TEMP=/tmpexport TMPDIR=/tmp14) 设置 grid 用户环境变量以grid用户登录$ vi .bash_profileumask 022export ORACLE_BASE=/opt/oracle/grid/appexport ORACLE_HOME=/opt/oracle/grid/11.2.0export ORACLE_SID=+ASM1 (rac22改成+ASM2，rac23改成+ASM3)export NLS_LANG=AMERICAN_AMERICA.UTF8export NLS_DATE_FORMAT=yyyy-mm-dd hh24:mi:ssexport PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/binexport PATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/binexport PATH=$PATH:$ORACLE_BASE/common/oracle/binexport ORACLE_PATH=$PATH:$ORACLE_BASE/common/oracle/sql:.:$ORACLE_HOME/rdbms/adminexport ORACLE_TERM=xtermexport TNS_ADMIN=$ORACLE_HOME/network/adminexport LD_LIBRARY_PATH=$ORACLE_HOME/libexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$ORACLE_HOME/oracm/libexport LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/lib:/usr/lib:/usr/local/libexport CLASSPATH=$ORACLE_HOME/JREexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/jlibexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/rdbms/jlibexport CLASSPATH=$CLASSPATH:$ORACLE_HOME/network/jlibexport THREADS_FLAG=nativeexport TEMP=/tmpexport TMPDIR=/tmpexport PATH=$PATH:$ORACLE_HOME/bin15) 配置 SSH分别以 root、oracle、grid 用户配置三个用户的 SSH无密码登录。1、分别rac21、rac22、rac23节点以root用户登录执行:#mkdir /.ssh#chmod 700 /.ssh #ssh-keygen -t rsa密码全直接回车#su oracle$mkdir /.ssh$chmod 700 /.ssh $ssh-keygen -t rsa密码全直接回车$exit#su grid$mkdir /.ssh$chmod 700 /.ssh $ssh-keygen -t rsa密码全直接回车$exit2、在rac21上以root用户执行:#cp /.ssh/id_rsa.pub /.ssh/authorized_keys#ssh rac22 cat /.ssh/id_rsa.pub/.ssh/authorized_keys#ssh rac23 cat /.ssh/id_rsa.pub/.ssh/authorized_keys #scp /.ssh/authorized_keys rac22:/.ssh/authorized_keys#scp /.ssh/authorized_keys rac23:/.ssh/authorized_keys#su - oracle$cp /.ssh/id_rsa.pub /.ssh/authorized_keys$ssh rac22 cat /.ssh/id_rsa.pub/.ssh/authorized_keys$ssh rac23 cat /.ssh/id_rsa.pub/.ssh/authorized_keys $scp /.ssh/authorized_keys rac22:/.ssh/authorized_keys$scp /.ssh/authorized_keys rac23:/.ssh/authorized_keys$exit#su grid$cp /.ssh/id_rsa.pub /.ssh/authorized_keys$ssh rac22 cat /.ssh/id_rsa.pub/.ssh/authorized_keys$ssh rac23 cat /.ssh/id_rsa.pub/.ssh/authorized_keys $scp /.ssh/authorized_keys rac22:/.ssh/authorized_keys$scp /.ssh/authorized_keys rac23:/.ssh/authorized_keys3、在rac21、rac22和rac23节点上分别用root、oracle、grid用户登录，然后分别执行：ssh rac21输入yesexitssh rac21-priv输入yesexitssh rac22输入yesexitssh rac22-priv输入yesexitssh rac23输入yesexitssh rac23-priv输入yesexit4. 刷新磁盘若没有重机器,存储挂载后在系统中会看丌到,用如下命令迚行硬件刷新: #rescan-scsi-bus.sh5. 磁盘多路径配置1) 用PowerVault MD Storage Manager做LUN映射Disk Group划分与Virtual Disks划分2) 加载多路径模块在每个节点上以root用户执行：#scsi-rescan#modprobe dm-multipath#modprobe dm-round-robin3) 启动 multipath 服务在每个节点上以root用户执行：#service multipathd restart设置成开机自启动服务#chkconfig level 345 multipathd on4) 编辑/etc/multipath/bindings文件，修改虚拟磁盘映射别名在每个节点上以root用户执行：#vi /etc/multipath/bindingsrac2-data136f01faf000e5fd4000000af33c8ce843rac2-data236f01faf000e5fd4000000b083c8cea33rac2-data336f01faf000e5fd4700000e8b3f65c57frac2-data436f01faf000e5fd4000000b0a3c8cea5arac2-data536f01faf000e5fd4700000e8d3f65c5b6rac2-data636f01faf000e5fd4000000b0c3c8cea92rac2-data736f01faf000e5fd4700000e8f3f65c5e3rac2-data836f01faf000e5fd4000000b0e3c8ceabfrac2-data936f01faf000e5fd4700000e913f65c60arac2-data1036f01faf000e5fd4000000b103c8ceae3rac2-data1136f01faf000e5fd4700000e933f65c62erac2-data1236f01faf000e5fd4000000b123c8ceb09rac2-data1336f01faf000e5fd4700000e953f65c65crac2-data1436f01faf000e5fd4700000e763f65c39crac2-data1536f01faf000e5fd4000000b143c8ceb56rac2-data1636f01faf000e5fd4700000e973f65c6a3rac2-data1736f01faf000e5fd4000000b163c8ceb7frac2-data1836f01faf000e5fd4700000e993f65c6d2rac2-data1936f01faf000e5fd4000000b183c8cebadrac2-data2036f01faf000e5fd4700000e9b3f65c6f8rac2-data2136f01faf000e5fd4000000b1a3c8cebd3rac2-data2236f01faf000e5fd4700000e9d3f65c720rac2-data2336f01faf000e5fd4000000b1c3c8cebfbrac2-data2436f01faf000e5fd4700000e9f3f65c746rac2-data2536f01faf000e5fd4000000b1e3c8cec1frac2-data2636f01faf000e5fd4700000ea13f65c772rac2-redo136f01faf000e5fd4700000ea73f664f46rac2-redo236f01faf000e5fd4000000b263c8d7426rac2-redo336f01faf000e5fd4700000ea93f664f83rac2-crs136f01faf000e5fd4000000ad83c8ce4fdrac2-crs236f01faf000e5fd4700000e5a3f65c048rac2-crs336f01faf000e5fd4000000ada3c8ce526rac2-crs436f01faf000e5fd4700000e5c3f65c072rac2-crs536f01faf000e5fd4000000adc3c8ce54f5) 清除multipath磁盘并重新生成在每个节点上以root用户执行：1、重启服务器2、清除磁盘#multipath F3、重新扫描生成磁盘#multipath v2create: rac2-data1 (36f01faf000e5fd4000000af33c8ce843) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:1 sdb 8:16 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:1 sdaj 66:48 undef ready runningcreate: rac2-data2 (36f01faf000e5fd4000000b083c8cea33) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:2 sdc 8:32 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:2 sdak 66:64 undef ready runningcreate: rac2-data3 (36f01faf000e5fd4700000e8b3f65c57f) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:3 sdd 8:48 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:3 sdal 66:80 undef ready runningcreate: rac2-data4 (36f01faf000e5fd4000000b0a3c8cea5a) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:4 sde 8:64 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:4 sdam 66:96 undef ready runningcreate: rac2-data5 (36f01faf000e5fd4700000e8d3f65c5b6) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:5 sdf 8:80 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:5 sdan 66:112 undef ready runningcreate: rac2-data6 (36f01faf000e5fd4000000b0c3c8cea92) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:6 sdg 8:96 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:6 sdao 66:128 undef ready runningcreate: rac2-data7 (36f01faf000e5fd4700000e8f3f65c5e3) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:7 sdh 8:112 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:7 sdap 66:144 undef ready runningcreate: rac2-data8 (36f01faf000e5fd4000000b0e3c8ceabf) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:8 sdi 8:128 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:8 sdaq 66:160 undef ready runningcreate: rac2-data9 (36f01faf000e5fd4700000e913f65c60a) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:9 sdj 8:144 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:9 sdar 66:176 undef ready runningcreate: rac2-data10 (36f01faf000e5fd4000000b103c8ceae3) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:10 sdk 8:160 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:10 sdas 66:192 undef ready runningcreate: rac2-data11 (36f01faf000e5fd4700000e933f65c62e) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:11 sdl 8:176 undef ready running-+- policy=round-robin 0 prio=1 status=undef - 2:0:0:11 sdat 66:208 undef ready runningcreate: rac2-data12 (36f01faf000e5fd4000000b123c8ceb09) undef DELL,MD36xxfsize=500G features=0 hwhandler=0 wp=undef|-+- policy=round-robin 0 prio=1 status=undef| - 1:0:0:12 sdm 8:192 undef