Oracle_11g_RAC for_Linux6.5安装与配置

1、软件安装与配置Orace 11g RAC安装与配置for RedHat Linux 6.5文档控制修改记录日期作者版本2015-06-04孙井龙（总结）1.0一 准备工作安装包文件：操作系统:RedHat Enterprise Linux server release6.2 64bit数据库软件：linux.x64_11gR2_grid.zip linux.x64_11gR2_database_1of2.ziplinux.x64_11gR2_database_2of2.zipArcSDE9.3 for oracle11g on linux 64bit1.1 RAC 架构规划及磁盘规划服务器机器

2、名称Syspgisdb1Syspgisdb2公共IP 地址（eth3）78虚拟IP 地址（eth3）90私有IP 地址（eth0）ORACLE RAC SIDslgapgisdb1slgapgisdb2集群实例名称slgapgisdbSCAN IP1软件Linux6.5 64bit，Oracle磁盘规划逻辑磁盘Asm磁盘Asm磁盘卷组大小（G）/dev/sda1OCR_VOTE01OCRVOTING10.7 GB/d

3、ev/sdb1OCR_VOTE0210.7 GB/dev/sdc1FLASHBACK01FLASHBACKVG1099.5 GB/dev/sdd1ARCVG01ARCVG1099.5 GB/dev/sde1DATAVG01DATAVG2199.0 GB/dev/sdf1DATAVG022199.0 GB/dev/sdg1DATAVG032199.0 GB/dev/sdh1DATAVG042199.0 GB1.2 修改机器名（所有节点）修改机器名服务器1： hostname slgapgisdb1vi /etc/sysconfig/network服务器2： hostname slgapgisdb

4、2vi /etc/sysconfig/network1.3修改ip映射1.3.1检查网络要求Ø IP Address Requirements：至少配置两个接口，一个用于私有网络，一个用于公有网络Ø 每节点配置一个公有IP地址：静态IP地址在安装前配置完成可用公有IP，虚拟IP，SCAN IP地址在同一个子网内Ø 每节点配置一个私有IP 静态IP地址一个独立的私有子网，仅可被其他群集成员访问Ø SCAN IPSingle Client Access Name (SCAN)：为群集使用的单一的客户访问名称；使用DNS在安装之前配置3个静态IP地址，三个IP

5、地址关联SCAN名，并且有DNS提供随机访问在安装前配置DNS解析配置一个SCAN名，不能以数字开头与公有IP，虚拟IP，SCAN IP地址在同一个子网内符合RFC 952标准，可以使用“-”，不能使用“_”Ø 冗余互联在早期的版本，冗余互联只能使用bonding,trunking,teaming等类似的技术实现。从 开始Oracle可以直接实现冗余互联，不需要其它技术。内部冗余可以使用多大4个私有网络实现Ø 网络接口规划在安装过程中确认每个网络接口是公有，私有还是不使用。冗余互联不能用户公有接口，如果需要高可用或负载均衡使用第三方解决方案，如：bondin

6、g,trunking,teaming等类似的技术冗余互联可用于私有网络； 总结：Ø 每个节点至少两块网卡；Ø 私有和公有网络接口名必须不同，且不能包含多语言字符。名字区分大小写；Ø 所有节点的私有网络接口名必须相同；Ø 所有节点的共有网络名必须相同；Ø 为了提升可靠性，为公有和私有网络配置冗余Ø 对于公用网络必须支持TCP/IPØ 对于私有网络必须支持UDP并能切换到TCP/IP1.3.2设置ip地址查看ip地址和网卡情况：ifconfig arootsyspgisdb1 #ifconfig eth0

7、 netmask rootsyspgisdb2 #ifconfig eth0 netmask 再执行下面的，这样才能在重启后不变：vi /etc/sysconfig/network-scripts/ifcfg-eth0增加： ipaddr= netmask= onboot=yes bootproto=static 加网关要求给每台机器加上网关，不然vip有可能起不来su - rootvi /etc/sysconfig/network加GATEWAY=10.111.144.

8、126修改ip映射rootsyspgisdb1 #vi /etc/hosts localhost7 slgapgisdb9 slgapgisdb1-vip slgapgisdb1-priv8 slgapgisdb0 slgapgisdb2-vip slgapgisdb2-priv1 slgapgisdb-scan/*如果是双HBA 卡，还需要安装RDAC 多路径的软件rdac-LINUX-09.03.0C05.

9、0439-source.tar.gztar zxvf rdac-LINUX-09.03.0C05.0439-source.tar.gzcd linuxrdac-09.03.0C05.0439/makemake installvi /etc/grub.conf修改default=1添加title Red Hat Enterprise Linux Server (2.6.18-194.el5)root (hd0,0)kernel /vmlinuz-2.6.18-194.el5 ro root=/dev/VolGroup00/LogVol00 rhgbquietinitrd /mpp-2.6.18-

10、194.el5.img*/1.4禁用防火墙和SELNUX（所有节点）关闭防火墙：Service iptables statusService iptables stopchkconfig iptables offchkconfig iptables list或者：service iptables stopchkconfig -level 12345 iptables offchkconfig iptables -list设置/etc/selinux/config 文件：将SELINUX 设置为disabled,如下：rootrac1 # vi /etc/selinux/config# This

11、 file controls the state of SELinux on the system.# SELINUX= can take one of these three values:# enforcing - SELinux security policy is enforced.# permissive - SELinux prints warnings instead of enforcing.# disabled - No SELinux policy is loaded.SELINUX=disabled# SELINUXTYPE= can take one of these

12、two values:# targeted - Targeted processes are protected,# mls - Multi Level Security protection.SELINUXTYPE=targeted1.5开启ftp服务(可选)-开启vftp服务查看安装包情况rootlocalhost # rpm -qa |grep vsftpvsftpd-2.2.2-6.el6_0.1.x86_64ftp配置文件vi /etc/vsftpd/vsftpd.conf 修改user_list文件启动ftp服务：service vsftpd startchkconfig -lev

13、el 345 vsftpd on1.6检查服务器硬件和内存配置-查看linxu版本lsb_release -auname auname -rm1.6.1内存空间：至少2GB查看内存大小：32Ggrep MemTotal /proc/meminfo1.6.2交换空间SWAP一定要>=16G，否则在预检中报错，一般要求等于内存，或是内存的2倍查看：grep SwapTotal /proc/meminfo修改方式： mkdir -p /home/swapdd if=/dev/zero of=/home/swap/swapfile bs=1G count=32mkswap /home/

14、swap/swapfileswapon /home/swap/swapfile  编辑/etc/fstab /home/swap/swapfile swap swap defaults 0 01.6.3磁盘空间至少2G的共享磁盘空间存储群集共享文件，至少6.5GB的磁盘空间存储Grid infrastructure安装文件df h临时空间：至少1GBdf -h /tmp1.7检查软件需求1.1 确认Linux发行版cat /proc/version1.2 确认内核版本uname -r1.3 查询安装包rpm -q binutilsrpm -q compat-libstdc+

15、rpm -q elfutilsrpm -q gccrpm -q glibcrpm -q kshrpm -q libaiorpm -q libgccrpm -q libstdc+rpm -q makerpm -q sysstatrpm -q unixODBCrpm q libaio-devel安装包安装： rootlocalhost oracle# rpm -q compat-libstdc+package compat-libstdc+ is not installedrpm ivh 安装包名称二、修改操作系统内存参数2.1 修改/etc/security/limits.confvi /etc

16、/security/limits.conf#ORACLE SETTINGgrid soft nproc 2047grid hard nproc 16384grid soft nofile 1024grid hard nofile 65536oracle soft nproc 2047oracle hard nproc 16384oracle soft nofile 1024oracle hard nofile 655362.2修改/etc/pam.d/login在每个 Oracle RAC 节点上，在 /etc/pam.d/login 文件中添加或编辑下面一行内容：rootrac1 #vi /

17、etc/pam.d/login#for oracle session required pam_limits.so 2.3 shell 的限制Vi /etc/profile 文件：rootrac1 # vi /etc/profileif /$USER = "oracle" | /$USER = "grid" ; thenif /$SHELL = "/bin/ksh" ; thenulimit -p 16384ulimit -n 65536elseulimit -u 16384 -n 65536fiumask 022fiDave 备注：

18、在Oracle Linux 6 平台下安装Oracle，可以使用Preinstal 包，该包会完成相关的参数修改等操作，会大大简化我们安装数据库的时间，详细内容参考：Oracle Linux 6 下 Oracle RDBMS Server 11gR2 Preinstall RPM 包说明2.4修改sysctl参数/etc/sysctl.conf添加如下行： kernel.shamall = 2097152 kernel.shmmax = 2147483648 /这两个参数和值一般系统会自动生成，所以没必要添加，也没必要修改kernel.sem = 250 32000 100 128 kerne

19、l.shmmni = 4096 net.core.rmem_default = 4194304net.core.rmem_max = 4194304net.core.wmem_default = 262144net.core.wmem_max = 1048576net.ipv4.ip_local_port_range = 9000 65500 /oracle11g默认设置，与10g不同fs.file-max = 6815744fs.aio-max-nr = 1048576 /这两个参数10g没有#net.core.rmem_default = 262144#net.core.wmem_max

20、= 1048586内核参数修改完成之后，运行#sysctl -p命令使得参数生效。2.5 停止NTP配置可以使用群集同步时间服务代替NTP，当群集发NTP协议没有启用时，群集会自动使用时间同步。停止时间同步服务步骤如下：# /sbin/service ntpd stop# chkconfig ntpd off# mv /etc/ntp.conf /etc/.如果使用群集时间同步，执行如下命令检查crsctl check ctss2.6linux硬件时间设置Ø 默认情况下Linux运行使用的是CPU tick，不会获取BIOS里面存的系统时间，在系统开机时会自动

21、从BIOS里面获取。Ø 系统时间可以用date修改：date s “月/日/年 时:分:秒”Ø 硬件时间使用clock和hwclock设置：hwclock show 显示硬件时间hwclock set date=“月/日/年 时:分:秒”Ø 将系统时间写入硬件时间hwclock systohchwclock -wØ 将硬件时间写入系统时间hwclock hctosyshwclock sü 不同机器间时间同步，在配置NTP服务前首先使用ntpdate同步机器间的时间，因为时间差异过大时NTP不会同步ntpdate hostname三、raw设置如

22、果用裸设备方式，按如下进行，如果按asm方式，参考下面的第五大部分。-分区硬盘fdisk -lfdisk /dev/sdbn-p-l 回车-回车 ，这样新建一个分区，大小是sdb磁盘，最后执行w写入磁盘；sdb1 50Gsdc1 50Gsdd1 100sde1 500sdg1 500sdg1 1048sdh1 1024sdh2 1024存储分区所有规划的设备进行分区，例如在节点1执行：rootdb1 # fdisk /dev/sdeWARNING: DOS-compatible mode is deprecated. It's strongly recommended to switc

23、h off the mode (command 'c') and change display units to sectors (command 'u').Command (m for help): pDisk /dev/sde: 536.9 GB, 536870912000 bytes255 heads, 63 sectors/track, 65270 cylindersUnits = cylinders of 16065 * 512 = 8225280 bytesSector size (logical/physical): 512 bytes / 512

24、 bytesI/O size (minimum/optimal): 512 bytes / 512 bytesDisk identifier: 0x000d60dc Device Boot Start End Blocks Id SystemCommand (m for help): nCommand action e extended p primary partition (1-4)pPartition number (1-4): 1First cylinder (1-65270, default 1): Using default value 1Last cylinder, +cylin

25、ders or +sizeK,M,G (1-65270, default 65270): Using default value 65270Command (m for help): wThe partition table has been altered!Calling ioctl() to re-read partition table.Syncing disks.所有节点同步分区partprobe UDEV绑定裸设备vi /etc/udev/rules.d/60-raw.rules# Enter raw device bindings here.# An example would b

26、e:# ACTION="add", KERNEL="sda", RUN+="/bin/raw /dev/raw/raw1 %N"# to bind /dev/raw/raw1 to /dev/sda, or# ACTION="add", ENVMAJOR="8", ENVMINOR="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"# to bind /dev/raw/raw2 to the device with major

27、 8, minor 1.#for ocr_votingACTION="add",KERNEL="sdb1",RUN+="/bin/raw /dev/raw/raw1 %N"ACTION="add",KERNEL="sdb2",RUN+="/bin/raw /dev/raw/raw2 %N"ACTION="add",KERNEL="sdb3",RUN+="/bin/raw /dev/raw/raw3 %N"#for F

28、lash_RecoveryACTION="add",KERNEL="sdb5",RUN+="/bin/raw /dev/raw/raw4 %N"ACTION="add",KERNEL="sdb6",RUN+="/bin/raw /dev/raw/raw5 %N"ACTION="add",KERNEL="sdb7",RUN+="/bin/raw /dev/raw/raw6 %N"#for dataACTION=&quo

29、t;add",KERNEL="sdc1",RUN+="/bin/raw /dev/raw/raw7 %N"ACTION="add",KERNEL="sdd1",RUN+="/bin/raw /dev/raw/raw8 %N"ACTION="add",KERNEL="sde1",RUN+="/bin/raw /dev/raw/raw9 %N"ACTION="add",KERNEL="sdf1&quo

30、t;,RUN+="/bin/raw /dev/raw/raw10 %N"ACTION="add",KERNEL="sdg1",RUN+="/bin/raw /dev/raw/raw11 %N"ACTION="add",KERNEL="sdh1",RUN+="/bin/raw /dev/raw/raw12 %N"ACTION="add",KERNEL="sdi1",RUN+="/bin/raw /dev/ra

31、w/raw13 %N"ACTION="add",KERNEL="sdj1",RUN+="/bin/raw /dev/raw/raw14 %N"KERNEL="raw1-9*", OWNER="grid", GROUP="asmadmin", MODE="660"重启 UDEV： # /sbin/start_udev以上内容需要在所有节点执行验证：rootdb1 rules.d# ll /dev/rawtotal 0crw-rw- 1 grid a

32、smadmin 162, 1 Jul 11 15:19 raw1crw-rw- 1 grid asmadmin 162, 10 Jul 11 15:19 raw10crw-rw- 1 grid asmadmin 162, 11 Jul 11 15:19 raw11crw-rw- 1 grid asmadmin 162, 12 Jul 11 15:19 raw12crw-rw- 1 grid asmadmin 162, 13 Jul 11 15:19 raw13crw-rw- 1 grid asmadmin 162, 14 Jul 11 15:19 raw14crw-rw- 1 grid asm

33、admin 162, 2 Jul 11 15:19 raw2crw-rw- 1 grid asmadmin 162, 3 Jul 11 15:19 raw3crw-rw- 1 grid asmadmin 162, 4 Jul 11 15:19 raw4crw-rw- 1 grid asmadmin 162, 5 Jul 11 15:19 raw5crw-rw- 1 grid asmadmin 162, 6 Jul 11 15:19 raw6crw-rw- 1 grid asmadmin 162, 7 Jul 11 15:19 raw7crw-rw- 1 grid asmadmin 162, 8

34、 Jul 11 15:19 raw8crw-rw- 1 grid asmadmin 162, 9 Jul 11 15:19 raw9crw-rw- 1 root disk 162, 0 Jul 11 15:19 rawctl 2.4 重启UDEVrootrac1 dev# /sbin/start_udevStarting udev: OK 2.5 检查共享设备的所属关系和权限 rootrac1 rules.d# cd /devrootrac1 dev# ls -al asm-disk*brw-rw- 1 oracle dba 8, 17 Sep 13 2014 asm-disk1brw-rw-

35、 1 oracle dba 8, 33 Sep 13 2014 asm-disk2brw-rw- 1 oracle dba 8, 49 Sep 13 2014 asm-disk3brw-rw- 1 oracle dba 8, 65 Sep 13 2014 asm-disk4brw-rw- 1 oracle dba 8, 81 Sep 13 2014 asm-disk5brw-rw- 1 oracle dba 8, 97 Sep 13 2014 asm-disk6brw-rw- 1 oracle dba 8, 113 Sep 13 2014 asm-disk7 至此配置结束，在ASM的配置中，A

36、SM_DISKSTRING参数指向'/dev/asm-disk*'就可以了。设置随机启动 rootoratest # echo "/sbin/start_udev" >>/etc/rc.local四、创建用户及配置环境变量4.1添加组和用户/usr/sbin/groupadd -g 501 oinstall/usr/sbin/groupadd -g 502 dba/usr/sbin/groupadd -g 503 oper/usr/sbin/groupadd -g 504 asmadmin/usr/sbin/groupadd -g 505 asm

37、oper/usr/sbin/groupadd -g 506 asmdba/usr/sbin/useradd -g oinstall -G dba,asmdba,oper oracle/usr/sbin/useradd -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid备注：修改用户 usermod -d /home/test -G test2 testpasswd oraclepasswd gridoracle321grid3214.2 创建目录mkdir -p /oracle/oraInventorychown -R grid:

38、oinstall /oracle/oraInventorychmod -R 775 /oracle/oraInventorymkdir -p /oracle/gridchown -R grid:oinstall /oracle/gridchmod -R 775 /oracle/gridmkdir -p /oracle/app/cfgtoollogs -needed to ensure that dbca is able to run after the rdbms installation.mkdir -p /oracle/app/product/11.2.0/db_1chown -R ora

39、cle:oinstall /oracle/appchown oracle:oinstall /oraclechmod -R 775 /oracle4.2 Grid 用户变量修改grid 用户的.bash_profile. 注意每个节点的不同内容：export ORACLE_SID=+ASM1export ORACLE_BASE=/oracle/oracleexport ORACLE_HOME=/oracle/grid/11.2.0export PATH=$ORACLE_HOME/bin:$PATH:/usr/local/bin/:.export TEMP=/tmpexport TMP=/tmp

40、export TMPDIR=/tmpumask 022#export ORACLE_SID=+ASM24.3 Oracle 用户变量修改oracle 用户的.bash_profile,注意每个节点的不同内容：export ORACLE_BASE=/oracle/app;export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1;export ORACLE_UNQNAME=slgapgisdb;export ORACLE_SID=slgapgisdb1;export ORACLE_TERM=xterm;export NLS_DATE_FORMAT=&q

41、uot;YYYY:MM:DD HH24:MI:SS"export NLS_LANG=american_america.ZHS16GBK;export TNS_ADMIN=$ORACLE_HOME/network/admin;export ORA_NLS11=$ORACLE_HOME/nls/data;PATH=.:$PATH:$HOME/bin:$ORACLE_HOME/binPATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/binexport PATHLD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_H

42、OME/oracm/libLD_LIBRARY_PATH=$LD_LIBRARY_PATH:/lib:/usr/lib:/usr/local/libexport LD_LIBRARY_PATHCLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib:$ORACLE_HOME/network/jlibexport CLASSPATHexport THREADS_FLAG=native;export TEMP=/tmpexport TMPDIR=/tmp五、asm存储划分+OCR_VOTE盘+DATA盘+ARCH盘ro

43、otcmsnmdb1 # fdisk lfdisk /dev/sdb磁盘分区； n-p1wfdisk l/sbin/partprobe5.1下载及安装asmoracleasm-support-2.1.3-1.el5.x86_64.rpmoracleasmlib-2.0.4-1.el5.x86_64.rpmoracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpm安装：rpm -Uvh oracleasm-support-2.1.3-1.el5.x86_64.rpm rpm -ivh kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.

44、rpm -nodepsoracleasmlib-2.0.4-1.el5.x86_64.rpm oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpmrootcmsnmdb1 oracle# rpm -Uvh oracleasm-support-2.1.3-1.el5.x86_64.rpm > oracleasmlib-2.0.4-1.el5.x86_64.rpm > oracleasm-2.6.18-194.el5-2.0.5-1.el5.x86_64.rpmwarning: oracleasm-support-2.1.3-1.el5.x86

45、_64.rpm: Header V3 DSA signature: NOKEY,key ID 1e5e0159Preparing. # 100%1:oracleasm-support # 33%2:oracleasm-2.6.18-194.el# 67%3:oracleasmlib # 100%rootcmsnmdb1 oracle#rootPGIS67 # rpm -ivh oracleasm-support-2.1.8-1.el6.x86_64.rpmwarning: oracleasm-support-2.1.8-1.el6.x86_64.rpm: Header V3 RSA/SHA25

46、6 Signature, key ID ec551f03: NOKEYPreparing. # 100% 1:oracleasm-support # 100%rootPGIS67 # rpm -ivh oracleasmlib-2.0.4-1.el6.x86_64.rpmwarning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEYerror: Failed dependencies: oracleasm >= 1.0.4 is needed by o

47、racleasmlib-2.0.4-1.el6.x86_64rootPGIS67 # rpm -ivh oracleasmlib-2.0.4-1.el6.x86_64.rpm -nodepswarning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEYPreparing. # 100% 1:oracleasmlib # 100%rootPGIS67 # rpm -ivh kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpmerr

48、or: Failed dependencies: kernel < 2.6.32-359.el6 is needed by kmod-oracleasm-2.0.6.rh1-2.el6.x86_64rootPGIS67 # rpm -ivh kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpm -nodepsPreparing. # 100% 1:kmod-oracleasm # 100%rootPGIS67 # rpm -qa |grep asmkmod-oracleasm-2.0.6.rh1-2.el6.x86_64oracleasmlib-2.0.4-

49、1.el6.x86_64libatasmart-0.17-4.el6_2.x86_64oracleasm-support-2.1.8-1.el6.x86_64rootPGIS67 # 本次安装中，下面两步失败；linux6.2吉林森公项目成功，linux6.55.2配置asm/etc/init.d/oracleasm configurerootcmsnmdb1 oracle# /etc/init.d/oracleasm configureConfiguring the Oracle ASM library driver.This will configure the on-boot prope

50、rties of the Oracle ASM librarydriver. The following questions will determine whether the driver isloaded on boot and what permissions it will have. The current valueswill be shown in brackets (''). Hitting <ENTER> without typing ananswer will keep that current value. Ctrl-C will abort

51、.Default user to own the driver interface : gridDefault group to own the driver interface : asmadminStart Oracle ASM library driver on boot (y/n) n: yScan for Oracle ASM disks on boot (y/n) y: yWriting Oracle ASM library driver configuration: doneInitializing the Oracle ASMLib driver: OK Scanning th

52、e system for Oracle ASMLib disks: OK 5.3创建ASM查看所有磁盘信息fdisk loracle11g中ocr和vote合并为一个磁盘ocrvote磁盘组了；一般还需要设置恢复区、归档日志、数据等；根据上面的结果划分磁盘分区表，如对/dev/sda进行分区：fdisk /dev/sda然按提示依次进行：n-p-1-回车-回车-p-w最后查看结果fdisk l#ls /dev/sd*下面是创建asm磁盘组的结果列表：/etc/init.d/oracleasm createdisk OCR_VOTE01 /dev/sda1/etc/init.d/oracleas

53、m createdisk OCR_VOTE02 /dev/sdb1/etc/init.d/oracleasm createdisk FLASHBACK01 /dev/sdc1/etc/init.d/oracleasm createdisk ARCVG01 /dev/sdd1/etc/init.d/oracleasm createdisk DATAVG01 /dev/sde1/etc/init.d/oracleasm createdisk DATAVG02 /dev/sdf1/etc/init.d/oracleasm createdisk DATAVG03 /dev/sdg1/etc/init.

54、d/oracleasm createdisk DATAVG04 /dev/sdh1rootcmsnmdb1 oracle# /etc/init.d/oracleasm createdisk OCR_VOTE01 /dev/sda1Marking disk "OCR_VOTE01" as an ASM disk: OK rootcmsnmdb1 oracle#/etc/init.d/oracleasm scandisksScanning the system for Oracle ASMLib disks: OK /etc/init.d/oracleasm listdisksrootcmsnmdb1 oracle# /etc/init.d/oracleasm listdisksARCVG01DATAVG01DATAVG02DATAVG03DATAVG04FLASHBACK01OCR_VOTE01OCR_VOTE02 rootcmsnmdb