Oracle技术服务|系统集成|技术开发

 找回密码
 立即注册

QQ登录

只需一步,快速开始

查看: 4881|回复: 3

[分享] Linux Redhat 6安装11gR2 cluster

[复制链接]

15

主题

0

好友

308

积分

版主

Rank: 7Rank: 7Rank: 7

发表于 2013-11-29 11:13:03 |显示全部楼层
Install Oracle 11gR2 Single Database withClusteron RHEL6

Brief informaiton

Node 1
  1. Hostname:               nj-nj-oporadb01
  2. Public IP :                10.65.201.21
  3. private IP:          10.0.0.11
  4. Virtual IP:                 10.65.201.111
复制代码
Node 2
  1. Hostname:              nj-nj-oporadb02
  2. Public IP :               10.65.201.22
  3. private IP:               10.0.0.12
  4. Virtual IP:                10.65.201.112
复制代码
SCAN Name
  1. oporadb-scan.ams.coresvcs.com
复制代码
SCANIP
  1. 10.65.201.120
  2. 10.65.201.121
  3. 10.65.201.122
复制代码
Cluster Name
  1. oporadb-cluster
复制代码
OCR and votedisks:  ASM diskgroup
Request:
  
Type
  
Description
NIC
At least two lan cards  one for public and one for private
Memory
More than 4G
OS
Red Hat Enterprise Linux  6, 2.6.32-71.el6.x86_64 or later
Storage
Shared storage: SAN or  NAS
  
Local storage: more than  18G

Systemconfiguration
1.       System checks
  1. [[email protected] grid]$ cat /proc/version
  2. Linux version 2.6.32-358.18.1.el6.x86_64 ([email protected]) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) ) #1 SMP Fri Aug 2 17:04:38 EDT 2013
  3. [[email protected] grid]$ cat /etc/redhat-release
  4. Red Hat Enterprise Linux Server release 6.4 (Santiago)

  5. [[email protected] ~]$ cat /proc/version
  6. Linux version 2.6.32-358.18.1.el6.x86_64 ([email protected]) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-3) (GCC) ) #1 SMP Fri Aug 2 17:04:38 EDT 2013
  7. [[email protected] ~]$ cat /etc/redhat-release
  8. Red Hat Enterprise Linux Server release 6.4 (Santiago)
复制代码
2.       Resource checkMemory  and Swapcheck
  1. [[email protected] grid]$ grep MemTotal /proc/meminfo
  2. MemTotal:       64679632 kB
  3. [[email protected] grid]$ grep SwapTotal /proc/meminfo
  4. SwapTotal:      17301488 kB

  5. [gr[email protected] ~]$ grep MemTotal /proc/meminfo
  6. MemTotal:       64679632 kB
  7. [[email protected] ~]$ grep SwapTotal /proc/meminfo
  8. SwapTotal:      17301488 kB
复制代码
Ensurethat swap space is greater than or equal to the minimum size required forinstallation as described in the following tables:
        
Available RAM
         
Swap Space Required
     
      
Between 2.5 GB and 32 GB
      
Equal to the size of RAM
   
     
More than 32 GB
      
32 GB of RAM
   
3.       Space check
  1. [[email protected] ~]$ df -h
  2. Filesystem            Size  Used Avail Use% Mounted on
  3. /dev/mapper/vg0-lv_root
  4.                        51G   26G   23G  54% /
  5. tmpfs                  31G  352K   31G   1% /dev/shm
  6. /dev/sdb1             485M   66M  394M  15% /boot

  7. [[email protected] ~]$ df -h
  8. Filesystem            Size  Used Avail Use% Mounted on
  9. /dev/mapper/vg0-lv_root
  10.                        51G   16G   34G  32% /
  11. tmpfs                  31G  228K   31G   1% /dev/shm
  12. /dev/sdb1             485M   66M  394M  15% /boot
复制代码
Ensurehave at least 6.5 GB of space for the Oracle Grid Infrastructure for a Clusterhome,
  1. [[email protected] ~]$ df -h /tmp
  2. Filesystem            Size  Used Avail Use% Mounted on
  3. /dev/mapper/vg0-lv_root
  4.                        51G   26G   23G  54% /

  5. [[email protected] ~]$ df -h /tmp
  6. Filesystem            Size  Used Avail Use% Mounted on
  7. /dev/mapper/vg0-lv_root
  8.                        51G   16G   34G  32% /
复制代码
Ensurethat have at least 1 GB of space in /tmp

4.       Check NetworkRequirements
Ifyou do not enable GNS, then the public and virtual IP addresses for each nodemust be static IP addresses, configured before installation for each node, butnot currently in use. Public and virtual IP addresses must be on the samesubnet.
OracleClusterware manages private IP addresses in the private subnet on interfacesyou identify as private during the installation interview.
Thecluster must have the following addresses configured:

  • A     public IP address for each node, with the following characteristics:

        
    • Static IP address
        
    • Configured before installation for each      node, and resolvable to that node before installation
        
    • On the      same subnet as all other public IP addresses, VIP addresses, and SCAN      addresses
  • A virtual     IP address for each node, with the following characteristics:

        
    • Static IP      address
        
    • Configured      before installation for each node, but not currently in use
        
    • On the      same subnet as all other public IP addresses, VIP addresses, and SCAN      addresses
  • A Single     Client Access Name (SCAN) for the cluster, with the following     characteristics:

        
    • Three      Static IP addresses configured on the domain name server (DNS) before      installation so that the three IP addresses are associated with the name      provided as the SCAN, and all three addresses are returned in random      order by the DNS to the requestor
        
    • Configured      before installation in the DNS to resolve to addresses that are not      currently in use
        
    • Given a      name that does not begin with a numeral
        
    • On the      same subnet as all other public IP addresses, VIP addresses, and SCAN      addresses
        
    • Conforms      with the RFC 952 standard, which allows alphanumeric characters and      hyphens ("-"), but does not allow underscores ("_").
  • A private     IP address for each node, with the following characteristics:

        
    • Static IP      address
        
    • Configured      before installation, but on a separate, private network, with its own      subnet, that is not resolvable except by other cluster member nodes

Note: Oracle strongly recommends that you donot configure SCAN VIP addresses in the hosts file. Use DNS resolution for SCANVIPs. If you use the hosts file to resolve SCANs, then you will only be able toresolve to one IP address and you will have only one SCAN address.
  1. [[email protected] ~]$ cat /etc/hosts
  2. 127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
  3. ::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
  4. ###nj-nj-oporadb01
  5. 10.65.201.21  nj-nj-oporadb01.ams.coresvcs.com  nj-nj-oporadb01
  6. 10.65.201.111 nj-nj-oporadb01-vip
  7. 10.0.0.11     nj-nj-oporadb01-priv

  8. ###nj-nj-oporadb02
  9. 10.65.201.22  nj-nj-oporadb02.ams.coresvcs.com  nj-nj-oporadb02
  10. 10.65.201.112 nj-nj-oporadb02-vip
  11. 10.0.0.12     nj-nj-oporadb02-priv

  12. ###scan IP
  13. 10.65.201.120oporadb-scan.ams.coresvcs.comoporadb-scan
  14. 10.65.201.121oporadb-scan.ams.coresvcs.comoporadb-scan
  15. 10.65.201.122oporadb-scan.ams.coresvcs.comoporadb-scan

  16. [email protected] > nslookup oporadb-scan.ams.coresvcs.com
  17. Server:                 10.41.244.14
  18. Address:              10.41.244.14#53

  19. Name:  oporadb-scan.ams.coresvcs.com
  20. Address: 10.65.201.122
  21. Name:  oporadb-scan.ams.coresvcs.com
  22. Address: 10.65.201.121
  23. Name:  oporadb-scan.ams.coresvcs.com
  24. Address: 10.65.201.120
复制代码
5.       Check Operating System Packages
RedHatLinux 6 x86-64 Oracle Grid Infrastructure and Oracle RAC Package Requirements,thefollowing packages (or later versions) must be installed:
  1. binutils-2.20.51.0.2-5.11.el6 (x86_64)
  2. compat-libcap1-1.10-1 (x86_64)
  3. compat-libstdc++-33-3.2.3-69.el6 (x86_64)
  4. compat-libstdc++-33-3.2.3-69.el6.i686
  5. gcc-4.4.4-13.el6 (x86_64)
  6. gcc-c++-4.4.4-13.el6 (x86_64)
  7. glibc-2.12-1.7.el6 (i686)
  8. glibc-2.12-1.7.el6 (x86_64)
  9. glibc-devel-2.12-1.7.el6 (x86_64)
  10. glibc-devel-2.12-1.7.el6.i686
  11. ksh
  12. libgcc-4.4.4-13.el6 (i686)
  13. libgcc-4.4.4-13.el6 (x86_64)
  14. libstdc++-4.4.4-13.el6 (x86_64)
  15. libstdc++-4.4.4-13.el6.i686
  16. libstdc++-devel-4.4.4-13.el6 (x86_64)
  17. libstdc++-devel-4.4.4-13.el6.i686
  18. libaio-0.3.107-10.el6 (x86_64)
  19. libaio-0.3.107-10.el6.i686
  20. libaio-devel-0.3.107-10.el6 (x86_64)
  21. libaio-devel-0.3.107-10.el6.i686
  22. make-3.81-19.el6
  23. sysstat-9.0.4-11.el6 (x86_64)
复制代码
6.       Configure system kernel parameters
Edit/etc/sysctl.conf
Addthe below lines and make sure the values meet the minimum requirement as below:
  1. fs.aio-max-nr = 1048576
  2. fs.file-max = 6815744
  3. kernel.shmall = 2097152
  4. kernel.shmmax = 536870912
  5. kernel.shmmni = 4096
  6. kernel.sem = 250 32000 100 128
  7. net.ipv4.ip_local_port_range = 9000 65500
  8. net.core.rmem_default = 262144
  9. net.core.rmem_max = 4194304
  10. net.core.wmem_default = 262144
  11. net.core.wmem_max = 1048586
复制代码
itwill take effect after running the command: sysctl -p

7.       Stop ntpd service
Wewill use Oracle CTSSD service instead of ntp to implement time synchronization,executethe steps on each node,
  1. service ntpd stop
  2. chkconfig ntpd off
  3. mv /etc/ntp.conf /etc/ntp.conf.org
  4. rm /var/run/ntpd.pid
复制代码
8.       Directory design
  1. /tmp      2G   free space
  2. /u01      8G   for the binary installation。
  3. /soft     5G  for storing Installation media
复制代码
Note:in this case, all the other datafiles will be placed on ASM.

9.       IP design
  
Node
  
Public  IP
Private  IP
VIP
node1
10.65.201.21
10.0.0.11
10.65.201.111
node2
10.65.201.22
10.0.0.12
10.65.201.112
  
SCAN name
  
SCAN IP
oporadb-scan.ams.coresvcs.com
10.65.201.120-122
Addthe below info to the /etc/hosts on each node,
  1. ###nj-nj-oporadb01
  2. 10.65.201.21  nj-nj-oporadb01.ams.coresvcs.com  nj-nj-oporadb01
  3. 10.65.201.111 nj-nj-oporadb01-vip
  4. 10.0.0.11     nj-nj-oporadb01-priv

  5. ###nj-nj-oporadb02
  6. 10.65.201.22  nj-nj-oporadb02.ams.coresvcs.com  nj-nj-oporadb02
  7. 10.65.201.112 nj-nj-oporadb02-vip
  8. 10.0.0.12     nj-nj-oporadb02-priv

  9. ###scan IP
  10. 10.65.201.103  oporadb-scan.ams.coresvcs.com oporadb-scan
  11. 10.65.201.104  oporadb-scan.ams.coresvcs.com oporadb-scan
  12. 10.65.201.105  oporadb-scan.ams.coresvcs.com oporadb-scan
复制代码
10.       User design
Installgrid Infrastructure and database use separate user in 11g
  
Group Name
  
gid
description
oinstall
502
Oracle  Software owner
dba
501
DB  administrator
  
User Name
  
uid
Primary Group
Other groups
Description
grid
1100
oinstall
dba
Oracle  Cluster user
oracle
501
oinstall
dba
Oracle DB  user
  1. # groupadd -g 502 oinstall
  2. # groupadd -g 501 dba
  3. # useradd -u 1100 -g oinstall -G  dba  grid
  4. # useradd -u  501 -g oinstall -G dba oracle
  5. # mkdir -p /u01/app/grid
  6. # mkdir -p /u01/app/11.2.0/grid
  7. # chown -R grid:oinstall /u01
  8. # mkdir -p /u01/app/oracle
  9. # chown oracle:oinstall /u01/app/oracle
  10. # chmod -R 775 /u01
  11. # passwd grid
  12. # passwd oracle
复制代码
11.       Modify user limits
Modifythe file /etc/security/limits.conf as rootadd below info
  1. grid soft nproc 2047
  2. grid hard nproc 16384
  3. grid soft nofile 1024
  4. grid hard nofile 65536
  5. oracle soft nproc 2047
  6. oracle hard nproc 16384
  7. oracle soft nofile 1024
  8. oracle hard nofile 65536
复制代码
edit/etc/pam.d/loginas rootadd the below info
  1. session required pam_limits.so
复制代码
edit/etc/profileadd below infoas root
  1. if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
  2. if [ $SHELL = "/bin/ksh" ]; then
  3. ulimit -p 16384
  4. ulimit -n 65536
  5. else
  6. ulimit -u 16384 -n 65536
  7. fi
  8. umask 022
  9. fi
复制代码
Toavoid stty causes error during installation, add below content in the $HOME/.bashrcoforacle and grid,
  1. if [ -t 0 ]; then
  2. stty intr ^C
  3. fi

  4. [[email protected] ~]# su – oracle
  5. [[email protected] ~]$ vi .bashrc
  6. [[email protected] ~]$ su - grid
  7. Password:
  8. [[email protected] ~]$ vi .bashrc
复制代码
12.        Set users’ profile
Configure.bash_profile of grid and oracle users on both nodes
Grid user $HOME/.bash_profile
  1. TMP=/tmp; export TMP
  2. TMPDIR=$TMP; export TMPDIR
  3. #ORACLE_SID is different,node2 should be +ASM2
  4. ORACLE_SID=+ASM1; export ORACLE_SID
  5. ORACLE_BASE=/u01/app/grid
  6. export ORACLE_BASE
  7. ORACLE_HOME=/u01/app/11.2.0/grid
  8. export ORACLE_HOME
  9. NLS_LANG=AMERICAN_AMERICA.ZHS16GBK
  10. export NLS_LANG
  11. NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT
  12. PATH=$ORACLE_BASE/bin:$ORACLE_HOME/bin:/bin:/sbin:/usr/ccs/bin:/usr/local/bin:$PATH
  13. export PATH
  14. umask 022
复制代码
oracle user$HOME/.bash_profile
  1. ORACLE_BASE=/u01/app/oracle
  2. export ORACLE_BASE
  3. ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
  4. export ORACLE_HOME
  5. ORACLE_TERM=xterm
  6. export ORACLE_TERM
  7. TNS_ADMIN=$ORACLE_HOME/network/admin
  8. export TNS_ADMIN
  9. NLS_LANG=AMERICAN_AMERICA.ZHS16GBK
  10. export NLS_LANG
  11. NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"; export NLS_DATE_FORMAT
  12. PATH=$ORACLE_HOME/bin:/bin:/sbin:/usr/ccs/bin:/usr/local/bin:$PATH
  13. export PATH
  14. LD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_HOME/network/lib:/usr/local/lib:/usr/lib
  15. export LD_LIBRARY_PATH
  16. CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib
  17. export CLASSPATH
  18. umask 022
复制代码
13.        Automatic SSH Configuration
Executethe below commands on both nodes,
  1. su - oracle
  2. mkdir ~/.ssh
  3. chmod 700 ~/.ssh
  4. /usr/bin/ssh-keygen -t rsa
  5. /usr/bin/ssh-keygen -t dsa
复制代码
Executethe below command on one node,
  1. touch ~/.ssh/authorized_keys
  2. cd ~/.ssh
  3. sshnj-nj-oporadb01cat $HOME/.ssh/id_rsa.pub >> authorized_keys
  4. sshnj-nj-oporadb01cat $HOME/.ssh/id_dsa.pub >> authorized_keys
  5. sshnj-nj-oporadb02cat $HOME/.ssh/id_rsa.pub >> authorized_keys
  6. sshnj-nj-oporadb02cat $HOME/.ssh/id_dsa.pub >> authorized_keys
  7. scp authorized_keys  nj-nj-oporadb02:$HOME/.ssh/
复制代码
Executethe below command on both nodes,
  1. chmod 600 ~/.ssh/authorized_keys
复制代码
verifythe following commands can work without password on both nodes,
  1. sshnj-oporadb01date
  2. sshnj-oporadb02date
  3. sshnj-oporadb01-priv date
  4. sshnj-oporadb02-priv date
复制代码
dothe above steps as grid,execute the following commands on both nodes,
  1. su – grid
  2. mkdir ~/.ssh
  3. chmod 700 ~/.ssh
  4. /usr/bin/ssh-keygen -t rsa
  5. /usr/bin/ssh-keygen -t dsa
复制代码
Executethe following commands on node1,
  1. touch ~/.ssh/authorized_keys
  2. cd ~/.ssh
  3. sshnj-oporadb01cat $HOME/.ssh/id_rsa.pub >> authorized_keys
  4. sshnj-oporadb01cat $HOME/.ssh/id_dsa.pub >> authorized_keys
  5. sshnj-oporadb02cat $HOME/.ssh/id_rsa.pub >> authorized_keys
  6. sshnj-oporadb02cat $HOME/.ssh/id_dsa.pub >> authorized_keys
  7. scp authorized_keys  nj-oporadb02:$HOME/.ssh/
复制代码
executethe following command on both nodes,
  1. chmod 600 ~/.ssh/authorized_keys
复制代码
verifythe following commands can work without password on both nodes,
  1. sshnj-oporadb01date
  2. sshnj-oporadb02date
  3. sshnj-oporadb01-priv date
  4. sshnj-oporadb02-priv date
复制代码
Configure ASMshared disks14.        Install ASM system packages
InstallASMLib 2.0 packages
  1. oracleasmlib-2.0                  - the ASM libraries
  2. oracleasm-support-2.1             - utilities needed to administer ASMLib
复制代码
  1. [[email protected] ~]# uname -rm
  2. 2.6.32-358.18.1.el6.x86_64 x86_64
复制代码
Downthe corresponding packages from
http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html
  1. oracleasm-support-2.1.8-1.el6.x86_64
  2. oracleasmlib-2.0.4-1.el6.x86_64
复制代码
15.        C heck the disks info
Node 1
  1. [[email protected] ~]# fdisk -l
复制代码
Node 2
  1. [[email protected] ~]# fdisk -l
复制代码
CreateASM diskgroups,execute the following commands on node1 as root user:
  1. oracleasm createdisk ASM_DISK01 /dev/emcpowera1
  2. oracleasm createdisk ASM_DISK02 /dev/emcpowerb1
  3. oracleasm createdisk ASM_DISK03 /dev/emcpowerc1
  4. oracleasm createdisk ASM_DISK04 /dev/emcpowerd1
  5. oracleasm createdisk ASM_DISK05 /dev/emcpowere1
  6. oracleasm createdisk ASM_DISK06 /dev/emcpowerf1
  7. oracleasm createdisk ASM_DISK07 /dev/emcpowerg1
  8. oracleasm createdisk ASM_DISK08 /dev/emcpowerh1
  9. oracleasm createdisk ASM_DISK09 /dev/emcpoweri1               
  10. oracleasm createdisk ASM_DISK11 /dev/emcpowera2              
  11. oracleasm createdisk ASM_DISK12 /dev/emcpowerb2               
  12. oracleasm createdisk ASM_DISK13 /dev/emcpowerc2               
  13. oracleasm createdisk ASM_DISK14 /dev/emcpowerd2                 
  14. oracleasm createdisk ASM_DISK15 /dev/emcpowere2               
  15. oracleasm createdisk ASM_DISK16 /dev/emcpowerf2            
  16. oracleasm createdisk ASM_DISK17 /dev/emcpowerg2               
  17. oracleasm createdisk ASM_DISK18 /dev/emcpowerh2               
  18. oracleasm createdisk ASM_DISK19 /dev/emcpoweri2            
  19. oracleasm createdisk ASM_DISK20 /dev/emcpowerj1               
  20. oracleasm createdisk ASM_DISK21 /dev/emcpowera6              
  21. oracleasm createdisk ASM_DISK22 /dev/emcpowerb6               
  22. oracleasm createdisk ASM_DISK23 /dev/emcpowerc6               
  23. oracleasm createdisk ASM_DISK24 /dev/emcpowerd6               
  24. oracleasm createdisk ASM_DISK25 /dev/emcpowerl1
  25. oracleasm createdisk ASM_DISK26 /dev/emcpowerc3
  26. oracleasm createdisk ASM_DISK27 /dev/emcpowera3
  27. oracleasm createdisk ASM_DISK28 /dev/emcpowerb3
  28. oracleasm createdisk ASM_DISK29 /dev/emcpowerb3
  29. oracleasm createdisk ASM_DISK30 /dev/emcpowerb3
  30. [[email protected] ~]# oracleasm listdisks
  31. ASM_DISK01
  32. ASM_DISK02
  33. ASM_DISK03
  34. ASM_DISK04
  35. ASM_DISK05
  36. ASM_DISK06
  37. ASM_DISK07
  38. ASM_DISK08
  39. ASM_DISK09
  40. ASM_DISK11
  41. ASM_DISK12
  42. ASM_DISK13
  43. ASM_DISK14
  44. ASM_DISK15
  45. ASM_DISK16
  46. ASM_DISK17
  47. ASM_DISK18
  48. ASM_DISK19
  49. ASM_DISK20
  50. ASM_DISK21
  51. ASM_DISK22
  52. ASM_DISK23
  53. ASM_DISK24
  54. ASM_DISK25
  55. ASM_DISK26
  56. ASM_DISK27
  57. ASM_DISK28
  58. ASM_DISK29
  59. ASM_DISK30
复制代码
Runthe below commands on node2 as root:
  1. #oracleasm scandisks
  2. #oracleasm listdisks
复制代码
  Installbinaries1. Media
Downloadthe following medias and place them on the all nodes
  1. p13390677_112040_Linux-x86-64_1of7.zip
  2. p13390677_112040_Linux-x86-64_2of7.zip
  3. p13390677_112040_Linux-x86-64_3of7.zip
复制代码
2.      Install cvuqdisk package
Install cvuqdiskpackage on each nodes asroot, this package which is used to discover the shared storage,locates in therpm directory of the gridpackagep13390677_112040_Linux-x86-64_3of7.zip:
  1. export CVUQDISK_GRP=oinstall
  2. rpm –ivh cvuqdisk-1.0.9-1.rpm
  3. [[email protected] oracleinstall]#unzip p13390677_112040_Linux-x86-64_3of7.zip
  4. [[email protected] oracleinstall]#cd grid/rpm
  5. [[email protected] rpm]# rpm -ivh cvuqdisk-1.0.9-1.rpm
  6. Preparing...                ########################################### [100%]
  7.    1:cvuqdisk               ########################################### [100%]
  8. [[email protected] rpm]# rpm -ivh cvuqdisk-1.0.9-1.rpm
  9. Preparing...                ########################################### [100%]
  10.    1:cvuqdisk               ########################################### [100%]
复制代码
3.     Pre-check the cluster environment as grid
The script locates in the grid package p13390677_112040_Linux-x86-64_3of7.zip,
  1. ./runcluvfy.sh stage -pre crsinst -n node1,node2 -fixup -verbose
复制代码
Checkas below
  1. [[email protected] grid]$ ./runcluvfy.sh stage -pre crsinst -n nj-oporadb01,nj-oporadb02 -fixup -verbose

  2. Performing pre-checks for cluster services setup

  3. Checking node reachability...

  4. Check: Node reachability from node "nj-oporadb02"
  5. Destination Node                      Reachable?
  6.   ------------------------------------  ------------------------
  7. nj-oporadb01                          yes
  8. nj-oporadb02                          yes
  9. Result: Node reachability check passed from node "nj-oporadb02"


  10. Checking user equivalence...

  11. Check: User equivalence for user "grid"
  12.   Node Name                             Status
  13.   ------------------------------------  ------------------------
  14. nj-oporadb02                          passed
  15. nj-oporadb01                          passed
  16. Result: User equivalence check passed for user "grid"

  17. Checking node connectivity...

  18. Checking hosts config file...
  19.   Node Name                             Status
  20.   ------------------------------------  ------------------------
  21. nj-oporadb02                          passed
  22. nj-oporadb01                          passed

  23. Verification of the hosts config file successful


  24. Interface information for node "nj-oporadb02"
  25. Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU
  26. ------ --------------- --------------- --------------- --------------- ----------------- ------
  27. eth2   10.0.0.12       10.0.0.0        0.0.0.0         10.65.201.1     00:1D:09:71:CD:68 1500
  28. bond0  10.65.201.22    10.65.201.0     0.0.0.0         10.65.201.1     00:1E:4F:1A:FF:32 1500


  29. Interface information for node "nj-oporadb01"
  30. Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU
  31. ------ --------------- --------------- --------------- --------------- ----------------- ------
  32. eth2   10.0.0.11       10.0.0.0        0.0.0.0         10.65.201.1     00:1D:09:71:CD:20 1500
  33. bond0  10.65.201.21    10.65.201.0     0.0.0.0         10.65.201.1     00:1E:4F:1C:2F:83 1500


  34. Check: Node connectivity of subnet "10.0.0.0"
  35.   Source                          Destination                     Connected?
  36.   ------------------------------  ------------------------------  ----------------
  37.   nj-oporadb02[10.0.0.12]         nj-oporadb01[10.0.0.11]         yes
  38. Result: Node connectivity passed for subnet "10.0.0.0" with node(s) nj-oporadb02,nj-oporadb01


  39. Check: TCP connectivity of subnet "10.0.0.0"
  40.   Source                          Destination                     Connected?
  41.   ------------------------------  ------------------------------  ----------------
  42. nj-oporadb02:10.0.0.12          nj-oporadb01:10.0.0.11          passed
  43. Result: TCP connectivity check passed for subnet "10.0.0.0"


  44. Check: Node connectivity of subnet "10.65.201.0"
  45.   Source                          Destination                     Connected?
  46.   ------------------------------  ------------------------------  ----------------
  47.   nj-oporadb02[10.65.201.22]      nj-oporadb01[10.65.201.21]      yes
  48. Result: Node connectivity passed for subnet "10.65.201.0" with node(s) nj-oporadb02,nj-oporadb01


  49. Check: TCP connectivity of subnet "10.65.201.0"
  50.   Source                          Destination                     Connected?
  51.   ------------------------------  ------------------------------  ----------------
  52. nj-oporadb02:10.65.201.22       nj-oporadb01:10.65.201.21       passed
  53. Result: TCP connectivity check passed for subnet "10.65.201.0"


  54. Interfaces found on subnet "10.65.201.0" that are likely candidates for VIP are:
  55. nj-oporadb02 bond0:10.65.201.22
  56. nj-oporadb01 bond0:10.65.201.21

  57. Interfaces found on subnet "10.0.0.0" that are likely candidates for a private interconnect are:
  58. nj-oporadb02 eth2:10.0.0.12
  59. nj-oporadb01 eth2:10.0.0.11
  60. Checking subnet mask consistency...
  61. Subnet mask consistency check passed for subnet "10.0.0.0".
  62. Subnet mask consistency check passed for subnet "10.65.201.0".
  63. Subnet mask consistency check passed.

  64. Result: Node connectivity check passed

  65. Checking multicast communication...

  66. Checking subnet "10.0.0.0" for multicast communication with multicast group "230.0.1.0"...
  67. Check of subnet "10.0.0.0" for multicast communication with multicast group "230.0.1.0" passed.

  68. Checking subnet "10.65.201.0" for multicast communication with multicast group "230.0.1.0"...
  69. Check of subnet "10.65.201.0" for multicast communication with multicast group "230.0.1.0" passed.

  70. Check of multicast communication passed.

  71. Checking ASMLib configuration.
  72.   Node Name                             Status
  73.   ------------------------------------  ------------------------
  74. nj-oporadb02                          passed
  75. nj-oporadb01                          passed
  76. Result: Check for ASMLib configuration passed.

  77. Check: Total memory
  78.   Node Name     Available                 Required                  Status
  79.   ------------  ------------------------  ------------------------  ----------
  80.   nj-oporadb02  61.6833GB (6.4679632E7KB)  1.5GB (1572864.0KB)       passed
  81.   nj-oporadb01  61.6833GB (6.4679632E7KB)  1.5GB (1572864.0KB)       passed
  82. Result: Total memory check passed

  83. Check: Available memory
  84.   Node Name     Available                 Required                  Status
  85.   ------------  ------------------------  ------------------------  ----------
  86.   nj-oporadb02  60.1665GB (6.3089152E7KB)  50MB (51200.0KB)          passed
  87.   nj-oporadb01  44.9829GB (4.716802E7KB)  50MB (51200.0KB)          passed
  88. Result: Available memory check passed

  89. Check: Swap space
  90.   Node Name     Available                 Required                  Status
  91.   ------------  ------------------------  ------------------------  ----------
  92.   nj-oporadb02  16.5GB (1.7301488E7KB)    16GB (1.6777216E7KB)      passed
  93.   nj-oporadb01  16.5GB (1.7301488E7KB)    16GB (1.6777216E7KB)      passed
  94. Result: Swap space check passed

  95. Check: Free disk space for "nj-oporadb02:/tmp"
  96.   Path              Node Name     Mount point   Available     Required      Status
  97.   ----------------  ------------  ------------  ------------  ------------  ------------
  98.   /tmp              nj-oporadb02  /             34.7506GB     1GB           passed
  99. Result: Free disk space check passed for "nj-oporadb02:/tmp"

  100. Check: Free disk space for "nj-oporadb01:/tmp"
  101.   Path              Node Name     Mount point   Available     Required      Status
  102.   ----------------  ------------  ------------  ------------  ------------  ------------
  103.   /tmp              nj-oporadb01  /             23.8174GB     1GB           passed
  104. Result: Free disk space check passed for "nj-oporadb01:/tmp"

  105. Check: User existence for "grid"
  106.   Node Name     Status                    Comment
  107.   ------------  ------------------------  ------------------------
  108.   nj-oporadb02  passed                    exists(1100)
  109.   nj-oporadb01  passed                    exists(1100)

  110. Checking for multiple users with UID value 1100
  111. Result: Check for multiple users with UID value 1100 passed
  112. Result: User existence check passed for "grid"

  113. Check: Group existence for "oinstall"
  114.   Node Name     Status                    Comment
  115.   ------------  ------------------------  ------------------------
  116.   nj-oporadb02  passed                    exists
  117.   nj-oporadb01  passed                    exists
  118. Result: Group existence check passed for "oinstall"

  119. Check: Group existence for "dba"
  120.   Node Name     Status                    Comment
  121.   ------------  ------------------------  ------------------------
  122.   nj-oporadb02  passed                    exists
  123.   nj-oporadb01  passed                    exists
  124. Result: Group existence check passed for "dba"

  125. Check: Membership of user "grid" in group "oinstall" [as Primary]
  126.   Node Name         User Exists   Group Exists  User in Group  Primary       Status
  127.   ----------------  ------------  ------------  ------------  ------------  ------------
  128. nj-oporadb02      yes           yes           yes           yes           passed
  129. nj-oporadb01      yes           yes           yes           yes           passed
  130. Result: Membership check for user "grid" in group "oinstall" [as Primary] passed

  131. Check: Membership of user "grid" in group "dba"
  132.   Node Name         User Exists   Group Exists  User in Group  Status
  133.   ----------------  ------------  ------------  ------------  ----------------
  134. nj-oporadb02      yes           yes           yes           passed
  135. nj-oporadb01      yes           yes           yes           passed
  136. Result: Membership check for user "grid" in group "dba" passed

  137. Check: Run level
  138.   Node Name     run level                 Required                  Status
  139.   ------------  ------------------------  ------------------------  ----------
  140.   nj-oporadb02  3                         3,5                       passed
  141.   nj-oporadb01  3                         3,5                       passed
  142. Result: Run level check passed

  143. Check: Hard limits for "maximum open file descriptors"
  144.   Node Name         Type          Available     Required      Status
  145.   ----------------  ------------  ------------  ------------  ----------------
  146. nj-oporadb02      hard          65536         65536         passed
  147. nj-oporadb01      hard          65536         65536         passed
  148. Result: Hard limits check passed for "maximum open file descriptors"

  149. Check: Soft limits for "maximum open file descriptors"
  150.   Node Name         Type          Available     Required      Status
  151.   ----------------  ------------  ------------  ------------  ----------------
  152. nj-oporadb02      soft          1024          1024          passed
  153. nj-oporadb01      soft          1024          1024          passed
  154. Result: Soft limits check passed for "maximum open file descriptors"

  155. Check: Hard limits for "maximum user processes"
  156.   Node Name         Type          Available     Required      Status
  157.   ----------------  ------------  ------------  ------------  ----------------
  158. nj-oporadb02      hard          16384         16384         passed
  159. nj-oporadb01      hard          16384         16384         passed
  160. Result: Hard limits check passed for "maximum user processes"

  161. Check: Soft limits for "maximum user processes"
  162.   Node Name         Type          Available     Required      Status
  163.   ----------------  ------------  ------------  ------------  ----------------
  164. nj-oporadb02      soft          2047          2047          passed
  165. nj-oporadb01      soft          2047          2047          passed
  166. Result: Soft limits check passed for "maximum user processes"

  167. Check: System architecture
  168.   Node Name     Available                 Required                  Status
  169.   ------------  ------------------------  ------------------------  ----------
  170.   nj-oporadb02  x86_64                    x86_64                    passed
  171.   nj-oporadb01  x86_64                    x86_64                    passed
  172. Result: System architecture check passed

  173. Check: Kernel version
  174.   Node Name     Available                 Required                  Status
  175.   ------------  ------------------------  ------------------------  ----------
  176.   nj-oporadb02  2.6.32-358.18.1.el6.x86_64  2.6.9                     passed
  177.   nj-oporadb01  2.6.32-358.18.1.el6.x86_64  2.6.9                     passed
  178. Result: Kernel version check passed

  179. Check: Kernel parameter for "semmsl"
  180.   Node Name         Current       Configured    Required      Status        Comment
  181.   ----------------  ------------  ------------  ------------  ------------  ------------
  182. nj-oporadb02      250           250           250           passed
  183. nj-oporadb01      250           250           250           passed
  184. Result: Kernel parameter check passed for "semmsl"

  185. Check: Kernel parameter for "semmns"
  186.   Node Name         Current       Configured    Required      Status        Comment
  187.   ----------------  ------------  ------------  ------------  ------------  ------------
  188. nj-oporadb02      32000         32000         32000         passed
  189. nj-oporadb01      32000         32000         32000         passed
  190. Result: Kernel parameter check passed for "semmns"

  191. Check: Kernel parameter for "semopm"
  192.   Node Name         Current       Configured    Required      Status        Comment
  193.   ----------------  ------------  ------------  ------------  ------------  ------------
  194. nj-oporadb02      100           100           100           passed
  195. nj-oporadb01      100           100           100           passed
  196. Result: Kernel parameter check passed for "semopm"

  197. Check: Kernel parameter for "semmni"
  198.   Node Name         Current       Configured    Required      Status        Comment
  199.   ----------------  ------------  ------------  ------------  ------------  ------------
  200. nj-oporadb02      128           128           128           passed
  201. nj-oporadb01      128           128           128           passed
  202. Result: Kernel parameter check passed for "semmni"

  203. Check: Kernel parameter for "shmmax"
  204.   Node Name         Current       Configured    Required      Status        Comment
  205.   ----------------  ------------  ------------  ------------  ------------  ------------
  206. nj-oporadb02      68719476736   68719476736   4294967295    passed
  207. nj-oporadb01      68719476736   68719476736   4294967295    passed
  208. Result: Kernel parameter check passed for "shmmax"

  209. Check: Kernel parameter for "shmmni"
  210.   Node Name         Current       Configured    Required      Status        Comment
  211.   ----------------  ------------  ------------  ------------  ------------  ------------
  212. nj-oporadb02      4096          4096          4096          passed
  213. nj-oporadb01      4096          4096          4096          passed
  214. Result: Kernel parameter check passed for "shmmni"

  215. Check: Kernel parameter for "shmall"
  216.   Node Name         Current       Configured    Required      Status        Comment
  217.   ----------------  ------------  ------------  ------------  ------------  ------------
  218. nj-oporadb02      4294967296    4294967296    2097152       passed
  219. nj-oporadb01      4294967296    4294967296    2097152       passed
  220. Result: Kernel parameter check passed for "shmall"

  221. Check: Kernel parameter for "file-max"
  222.   Node Name         Current       Configured    Required      Status        Comment
  223.   ----------------  ------------  ------------  ------------  ------------  ------------
  224. nj-oporadb02      6815744       6815744       6815744       passed
  225. nj-oporadb01      6815744       6815744       6815744       passed
  226. Result: Kernel parameter check passed for "file-max"

  227. Check: Kernel parameter for "ip_local_port_range"
  228.   Node Name         Current       Configured    Required      Status        Comment
  229.   ----------------  ------------  ------------  ------------  ------------  ------------
  230. nj-oporadb02      between 9000.0 & 65500.0  between 9000.0 & 65500.0  between 9000.0 & 65500.0  passed
  231. nj-oporadb01      between 9000.0 & 65500.0  between 9000.0 & 65500.0  between 9000.0 & 65500.0  passed
  232. Result: Kernel parameter check passed for "ip_local_port_range"

  233. Check: Kernel parameter for "rmem_default"
  234.   Node Name         Current       Configured    Required      Status        Comment
  235.   ----------------  ------------  ------------  ------------  ------------  ------------
  236. nj-oporadb02      1048576       1048576       262144        passed
  237. nj-oporadb01      1048576       1048576       262144        passed
  238. Result: Kernel parameter check passed for "rmem_default"

  239. Check: Kernel parameter for "rmem_max"
  240.   Node Name         Current       Configured    Required      Status        Comment
  241.   ----------------  ------------  ------------  ------------  ------------  ------------
  242. nj-oporadb02      4194304       4194304       4194304       passed
  243. nj-oporadb01      4194304       4194304       4194304       passed
  244. Result: Kernel parameter check passed for "rmem_max"

  245. Check: Kernel parameter for "wmem_default"
  246.   Node Name         Current       Configured    Required      Status        Comment
  247.   ----------------  ------------  ------------  ------------  ------------  ------------
  248. nj-oporadb02      262144        262144        262144        passed
  249. nj-oporadb01      262144        262144        262144        passed
  250. Result: Kernel parameter check passed for "wmem_default"

  251. Check: Kernel parameter for "wmem_max"
  252.   Node Name         Current       Configured    Required      Status        Comment
  253.   ----------------  ------------  ------------  ------------  ------------  ------------
  254. nj-oporadb02      1048576       1048576       1048576       passed
  255. nj-oporadb01      1048576       1048576       1048576       passed
  256. Result: Kernel parameter check passed for "wmem_max"

  257. Check: Kernel parameter for "aio-max-nr"
  258.   Node Name         Current       Configured    Required      Status        Comment
  259.   ----------------  ------------  ------------  ------------  ------------  ------------
  260. nj-oporadb02      1048576       1048576       1048576       passed
  261. nj-oporadb01      1048576       1048576       1048576       passed
  262. Result: Kernel parameter check passed for "aio-max-nr"

  263. Check: Package existence for "make"
  264.   Node Name     Available                 Required                  Status
  265.   ------------  ------------------------  ------------------------  ----------
  266.   nj-oporadb02  make-3.81-20.el6          make-3.80                 passed
  267.   nj-oporadb01  make-3.81-20.el6          make-3.80                 passed
  268. Result: Package existence check passed for "make"

  269. Check: Package existence for "binutils"
  270.   Node Name     Available                 Required                  Status
  271.   ------------  ------------------------  ------------------------  ----------
  272.   nj-oporadb02  binutils-2.20.51.0.2-5.36.el6  binutils-2.15.92.0.2      passed
  273.   nj-oporadb01  binutils-2.20.51.0.2-5.36.el6  binutils-2.15.92.0.2      passed
  274. Result: Package existence check passed for "binutils"

  275. Check: Package existence for "gcc(x86_64)"
  276.   Node Name     Available                 Required                  Status
  277.   ------------  ------------------------  ------------------------  ----------
  278.   nj-oporadb02  gcc(x86_64)-4.4.7-3.el6   gcc(x86_64)-3.4.6         passed
  279.   nj-oporadb01  gcc(x86_64)-4.4.7-3.el6   gcc(x86_64)-3.4.6         passed
  280. Result: Package existence check passed for "gcc(x86_64)"

  281. Check: Package existence for "libaio(x86_64)"
  282.   Node Name     Available                 Required                  Status
  283.   ------------  ------------------------  ------------------------  ----------
  284.   nj-oporadb02  libaio(x86_64)-0.3.107-10.el6  libaio(x86_64)-0.3.105    passed
  285.   nj-oporadb01  libaio(x86_64)-0.3.107-10.el6  libaio(x86_64)-0.3.105    passed
  286. Result: Package existence check passed for "libaio(x86_64)"

  287. Check: Package existence for "glibc(x86_64)"
  288.   Node Name     Available                 Required                  Status
  289.   ------------  ------------------------  ------------------------  ----------
  290.   nj-oporadb02  glibc(x86_64)-2.12-1.107.el6_4.4  glibc(x86_64)-2.3.4-2.41  passed
  291.   nj-oporadb01  glibc(x86_64)-2.12-1.107.el6_4.4  glibc(x86_64)-2.3.4-2.41  passed
  292. Result: Package existence check passed for "glibc(x86_64)"

  293. Check: Package existence for "compat-libstdc++-33(x86_64)"
  294.   Node Name     Available                 Required                  Status
  295.   ------------  ------------------------  ------------------------  ----------
  296.   nj-oporadb02  compat-libstdc++-33(x86_64)-3.2.3-69.el6  compat-libstdc++-33(x86_64)-3.2.3  passed
  297.   nj-oporadb01  compat-libstdc++-33(x86_64)-3.2.3-69.el6  compat-libstdc++-33(x86_64)-3.2.3  passed
  298. Result: Package existence check passed for "compat-libstdc++-33(x86_64)"

  299. Check: Package existence for "elfutils-libelf(x86_64)"
  300.   Node Name     Available                 Required                  Status
  301.   ------------  ------------------------  ------------------------  ----------
  302.   nj-oporadb02  elfutils-libelf(x86_64)-0.152-1.el6  elfutils-libelf(x86_64)-0.97  passed
  303.   nj-oporadb01  elfutils-libelf(x86_64)-0.152-1.el6  elfutils-libelf(x86_64)-0.97  passed
  304. Result: Package existence check passed for "elfutils-libelf(x86_64)"

  305. Check: Package existence for "elfutils-libelf-devel"
  306.   Node Name     Available                 Required                  Status
  307.   ------------  ------------------------  ------------------------  ----------
  308.   nj-oporadb02  elfutils-libelf-devel-0.152-1.el6  elfutils-libelf-devel-0.97  passed
  309.   nj-oporadb01  elfutils-libelf-devel-0.152-1.el6  elfutils-libelf-devel-0.97  passed
  310. Result: Package existence check passed for "elfutils-libelf-devel"

  311. Check: Package existence for "glibc-common"
  312.   Node Name     Available                 Required                  Status
  313.   ------------  ------------------------  ------------------------  ----------
  314.   nj-oporadb02  glibc-common-2.12-1.107.el6_4.4  glibc-common-2.3.4        passed
  315.   nj-oporadb01  glibc-common-2.12-1.107.el6_4.4  glibc-common-2.3.4        passed
  316. Result: Package existence check passed for "glibc-common"

  317. Check: Package existence for "glibc-devel(x86_64)"
  318.   Node Name     Available                 Required                  Status
  319.   ------------  ------------------------  ------------------------  ----------
  320.   nj-oporadb02  glibc-devel(x86_64)-2.12-1.107.el6_4.4  glibc-devel(x86_64)-2.3.4  passed
  321.   nj-oporadb01  glibc-devel(x86_64)-2.12-1.107.el6_4.4  glibc-devel(x86_64)-2.3.4  passed
  322. Result: Package existence check passed for "glibc-devel(x86_64)"

  323. Check: Package existence for "glibc-headers"
  324.   Node Name     Available                 Required                  Status
  325.   ------------  ------------------------  ------------------------  ----------
  326.   nj-oporadb02  glibc-headers-2.12-1.107.el6_4.4  glibc-headers-2.3.4       passed
  327.   nj-oporadb01  glibc-headers-2.12-1.107.el6_4.4  glibc-headers-2.3.4       passed
  328. Result: Package existence check passed for "glibc-headers"

  329. Check: Package existence for "gcc-c++(x86_64)"
  330.   Node Name     Available                 Required                  Status
  331.   ------------  ------------------------  ------------------------  ----------
  332.   nj-oporadb02  gcc-c++(x86_64)-4.4.7-3.el6  gcc-c++(x86_64)-3.4.6     passed
  333.   nj-oporadb01  gcc-c++(x86_64)-4.4.7-3.el6  gcc-c++(x86_64)-3.4.6     passed
  334. Result: Package existence check passed for "gcc-c++(x86_64)"

  335. Check: Package existence for "libaio-devel(x86_64)"
  336.   Node Name     Available                 Required                  Status
  337.   ------------  ------------------------  ------------------------  ----------
  338.   nj-oporadb02  libaio-devel(x86_64)-0.3.107-10.el6  libaio-devel(x86_64)-0.3.105  passed
  339.   nj-oporadb01  libaio-devel(x86_64)-0.3.107-10.el6  libaio-devel(x86_64)-0.3.105  passed
  340. Result: Package existence check passed for "libaio-devel(x86_64)"

  341. Check: Package existence for "libgcc(x86_64)"
  342.   Node Name     Available                 Required                  Status
  343.   ------------  ------------------------  ------------------------  ----------
  344.   nj-oporadb02  libgcc(x86_64)-4.4.7-3.el6  libgcc(x86_64)-3.4.6      passed
  345.   nj-oporadb01  libgcc(x86_64)-4.4.7-3.el6  libgcc(x86_64)-3.4.6      passed
  346. Result: Package existence check passed for "libgcc(x86_64)"

  347. Check: Package existence for "libstdc++(x86_64)"
  348.   Node Name     Available                 Required                  Status
  349.   ------------  ------------------------  ------------------------  ----------
  350.   nj-oporadb02  libstdc++(x86_64)-4.4.7-3.el6  libstdc++(x86_64)-3.4.6   passed
  351.   nj-oporadb01  libstdc++(x86_64)-4.4.7-3.el6  libstdc++(x86_64)-3.4.6   passed
  352. Result: Package existence check passed for "libstdc++(x86_64)"

  353. Check: Package existence for "libstdc++-devel(x86_64)"
  354.   Node Name     Available                 Required                  Status
  355.   ------------  ------------------------  ------------------------  ----------
  356.   nj-oporadb02  libstdc++-devel(x86_64)-4.4.7-3.el6  libstdc++-devel(x86_64)-3.4.6  passed
  357.   nj-oporadb01  libstdc++-devel(x86_64)-4.4.7-3.el6  libstdc++-devel(x86_64)-3.4.6  passed
  358. Result: Package existence check passed for "libstdc++-devel(x86_64)"

  359. Check: Package existence for "sysstat"
  360.   Node Name     Available                 Required                  Status
  361.   ------------  ------------------------  ------------------------  ----------
  362.   nj-oporadb02  sysstat-9.0.4-20.el6      sysstat-5.0.5             passed
  363.   nj-oporadb01  sysstat-9.0.4-20.el6      sysstat-5.0.5             passed
  364. Result: Package existence check passed for "sysstat"

  365. Check: Package existence for "pdksh"
  366.   Node Name     Available                 Required                  Status
  367.   ------------  ------------------------  ------------------------  ----------
  368.   nj-oporadb02  missing                   pdksh-5.2.14              failed
  369.   nj-oporadb01  missing                   pdksh-5.2.14              failed
  370. Result: Package existence check failed for "pdksh"

  371. Check: Package existence for "expat(x86_64)"
  372.   Node Name     Available                 Required                  Status
  373.   ------------  ------------------------  ------------------------  ----------
  374.   nj-oporadb02  expat(x86_64)-2.0.1-11.el6_2  expat(x86_64)-1.95.7      passed
  375.   nj-oporadb01  expat(x86_64)-2.0.1-11.el6_2  expat(x86_64)-1.95.7      passed
  376. Result: Package existence check passed for "expat(x86_64)"

  377. Checking for multiple users with UID value 0
  378. Result: Check for multiple users with UID value 0 passed

  379. Check: Current group ID
  380. Result: Current group ID check passed

  381. Starting check for consistency of primary group of root user
  382.   Node Name                             Status
  383.   ------------------------------------  ------------------------
  384. nj-oporadb02                          passed
  385. nj-oporadb01                          passed

  386. Check for consistency of root user's primary group passed

  387. Starting Clock synchronization checks using Network Time Protocol(NTP)...

  388. NTP Configuration file check started...
  389. Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes
  390. No NTP Daemons or Services were found to be running

  391. Result: Clock synchronization check using Network Time Protocol(NTP) passed

  392. Checking Core file name pattern consistency...
  393. Core file name pattern consistency check passed.

  394. Checking to make sure user "grid" is not in "root" group
  395.   Node Name     Status                    Comment
  396.   ------------  ------------------------  ------------------------
  397.   nj-oporadb02  passed                    does not exist
  398.   nj-oporadb01  passed                    does not exist
  399. Result: User "grid" is not part of "root" group. Check passed

  400. Check default user file creation mask
  401.   Node Name     Available                 Required                  Comment
  402.   ------------  ------------------------  ------------------------  ----------
  403.   nj-oporadb02  0022                      0022                      passed
  404.   nj-oporadb01  0022                      0022                      passed
  405. Result: Default user file creation mask check passed
  406. Checking consistency of file "/etc/resolv.conf" across nodes

  407. Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined

  408. WARNING:
  409. PRVF-5640 : Both search and domain entries are present in file "/etc/resolv.conf" on the following nodes: nj-oporadb02,nj-oporadb01
  410. Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...
  411. domain entry in file "/etc/resolv.conf" is consistent across nodes
  412. Checking file "/etc/resolv.conf" to make sure that only one domain entry is defined
  413. All nodes have one domain entry defined in file "/etc/resolv.conf"
  414. Checking all nodes to make sure that domain is "ams.coresvcs.com" as found on node "nj-oporadb02"
  415. All nodes of the cluster have same value for 'domain'
  416. Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...
  417. search entry in file "/etc/resolv.conf" is consistent across nodes
  418. Checking file "/etc/resolv.conf" to make sure that only one search entry is defined
  419. All nodes have one search entry defined in file "/etc/resolv.conf"
  420. Checking all nodes to make sure that search entry is "ams.coresvcs.com" as found on node "nj-oporadb02"
  421. All nodes of the cluster have same value for 'search'
  422. Checking DNS response time for an unreachable node
  423.   Node Name                             Status
  424.   ------------------------------------  ------------------------
  425. nj-oporadb02                          passed
  426. nj-oporadb01                          passed
  427. The DNS response time for an unreachable node is within acceptable limit on all nodes

  428. File "/etc/resolv.conf" is consistent across nodes

  429. Check: Time zone consistency
  430. Result: Time zone consistency check passed

  431. Pre-check for cluster services setup was unsuccessful on all the nodes.
复制代码
Ifthe pre-check fails, execute the below command on each node as root
  1. /tmp/CVU_11.2.0.4.0_grid/runfixup.sh
复制代码
Untilget the below result,
  1. Pre-check for cluster services setup was successful.
复制代码
Theabove pre-check fails due to the package pdksh is not installed,butcustomerinstall ksh instead of pdksh, the issue can be ignored.


4.      Install GridInfrastructure
Loginone of the nodes as grid with xming,switch to the grid package folder and runthe install script,
  1. [[email protected] oracleinstall]#unzip p13390677_112040_Linux-x86-64_3of7.zip
  2. [[email protected] oracleinstall] cd grid
  3. [[email protected] grid]$ ./runInstaller
复制代码
1.       It will pop-upbelow screen:

1.       Choose theoption “Skip software updates” and click “Next”,

1.       Choose thefirst option “Install and Configure Oracle Grid Infrastructure for a Cluster”to install the Oracle GI on the both nodes and click “Next”

1.       Choose theoption “Advanced Installation” and click “Next”

1.       Set the faultsetting and click “Next”

1.      Input the Cluster Name,SCAN Name and SCAN port,the SCAN Nameshould be defined in the DNS  and can beresolved,


1.       Edite and addthe Public Hostname and Virtual Hostname,which are defined above,

1.       Choose eth2 asthe private network and Bond0 as the Public Network,

1.      Choose the option “Oracle Automatic Storage Management(OracleASM)” to configure OCR and voting disk files on Oracle ASM storage,

1.       Choose ExternalRedundancy and above disks as OCR disk group,

1.       Use the samepassword for  ASM system Accounts, ignorethe warning,

ClickYes to ignore the issue,

1.       Use the defaultsetting,

1.       Set the OSASMand OSDBA group as dba,


1.       Ignore theabove problem and click Yes,


1.       Input the Gridbase and HOME location,make sure the directories exist,


1.       Prerequistitechecks before installation


1.      Fix the problems listed above if exist,the issue above here can beignored,Choose the “Ignore All” option and click “Next”,


Ignorethe issue and click Yes to continue,

1.       Theinstallation summary will be listed above, make sure there is no red mark part,if exist,fix it then click install,

Installprocess


1.       Run the abovescripts on each node as root ,first on node 1 and the node 2
Execute the script:
  1. [[email protected] ~]# /u01/app/11.2.0/grid/root.sh
  2. Performing root user operation for Oracle 11g

  3. The following environment variables are set as:
  4.     ORACLE_OWNER= grid
  5.     ORACLE_HOME=  /u01/app/11.2.0/grid

  6. Enter the full pathname of the local bin directory: [/usr/local/bin]:
  7. The contents of "dbhome" have not changed. No need to overwrite.
  8. The contents of "oraenv" have not changed. No need to overwrite.
  9. The contents of "coraenv" have not changed. No need to overwrite.

  10. Entries will be added to the /etc/oratab file as needed by
  11. Database Configuration Assistant when a database is created
  12. Finished running generic part of root script.
  13. Now product-specific root actions will be performed.
  14. Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
  15. User ignored Prerequisites during installation
  16. Installing Trace File Analyzer
  17. OLR initialization - successful
  18. Adding Clusterware entries to upstart
  19. CRS-2672: Attempting to start 'ora.mdnsd' on 'nj-oporadb01'
  20. CRS-2676: Start of 'ora.mdnsd' on 'nj-oporadb01' succeeded
  21. CRS-2672: Attempting to start 'ora.gpnpd' on 'nj-oporadb01'
  22. CRS-2676: Start of 'ora.gpnpd' on 'nj-oporadb01' succeeded
  23. CRS-2672: Attempting to start 'ora.cssdmonitor' on 'nj-oporadb01'
  24. CRS-2672: Attempting to start 'ora.gipcd' on 'nj-oporadb01'
  25. CRS-2676: Start of 'ora.cssdmonitor' on 'nj-oporadb01' succeeded
  26. CRS-2676: Start of 'ora.gipcd' on 'nj-oporadb01' succeeded
  27. CRS-2672: Attempting to start 'ora.cssd' on 'nj-oporadb01'
  28. CRS-2672: Attempting to start 'ora.diskmon' on 'nj-oporadb01'
  29. CRS-2676: Start of 'ora.diskmon' on 'nj-oporadb01' succeeded
  30. CRS-2676: Start of 'ora.cssd' on 'nj-oporadb01' succeeded

  31. ASM created and started successfully.

  32. Disk Group OCR created successfully.

  33. clscfg: -install mode specified
  34. Successfully accumulated necessary OCR keys.
  35. Creating OCR keys for user 'root', privgrp 'root'..
  36. Operation successful.
  37. Successful addition of voting disk 23234b0741a24f67bff765bddb648316.
  38. Successfully replaced voting disk group with +OCR.
  39. CRS-4266: Voting file(s) successfully replaced
  40. ##  STATE    File Universal Id                File Name Disk group
  41. --  -----    -----------------                --------- ---------
  42. 1. ONLINE   23234b0741a24f67bff765bddb648316 (ORCL:ASM_DISK27) [OCR]
  43. Located 1 voting disk(s).
  44. CRS-2672: Attempting to start 'ora.asm' on 'nj-oporadb01'
  45. CRS-2676: Start of 'ora.asm' on 'nj-oporadb01' succeeded
  46. CRS-2672: Attempting to start 'ora.OCR.dg' on 'nj-oporadb01'
  47. CRS-2676: Start of 'ora.OCR.dg' on 'nj-oporadb01' succeeded
  48. Preparing packages for installation...
  49. cvuqdisk-1.0.9-1
  50. Configure Oracle Grid Infrastructure for a Cluster ... succeeded

  51. [[email protected] ~]# /u01/app/11.2.0/grid/root.sh
  52. Performing root user operation for Oracle 11g

  53. The following environment variables are set as:
  54.     ORACLE_OWNER= grid
  55.     ORACLE_HOME=  /u01/app/11.2.0/grid

  56. Enter the full pathname of the local bin directory: [/usr/local/bin]:
  57. The contents of "dbhome" have not changed. No need to overwrite.
  58. The contents of "oraenv" have not changed. No need to overwrite.
  59. The contents of "coraenv" have not changed. No need to overwrite.

  60. Entries will be added to the /etc/oratab file as needed by
  61. Database Configuration Assistant when a database is created
  62. Finished running generic part of root script.
  63. Now product-specific root actions will be performed.
  64. Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
  65. User ignored Prerequisites during installation
  66. Installing Trace File Analyzer
  67. OLR initialization - successful
  68. Adding Clusterware entries to upstart
  69. CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node nj-oporadb01, number 1, and is terminating
  70. An active cluster was found during exclusive startup, restarting to join the cluster
  71. Preparing packages for installation...
  72. cvuqdisk-1.0.9-1
  73. Configure Oracle Grid Infrastructure for a Cluster ... succeeded
复制代码
Notice
It may fail to be executed on node2 likebelow,the reason should be the firewall is not disabled,refer to ID1103313.1,
  1. Timed out waiting for the CRS stack to start.
复制代码
Disablethe firewall on linux as root
  1. /sbin/chkconfig iptables off

  2. /sbin/chkconfig --list iptables
  3. iptables        0:off   1:off   2:off   3:off   4:off   5:off   6:off

  4. /sbin/lsmod |grep ip_tables
  5. ip_tables        17029  1 iptable_filter
  6. x_tables        17349  5 ipt_REJECT,xt_state,ip_tables,xt_physdev,xt_tcpudp

  7. /sbin/service iptables stop
  8. Flushing firewall rules:                  [  OK  ]
  9. Setting chains to policy ACCEPT: filter   [  OK  ]
  10. Unloading iptables modules:               [  OK  ]

  11. /sbin/lsmod |grep ip_tables
复制代码
Problem
Duringrun the script for the first time, we encountered below problems:
Itfailed with below error on node 1 when execute the script
  1. Errors in file :
  2. ORA-27091: unable to queue I/O
  3. ORA-15081: failed to submit an I/O operation to a disk
  4. ORA-06512: at line 4
  5. Errors in file :
  6. ORA-27091: unable to queue I/O
  7. ORA-15081: failed to submit an I/O operation to a disk
  8. ORA-06512: at line 4
  9. Failed to create Oracle Cluster Registry configuration, rc 255
复制代码
Fix problem

Thenrun the following commands on node 1 as root to reconfig CRS,
1.      1) /u01/app/11.2.0/grid/crs/install/rootcrs.pl -deconfig –force
2.      2) /usr/sbin/oracleasm deletedisk ASM_DISK26 --ASM_DISK30 which areused for OCR disk group
3.      3)Re-configureASMlib driver to use the correct userid grid
  1. /usr/sbin/oracleasm configure -u grid
  2. /usr/sbin/oracleasm configure
复制代码
4.      4) stop/start ASMlib
  1. /usr/sbin/oracleasm exit
  2. /usr/sbin/oracleasm init
  3. /usr/sbin/oracleasm scandisks
复制代码
5.     5)  Create theASMlib disks again used for Grid Infrastructure installation
  1. /usr/sbin/oracleasm deletedisk ASM_DISK26
  2. /usr/sbin/oracleasm deletedisk ASM_DISK27
  3. /usr/sbin/oracleasm deletedisk ASM_DISK28
  4. /usr/sbin/oracleasm deletedisk ASM_DISK29
  5. /usr/sbin/oracleasm deletedisk ASM_DISK30
复制代码
6.      6) run the scandisks again on all nodes
  1. /usr/sbin/oracleasm scandisks
复制代码
7.      7)  Re-run 'root.sh' and it succeeded on node 1, but it failed to run the scriptwith below error
  1. CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node nj-oporadb02, number 1, and is terminating
  2. An active cluster was found during exclusive startup, restarting to join the cluster
  3. Oracle Grid Infrastructure stack start initiated but failed to complete at /u01/app/11.2.0/grid/crs/install/crsconfig_lib.pm line 11814.
  4. /u01/app/11.2.0/grid/perl/bin/perl -I/u01/app/11.2.0/grid/perl/lib -I/u01/app/11.2.0/grid/crs/install /u01/app/11.2.0/grid/crs/install/rootcrs.pl execution failed
复制代码
SoI tried to re-configure CRS on both nodes as following steps and it succeeded.
Once the script executes complete,reutrn to the OUI and click OK tocomplete the rest steps,


Notice, it may encounter below error when the SCAN is not added into DNS,

The errors  like below will be found in the alert log:
  1. INFO: Checking name resolution setup for "oporadb-scan.ams.coresvcs.com"...
  2. INFO: ERROR:
  3. INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name "oporadb-scan.ams.coresvcs.com"
  4. INFO: ERROR:
  5. INFO: PRVF-4657 : Name resolution setup check for "oporadb-scan.ams.coresvcs.com" (IP address:10.65.201.120) failed
  6. INFO: ERROR:
  7. INFO: PRVF-4664 : Found inconsistent name resolution entries for SCAN name "oporadb-scan.ams.coresvcs.com"
  8. INFO: Verification of SCAN VIP and Listener setup failed
复制代码
Cause
Thereason is SCAN is not added into DNS , just write it into hosts file, the errorcan be ignored,refer to
PRVF-4664 PRVF-4657: Found inconsistent name resolution entries for SCANname [ID 887471.1]

Click ok to continue,

Click close,finish the grid installation。

Ensure the grid installation succeed
Executethe below command  as grid on both nodes:
  1. [[email protected] ~]$ crs_stat -t
  2. Name           Type           Target    State     Host
  3. ------------------------------------------------------------
  4. ora....ER.lsnr ora....er.type ONLINE    ONLINE    nj-o...db01
  5. ora....N1.lsnr ora....er.type ONLINE    ONLINE    nj-o...db02
  6. ora....N2.lsnr ora....er.type ONLINE    ONLINE    nj-o...db01
  7. ora....N3.lsnr ora....er.type ONLINE    ONLINE    nj-o...db01
  8. ora.OCR.dg     ora....up.type ONLINE    ONLINE    nj-o...db01
  9. ora.asm        ora.asm.type   ONLINE    ONLINE    nj-o...db01
  10. ora.cvu        ora.cvu.type   ONLINE    ONLINE    nj-o...db01
  11. ora.gsd        ora.gsd.type   OFFLINE   OFFLINE
  12. ora....network ora....rk.type ONLINE    ONLINE    nj-o...db01
  13. ora....SM1.asm application    ONLINE    ONLINE    nj-o...db01
  14. ora....01.lsnr application    ONLINE    ONLINE    nj-o...db01
  15. ora....b01.gsd application    OFFLINE   OFFLINE
  16. ora....b01.ons application    ONLINE    ONLINE    nj-o...db01
  17. ora....b01.vip ora....t1.type ONLINE    ONLINE    nj-o...db01
  18. ora....SM2.asm application    ONLINE    ONLINE    nj-o...db02
  19. ora....02.lsnr application    ONLINE    ONLINE    nj-o...db02
  20. ora....b02.gsd application    OFFLINE   OFFLINE
  21. ora....b02.ons application    ONLINE    ONLINE    nj-o...db02
  22. ora....b02.vip ora....t1.type ONLINE    ONLINE    nj-o...db02
  23. ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    nj-o...db01
  24. ora.ons        ora.ons.type   ONLINE    ONLINE    nj-o...db01
  25. ora....ry.acfs ora....fs.type ONLINE    ONLINE    nj-o...db01
  26. ora.scan1.vip  ora....ip.type ONLINE    ONLINE    nj-o...db02
  27. ora.scan2.vip  ora....ip.type ONLINE    ONLINE    nj-o...db01
  28. ora.scan3.vip  ora....ip.type ONLINE    ONLINE    nj-o...db01

  29. [[email protected] ~]$ crs_stat -t
  30. Name           Type           Target    State     Host
  31. ------------------------------------------------------------
  32. ora....ER.lsnr ora....er.type ONLINE    ONLINE    nj-o...db01
  33. ora....N1.lsnr ora....er.type ONLINE    ONLINE    nj-o...db02
  34. ora....N2.lsnr ora....er.type ONLINE    ONLINE    nj-o...db01
  35. ora....N3.lsnr ora....er.type ONLINE    ONLINE    nj-o...db01
  36. ora.OCR.dg     ora....up.type ONLINE    ONLINE    nj-o...db01
  37. ora.asm        ora.asm.type   ONLINE    ONLINE    nj-o...db01
  38. ora.cvu        ora.cvu.type   ONLINE    ONLINE    nj-o...db01
  39. ora.gsd        ora.gsd.type   OFFLINE   OFFLINE
  40. ora....network ora....rk.type ONLINE    ONLINE    nj-o...db01
  41. ora....SM1.asm application    ONLINE    ONLINE    nj-o...db01
  42. ora....01.lsnr application    ONLINE    ONLINE    nj-o...db01
  43. ora....b01.gsd application    OFFLINE   OFFLINE
  44. ora....b01.ons application    ONLINE    ONLINE    nj-o...db01
  45. ora....b01.vip ora....t1.type ONLINE    ONLINE    nj-o...db01
  46. ora....SM2.asm application    ONLINE    ONLINE    nj-o...db02
  47. ora....02.lsnr application    ONLINE    ONLINE    nj-o...db02
  48. ora....b02.gsd application    OFFLINE   OFFLINE
  49. ora....b02.ons application    ONLINE    ONLINE    nj-o...db02
  50. ora....b02.vip ora....t1.type ONLINE    ONLINE    nj-o...db02
  51. ora.oc4j       ora.oc4j.type  ONLINE    ONLINE    nj-o...db01
  52. ora.ons        ora.ons.type   ONLINE    ONLINE    nj-o...db01
  53. ora....ry.acfs ora....fs.type ONLINE    ONLINE    nj-o...db01
  54. ora.scan1.vip  ora....ip.type ONLINE    ONLINE    nj-o...db02
  55. ora.scan2.vip  ora....ip.type ONLINE    ONLINE    nj-o...db01
  56. ora.scan3.vip  ora....ip.type ONLINE    ONLINE    nj-o...db01
复制代码

本帖子中包含更多资源

您需要 登录 才可以下载或查看,没有帐号?立即注册

回复

使用道具 举报

44

主题

1

好友

849

积分

高级会员

Rank: 4

发表于 2013-11-29 11:55:27 |显示全部楼层
good ,,,好用心
自己路自己走~~~
------- linux + oracle -----
回复

使用道具 举报

29

主题

0

好友

462

积分

版主

Rank: 7Rank: 7Rank: 7

发表于 2013-11-30 09:15:17 |显示全部楼层
very good guy, rhel6.x asmlib packages fixed at 30-Apr-2013!!!
回复

使用道具 举报

1

主题

0

好友

70

积分

版主

Rank: 7Rank: 7Rank: 7

发表于 2014-12-11 14:46:49 |显示全部楼层
顶下多多
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

QQ|手机版|DB Support 技术联盟 ( 粤ICP备13057501号-1 )

GMT+8, 2018-1-22 20:03 , Processed in 0.157326 second(s), 21 queries .

Powered by Discuz! X2.5

© 2001-2012 Comsenz Inc.

回顶部