Recently we were Installing two node Oracle 12c RAC, on first node the installation completed successfully. But while running “root.sh” on next node it completed with the following error.
[root@racnode3 tmp]# /u01/grid/root.sh Performing root user operation for Oracle 12c The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/grid/crs/install/crsconfig_params 2016/10/30 18:37:00 CLSRSC-363: User ignored prerequisites during installation OLR initialization - successful d2016/10/30 18:38:08 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.conf' CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Oracle High Availability Services has been started. CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'racnode3' CRS-2672: Attempting to start 'ora.evmd' on 'racnode3' CRS-2676: Start of 'ora.mdnsd' on 'racnode3' succeeded CRS-2676: Start of 'ora.evmd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'racnode3' CRS-2676: Start of 'ora.gpnpd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'racnode3' CRS-2676: Start of 'ora.gipcd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'racnode3' CRS-2676: Start of 'ora.cssdmonitor' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'racnode3' CRS-2672: Attempting to start 'ora.diskmon' on 'racnode3' CRS-2676: Start of 'ora.diskmon' on 'racnode3' succeeded CRS-2789: Cannot stop resource 'ora.diskmon' as it is not running on server 'racnode3' CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start. CRS-4406: Oracle High Availability Services synchronous start failed. CRS-4000: Command Start failed, or completed with errors. 2016/10/30 18:50:21 CLSRSC-117: Failed to start Oracle Clusterware stack Died at /u01/grid/crs/install/crsinstall.pm line 941. The command '/u01/grid/perl/bin/perl -I/u01/grid/perl/lib -I/u01/grid/crs/install /u01/grid/crs/install/rootcrs.pl ' execution failed [root@racnode3 tmp]# /u01/grid/perl/bin/perl -I/u01/grid/perl/lib -I/u01/grid/crs/install /u01/grid/crs/install/rootcrs.pl Using configuration parameter file: /u01/grid/crs/install/crsconfig_params 2016/10/31 12:01:26 CLSRSC-363: User ignored prerequisites during installation CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'racnode3' CRS-2673: Attempting to stop 'ora.gpnpd' on 'racnode3' CRS-2673: Attempting to stop 'ora.evmd' on 'racnode3' CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'racnode3' CRS-2673: Attempting to stop 'ora.mdnsd' on 'racnode3' CRS-2673: Attempting to stop 'ora.gipcd' on 'racnode3' CRS-2677: Stop of 'ora.cssdmonitor' on 'racnode3' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'racnode3' succeeded CRS-2677: Stop of 'ora.mdnsd' on 'racnode3' succeeded CRS-2677: Stop of 'ora.gipcd' on 'racnode3' succeeded CRS-2677: Stop of 'ora.evmd' on 'racnode3' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'racnode3' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'racnode3' CRS-2672: Attempting to start 'ora.evmd' on 'racnode3' CRS-2676: Start of 'ora.evmd' on 'racnode3' succeeded CRS-2676: Start of 'ora.mdnsd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'racnode3' CRS-2676: Start of 'ora.gpnpd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'racnode3' CRS-2676: Start of 'ora.gipcd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'racnode3' CRS-2676: Start of 'ora.cssdmonitor' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'racnode3' CRS-2672: Attempting to start 'ora.diskmon' on 'racnode3' CRS-2676: Start of 'ora.diskmon' on 'racnode3' succeeded CRS-2789: Cannot stop resource 'ora.diskmon' as it is not running on server 'racnode3' CRS-2883: Resource 'ora.cssdmonitor' failed during Clusterware stack start. CRS-4406: Oracle High Availability Services synchronous start failed. CRS-4000: Command Start failed, or completed with errors. 2016/10/31 12:13:09 CLSRSC-117: Failed to start Oracle Clusterware stack Died at /u01/grid/crs/install/crsinstall.pm line 941. [root@racnode3 tmp]#
Solution:
Reboot the node on which “root.sh” script is failing then Execute root.sh again and it should complete successfully.
[root@racnode3 tmp]# /u01/grid/root.sh The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/grid Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite. Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/grid/crs/install/crsconfig_params 2016/10/31 13:07:32 CLSRSC-363: User ignored prerequisites during installation CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'racnode3' CRS-2673: Attempting to stop 'ora.crsd' on 'racnode3' CRS-2677: Stop of 'ora.crsd' on 'racnode3' succeeded CRS-2673: Attempting to stop 'ora.ctssd' on 'racnode3' CRS-2673: Attempting to stop 'ora.mdnsd' on 'racnode3' CRS-2673: Attempting to stop 'ora.gpnpd' on 'racnode3' CRS-2677: Stop of 'ora.mdnsd' on 'racnode3' succeeded CRS-2677: Stop of 'ora.gpnpd' on 'racnode3' succeeded CRS-2677: Stop of 'ora.ctssd' on 'racnode3' succeeded CRS-2673: Attempting to stop 'ora.evmd' on 'racnode3' CRS-2673: Attempting to stop 'ora.storage' on 'racnode3' CRS-2677: Stop of 'ora.storage' on 'racnode3' succeeded CRS-2673: Attempting to stop 'ora.asm' on 'racnode3' CRS-2677: Stop of 'ora.evmd' on 'racnode3' succeeded CRS-2677: Stop of 'ora.asm' on 'racnode3' succeeded CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'racnode3' CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'racnode3' succeeded CRS-2673: Attempting to stop 'ora.cssd' on 'racnode3' CRS-2677: Stop of 'ora.cssd' on 'racnode3' succeeded CRS-2673: Attempting to stop 'ora.gipcd' on 'racnode3' CRS-2677: Stop of 'ora.gipcd' on 'racnode3' succeeded CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'racnode3' has completed CRS-4133: Oracle High Availability Services has been stopped. CRS-4123: Starting Oracle High Availability Services-managed resources CRS-2672: Attempting to start 'ora.mdnsd' on 'racnode3' CRS-2672: Attempting to start 'ora.evmd' on 'racnode3' CRS-2676: Start of 'ora.evmd' on 'racnode3' succeeded CRS-2676: Start of 'ora.mdnsd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'racnode3' CRS-2676: Start of 'ora.gpnpd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.gipcd' on 'racnode3' CRS-2676: Start of 'ora.gipcd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'racnode3' CRS-2676: Start of 'ora.cssdmonitor' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'racnode3' CRS-2672: Attempting to start 'ora.diskmon' on 'racnode3' CRS-2676: Start of 'ora.diskmon' on 'racnode3' succeeded CRS-2789: Cannot stop resource 'ora.diskmon' as it is not running on server 'racnode3' CRS-2676: Start of 'ora.cssd' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'racnode3' CRS-2672: Attempting to start 'ora.ctssd' on 'racnode3' CRS-2676: Start of 'ora.ctssd' on 'racnode3' succeeded CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.asm' on 'racnode3' CRS-2676: Start of 'ora.asm' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.storage' on 'racnode3' CRS-2676: Start of 'ora.storage' on 'racnode3' succeeded CRS-2672: Attempting to start 'ora.crsd' on 'racnode3' CRS-2676: Start of 'ora.crsd' on 'racnode3' succeeded CRS-6017: Processing resource auto-start for servers: racnode3 CRS-2672: Attempting to start 'ora.ons' on 'racnode3' CRS-2676: Start of 'ora.ons' on 'racnode3' succeeded CRS-6016: Resource auto-start has completed for server racnode3 CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources CRS-4123: Oracle High Availability Services has been started. 2016/10/31 13:09:59 CLSRSC-343: Successfully started Oracle clusterware stack 2016/10/31 13:10:16 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded [root@racnode3 Desktop]#
thanks,
X A H E E R