| OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #463796] |
Sat, 03 July 2010 14:02  |
DBA_SangramKeshari
Messages: 44
Registered: October 2009
Location: Mumbai
|
Member |
|
|
Hello ,
I was installing Clusterware 11gR1(11.1.0.6) on Oracle Enterprise linux 5.4. The install didn't completed successfully.
was having no issues for user uqivalenece checking,rpm installation both cluvfy checks were successfull prior to installation.
Something went wrong at the time of Configuration Assistant was running and failed while ons config was running.
--crs_stat utility permissions
oracle@oel54ora11gr1rac1[/email] bin]$ pwd
/u01/crs/oracle/product/11.1.0/crs/bin
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_unregister
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_stop
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_stat
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_start
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_relocate
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_register
-r-xr-x--x 1 root oinstall 2388 Jul 3 21:33 crs_profile
[oracle@oel54ora11gr1rac1[/email] bin]$ ./crs_stat -t
CRS-0202: No resources are registered.
[oracle@oel54ora11gr1rac1[/email] bin]$ ./srvctl start nodeapps -n oel54ora11gr1rac1
PRKO-2006 : Invalid node name: oel54ora11gr1rac1
[oracle@oel54ora11gr1rac1[/email] ~]$ ./crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
[oracle@oel54ora11gr1rac2[/email] bin]$ ./crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.
I am unable to debug and no clue how to fix it. Please feel free to share your idea and experiece to correct.
My concern id how to start and stop my crs resources.
Regards,
Sangram
[Updated on: Sat, 03 July 2010 14:06] Report message to a moderator |
|
|
|
|
|
|
|
| Re: OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #464106 is a reply to message #463828] |
Tue, 06 July 2010 05:12  |
DBA_SangramKeshari
Messages: 44
Registered: October 2009
Location: Mumbai
|
Member |
|
|
Even I tried with #crsctl stop crs then, cleaning up four crs related file in /etc/init.d then ocrInfo.loc , formatted the ocr disk using dd command, the rebuild ocr using root.sh
I am frustrated now, OCR is again corrupt. This is know bug. But how to fix as the version is 11.1.0.6
|
|
|
|
| Re: OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #464129 is a reply to message #463796] |
Tue, 06 July 2010 07:13 |
mkounalis
Messages: 147
Registered: October 2009
Location: Dallas, TX
|
Senior Member |
|
|
Are you sure you have lun equivalency across your nodes? How do you know that your OCR is corrupt? Did you uninstall the entire 'crs stack and reinstall? Simply cleaning and reformatting the OCR and voting disks and the re-running root.sh isn't the best idea. Sounds to me like you have luns that are mapped differently on each of the nodes. Re-check you shared lun configuration. What makes you think this is a known bug? Do you have a sr open with oracle?
[Updated on: Tue, 06 July 2010 07:14] Report message to a moderator |
|
|
|
| Re: OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #464130 is a reply to message #464129] |
Tue, 06 July 2010 07:31 |
DBA_SangramKeshari
Messages: 44
Registered: October 2009
Location: Mumbai
|
Member |
|
|
To rebuild ocr i follow the below steps.
-------------------------------------------------
rm -rf /etc/oracle /etc/oratab /etc/oraInst.loc
cd /etc/init.d
rm init.evmd init.cssd init.crsd init.crs
cd /etc/init.d
ls -ltr init.evmd init.cssd init.crsd init.crs
cd /u01/crs/oracle/product/11.1.0/crs/
ls -ltr root.sh
sh root.sh
-------------------------------------------------
[root@oel54ora11gr1rac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 2096108
Used space (kbytes) : 1968
Available space (kbytes) : 2094140
ID : 620591252
Device/File Name : /u01/DISKS/OCR1
Device/File integrity check succeeded
Device/File Name : /u01/DISKS/OCR2
Device/File integrity check succeeded
Cluster registry integrity check succeeded
[root@oel54ora11gr1rac1 bin]# ./crsctl query css votedisk
0. 0 /u01/DISKS/VD1
1. 0 /u01/DISKS/VD2
Located 2 voting disk(s).
[root@oel54ora11gr1rac1 bin]#
[root@oel54ora11gr1rac1 bin]# su - oracle
[oracle@oel54ora11gr1rac1 ~]$ crsctl query css votedisk
0. 0 /u01/DISKS/VD1
1. 0 /u01/DISKS/VD2
Located 2 voting disk(s).
[oracle@oel54ora11gr1rac1 ~]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 2096108
Used space (kbytes) : 1968
Available space (kbytes) : 2094140
ID : 620591252
Device/File Name : /u01/DISKS/OCR1
Device/File integrity check succeeded
Device/File Name : /u01/DISKS/OCR2
Device/File integrity check succeeded
Cluster registry integrity check succeeded
[oracle@oel54ora11gr1rac2 ~]$ crsctl query css votedisk
Oracle Cluster Registry initialization failed accessing Oracle Cluster Registry device: PROC-26: Error while accessing the physical storage
[oracle@oel54ora11gr1rac2 ~]$ ocrcheck
PROT-602: Failed to retrieve data from the cluster registry
Regards,
SangyD
|
|
|
|
|
|
|
|
|
|
| Re: OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #464138 is a reply to message #464136] |
Tue, 06 July 2010 07:44 |
mkounalis
Messages: 147
Registered: October 2009
Location: Dallas, TX
|
Senior Member |
|
|
|
Did you follow the oracle installation guide? Lun equivalency is important - your OCR on node one might be a voting disk on node two ... it's not a single command it's a big part of preparing the nodes before install. Try cleaning up and then starting only one node. If it works, start another node. If it gets corrupted then probably luns are not configured correctly. Full install guides are available at docs.oracle.com.
|
|
|
|
|
|
| Re: OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #464144 is a reply to message #463796] |
Tue, 06 July 2010 08:11 |
DBA_SangramKeshari
Messages: 44
Registered: October 2009
Location: Mumbai
|
Member |
|
|
I have already installed 10 RACR2 manytime on RHEL4 but this the first time i am installing 11g R1 RAC on OEL 5.4.
please see below if could find any discrepencies, I am unable to find any...
[oracle@oel54ora11gr1rac1 ~]$ cd /u01/DISKS
[oracle@oel54ora11gr1rac1 DISKS]$ ls -ltr
total 0
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VD2 -> /dev/sdj1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VD1 -> /dev/sdi1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCRBKP2 -> /dev/sde1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCRBKP1 -> /dev/sdd1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCR2 -> /dev/sdc1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCR1 -> /dev/sdb1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VDBKP2 -> /dev/sdl1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VDBKP1 -> /dev/sdk1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 BLANK2 -> /dev/sdn1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 BLANK1 -> /dev/sdm1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 ASMDISK3 -> /dev/sdh1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 ASMDISK2 -> /dev/sdg1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 ASMDISK1 -> /dev/sdf1
[oracle@oel54ora11gr1rac1 DISKS]$ ls -ltr /dev/sd* |grep oracle
brw-rw---- 1 oracle oinstall 8, 65 Jul 6 16:16 /dev/sde1
brw-rw---- 1 oracle oinstall 8, 81 Jul 6 16:16 /dev/sdf1
brw-rw---- 1 oracle oinstall 8, 49 Jul 6 16:16 /dev/sdd1
brw-rw---- 1 oracle oinstall 8, 97 Jul 6 16:16 /dev/sdg1
brw-rw---- 1 oracle oinstall 8, 113 Jul 6 16:16 /dev/sdh1
brw-rw---- 1 oracle oinstall 8, 193 Jul 6 16:16 /dev/sdm1
brw-rw---- 1 oracle oinstall 8, 161 Jul 6 16:16 /dev/sdk1
brw-rw---- 1 oracle oinstall 8, 177 Jul 6 16:16 /dev/sdl1
brw-rw---- 1 oracle oinstall 8, 209 Jul 6 16:16 /dev/sdn1
brw-rw---- 1 oracle oinstall 8, 33 Jul 6 17:58 /dev/sdc1
brw-r----- 1 oracle oinstall 8, 129 Jul 6 18:36 /dev/sdi1
brw-r----- 1 oracle oinstall 8, 145 Jul 6 18:36 /dev/sdj1
[oracle@oel54ora11gr1rac2 ~]$ cd /u01/DISKS
[oracle@oel54ora11gr1rac2 DISKS]$ ls -ltr
total 0
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCRBKP2 -> /dev/sde1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCRBKP1 -> /dev/sdd1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCR2 -> /dev/sdc1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 OCR1 -> /dev/sdb1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VDBKP2 -> /dev/sdl1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VDBKP1 -> /dev/sdk1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VD2 -> /dev/sdj1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 VD1 -> /dev/sdi1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 BLANK2 -> /dev/sdn1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 BLANK1 -> /dev/sdm1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 ASMDISK2 -> /dev/sdg1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 ASMDISK1 -> /dev/sdf1
lrwxrwxrwx 1 oracle oinstall 9 Jul 1 00:24 ASMDISK3 -> /dev/sdh1
[oracle@oel54ora11gr1rac2 DISKS]$ ls -ltr /dev/sd* |grep oracle
brw-rw---- 1 oracle oinstall 8, 33 Jul 6 16:16 /dev/sdc1
brw-rw---- 1 oracle oinstall 8, 49 Jul 6 16:16 /dev/sdd1
brw-rw---- 1 oracle oinstall 8, 81 Jul 6 16:16 /dev/sdf1
brw-rw---- 1 oracle oinstall 8, 97 Jul 6 16:16 /dev/sdg1
brw-rw---- 1 oracle oinstall 8, 65 Jul 6 16:16 /dev/sde1
brw-rw---- 1 oracle oinstall 8, 113 Jul 6 16:16 /dev/sdh1
brw-rw---- 1 oracle oinstall 8, 161 Jul 6 16:16 /dev/sdk1
brw-rw---- 1 oracle oinstall 8, 177 Jul 6 16:16 /dev/sdl1
brw-rw---- 1 oracle oinstall 8, 193 Jul 6 16:16 /dev/sdm1
brw-rw---- 1 oracle oinstall 8, 209 Jul 6 16:16 /dev/sdn1
brw-rw---- 1 oracle oinstall 8, 145 Jul 6 17:37 /dev/sdj1
brw-r----- 1 oracle oinstall 8, 129 Jul 6 18:37 /dev/sdi1
Regards,
SangyD
|
|
|
|
| Re: OEL 5.4, Clusterware 11g R1 (11.1.0.6) [message #464151 is a reply to message #464144] |
Tue, 06 July 2010 08:31 |
mkounalis
Messages: 147
Registered: October 2009
Location: Dallas, TX
|
Senior Member |
|
|
|
Again - you need to follow the install docs. The output above doesn't prove or disprove lun equivalency. Please get with your sysadmin or storage administrator to confirm luns are the same on both nodes. This forum isn't a replacement for oracle support - you should probably open up a ticket with oracle as you are running oracle enterprise Linux as well. And for what it's worth, your device permissions are wrong - I don't know how many times I need to tell you to follow the docs.
|
|
|
|
|
|
|
|
|
|
|
|
] 
Search
Help
Members
Register
Login
Home
