Moving OCR and VOTING to Normal Redundancy Diskgroup on NFS Systems

1. NFS Volumes:

We assume that the NFS Volumes were already defined on all RAC nodes. If we check the fstab:

[root]# cat /etc/fstab
...
...
10.6.20.210:/ora_dev_ocr1 /nfsshared/ocr1 nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
10.6.20.210:/ora_dev_ocr2 /nfsshared/ocr2 nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
10.6.20.210:/ora_dev_ocr3 /nfsshared/ocr3 nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
...
...

2. Create disks manually:

Create the asm disks manually with the grid user as follows:

[grid]$ dd if=/dev/zero of=/nfsshared/ocr1/asm_dsk1 bs=1k count=3000000

3000000+0 records in
3000000+0 records out
3072000000 bytes (3.1 GB) copied, 9.26293 s, 332 MB/s

[grid]$ dd if=/dev/zero of=/nfsshared/ocr2/asm_dsk2 bs=1k count=3000000

3000000+0 records in
3000000+0 records out
3072000000 bytes (3.1 GB) copied, 9.53304 s, 322 MB/s

[grid]$ dd if=/dev/zero of=/nfsshared/ocr3/asm_dsk3 bs=1k count=3000000

3000000+0 records in
3000000+0 records out
3072000000 bytes (3.1 GB) copied, 8.88837 s, 346 MB/s

3. Create the diskgroup with normal redundancy as follows:

First, change the asm_diskstring to be able to find the disks, then create the diskgroup.

SQL> alter system set asm_diskstring='/nfsshared/data', '/nfsshared/ocr1/*', '/nfsshared/ocr2/*', '/nfsshared/ocr3/*';

SQL> CREATE DISKGROUP OCRVOTING NORMAL REDUNDANCY DISK '/nfsshared/ocr1/asm_dsk1','/nfsshared/ocr2/asm_dsk2','/nfsshared/ocr3/asm_dsk3';

>> On the other nodes of the RAC, you have to mount this newly created diskgroup:

SQL> ALTER DISKGROUP OCRVOTING MOUNT;

Diskgroup altered.

>> Check

ASMCMD [+] > lsdg
State Type Rebal Sector Logical_Sector Block AU Total_MB Free_MB Req_mir_free_MB Usable_file_MB Offline_disks Voting_files Name
...
....
MOUNTED NORMAL N 512 512 4096 1048576 8787 8502 2929 2786 0 N OCRVOTING/

4. Move the OCR to the newly defined disk group

[root]# $GRID_HOME/bin/ocrconfig -add +OCRVOTING
[root]# $GRID_HOME/bin/ocrconfig -delete +OCRVFDG

5. Move the voting disk to the newly defined disk group

[root]# $GRID_HOME/bin/crsctl replace votedisk +OCRVOTING

Successful addition of voting disk 82b834d5991e4fbdbf248129392ace71.
Successful addition of voting disk f21f2368ef994f35bf44fb3ba50ef203.
Successful addition of voting disk a8243f5d0d2a4f4dbf5076f0f189422b.
Successful deletion of voting disk b892966f9cfd4f5fbfcd711dac50c2b7.
Successfully replaced voting disk group with +OCRVOTING.
CRS-4266: Voting file(s) successfully replaced

6. Check

[grid]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     409568
         Used space (kbytes)      :       2240
         Available space (kbytes) :     407328
         ID                       : 1344843047
         Device/File Name         : +OCRVOTING
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check bypassed due to non-privileged user




[grid@]$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   82b834d5991e4fbdbf248129392ace71 (/nfsshared/ocr1/asm_dsk1) [OCRVOTING]
 2. ONLINE   f21f2368ef994f35bf44fb3ba50ef203 (/nfsshared/ocr2/asm_dsk2) [OCRVOTING]
 3. ONLINE   a8243f5d0d2a4f4dbf5076f0f189422b (/nfsshared/ocr3/asm_dsk3) [OCRVOTING]
Located 3 voting disk(s).