Friday, January 23, 2009

Cluster Interconnect redundancy for Oracle RAC - Unix/Solaris OS

If the RAC nodes are also Sun Cluster nodes,

clprivnet0 interface can be used for RAC interconnects as well with inbuilt redundancy.

Eg:-

clprivnet0: flags=1009843 mtu 1500 index 9 inet 172.16.4.1 netmask fffffe00 broadcast 172.16.5.255

ether 0:0:0:0:0:1

# cat /etc/hosts

# Internet host table

#

::1 localhost

127.0.0.1 localhost

192.168.2.125 node1 node1.domain.lk loghost

192.168.2.126 node2 node2.domain.lk

# Oracle RAC Public

192.168.2.129 ora-vip-1

192.168.2.130 ora-vip-2

# Oracle RAC Interconnects

172.16.4.1 ora-prip-1

172.16.4.2 ora-prip-2

Else we have to use Solaris level network redundancy.


Simple rules for switches between interconnects

- Interconnect switches should be in a single fabric
- Dedicated VLAN for interconnects links
- Port fast should be enabled for all interconnect ports
Eg: -
Switch -A> (enable) set spantree portfast 2/1 enable

Configuration options for Solaris 10

- Option 1 : Link based IPMP
# cat /etc/hostname.e1000g0
ora-prip-1 group sc_ipmp0 up

# cat /etc/hostname.e1000g4
group sc_ipmp0 standby up

- Option 2 : Link aggregation (All links (below: - e1000g0 and e1000g4) of an aggregation should connect to a single switch)

# dladm show-dev
# dladm create-aggr -d e1000g0 -d e1000g4 1
# dladm show-aggr 1

Port Grouping and LCAP should be enabled in the switch

Eg:-

Switch Config:
# = Insert Integer
Configure a Port Group:
interface Port-channel#
switchport access vlan #
switchport mode access
exit
port-channel load-balance src-dst-ip
Please configure the ports you want in the channel (4 max) required as following:
# = Insert Integer
config term
interface INTERFACE
channel-group # mode passive
channel-protocol lacp
switchport access vlan #
switchport mode access
exit
end
show run (to verify)