Hi everyone, I will start complete guide of Oracle RAC 19c lab setup. I have listed all the main points that I will cover during my up coming videos on my youtube channel, so it can be easy for you to follow and understand each point, besides that those steps will save your time if you follow, so I put those point in a notepad as you can see here:
Requirements
- Oracle Linux 8.5
- Oracle 19.3 Grid Infrastructure (GI)
- Oracle 19.3 Oracle Database (DB)
- Oracle Grid & Database RU 19.15 (Relase Update)
- VirtualBox
- VBox Network 1. Host only subnet 10.10.30.0/24 2. NAT subnet 10.10.20.0/24
- Virtual Machine Resource Allocation:
- Node1
- 8 GB VM RAM
- 25 GB OS VM DISK
- 40 GB GRID & DB Binaries VM DISK
- 4 Cores
- 2 VNIC Private/Public
- Node2
- 8 GB VM RAM
- 25 GB OS VM DISK
- 40 GB GRID & DB Binaries VM DISK
- 4 Cores
- 2 VNIC Private/Public
- Node1
- Shared Disk (VSAN)
- 40 GB ASM shared VM disks.
- 2 NIC (Network Interface Card) , 4 NIC (Redundant)
- 2 Network Switches, 4 Switches (redundant)
- DNS server
Setup VM Network
NAT
Change NAT subnet to 10.10.20.0/24 DHCP as well
Hostonly
Change HostOnly to 10.10.30.0/24
OS Installation
After download the Oracle 8u5, you can create a vm and select the iso as virutal CD/DVD then start the VM that you create and boot up the ISO media and follow the below steps:
Click Installation Destination:
Network & Host
Software Selection
1- Performance Tools 2- Legac Linux Compatibility 3- Development Tools 4- Graphic Administration Tools 5- System Tools
Root Password
User Creation
Begin Installation
Post Installation
- Remove screen lock and sleep.
- Increase terminal font size.
- Auto connect network interfaces.
- Add static network IP.
- Install guest addition tools
sudo dnf install kernel-uek-devel-$(uname -r) gcc binutils automake make perl bzip2 elfutils-libelf-devel
/run/media/admin/VBox_GAs_6.1.32/VBoxLinuxAdditions.run
Format Oracle Binaries Disk
Create LVM
list all the avilable disks on the OS:
[admin@rac1 ~]$ lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 259:0 0 25G 0 disk
├─sda1 259:1 0 500M 0 part /boot
└─sda2 259:2 0 24.5G 0 part
├─ol-root 252:0 0 16.5G 0 lvm /
└─ol-swap 252:1 0 8G 0 lvm [SWAP]
sdb 259:3 0 40G 0 disk
[admin@rac1 ~]$
formate the disk using below command:
[root@rac1 ~]# fdisk /dev/sdb
Welcome to fdisk (util-linux 2.32.1).
Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.
Device does not contain a recognized partition table.
Created a new DOS disklabel with disk identifier 0xb21e6b55.
Command (m for help): n
Partition type
p primary (0 primary, 0 extended, 4 free)
e extended (container for logical partitions)
Select (default p):
Using default response p.
Partition number (1-4, default 1):
First sector (2048-83886079, default 2048):
Last sector, +sectors or +size{K,M,G,T,P} (2048-83886079, default 83886079):
Created a new partition 1 of type 'Linux' and of size 40 GiB.
Command (m for help): p
Disk /dev/sdb: 40 GiB, 42949672960 bytes, 83886080 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xb21e6b55
Device Boot Start End Sectors Size Id Type
/dev/sdb1 2048 83886079 83884032 40G 83 Linux
Command (m for help): t
Selected partition 1
Hex code (type L to list all codes): 8e
Changed type of partition 'Linux' to 'Linux LVM'.
Command (m for help): p
Disk /dev/sdb: 40 GiB, 42949672960 bytes, 83886080 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xb21e6b55
Device Boot Start End Sectors Size Id Type
/dev/sdb1 2048 83886079 83884032 40G 8e Linux LVM
Command (m for help): w
The partition table has been altered.
Calling ioctl() to re-read partition table.
Syncing disks.
[root@rac1 ~]#
Create PV
[root@rac1 ~]# pvcreate /dev/sdb1
Physical volume "/dev/sdb1" successfully created.
[root@rac1 ~]# pvs
PV VG Fmt Attr PSize PFree
/dev/sda2 ol lvm2 a-- <24.51g 0
/dev/sdb1 lvm2 --- <40.00g <40.00g
[root@rac1 ~]#
Create VG
[root@rac1 ~]# vgcreate db /dev/sdb1
Volume group "db" successfully created
[root@rac1 ~]# vgs
VG #PV #LV #SN Attr VSize VFree
db 1 0 0 wz--n- <40.00g <40.00g
ol 1 2 0 wz--n- <24.51g 0
[root@rac1 ~]#
Create LV
[root@rac1 ~]# lvcreate db -n u01 -l 100%FREE
Logical volume "u01" created.
[root@rac1 ~]# lvs
LV VG Attr LSize Pool Origin Data% Meta% Move Log Cpy%Sync Convert
u01 db -wi-a----- <40.00g
root ol -wi-ao---- <16.51g
swap ol -wi-ao---- 8.00g
[root@rac1 ~]#
Make Files system
[root@rac1 ~]# mkfs -t xfs /dev/mapper/db-u01
meta-data=/dev/mapper/db-u01 isize=512 agcount=4, agsize=2621184 blks
= sectsz=512 attr=2, projid32bit=1
= crc=1 finobt=1, sparse=1, rmapbt=0
= reflink=1
data = bsize=4096 blocks=10484736, imaxpct=25
= sunit=0 swidth=0 blks
naming =version 2 bsize=4096 ascii-ci=0, ftype=1
log =internal log bsize=4096 blocks=5119, version=2
= sectsz=512 sunit=0 blks, lazy-count=1
realtime =none extsz=4096 blocks=0, rtextents=0
[root@rac1 ~]# fsck -N /dev/db/u01
fsck from util-linux 2.32.1
[/usr/sbin/fsck.xfs (1) -- /u01] fsck.xfs /dev/mapper/db-u01
[root@rac1 ~]#
Add to fstab
vim /etc/fstab
/dev/db/u01 /u01 xfs defaults 0 0
Mount the u01
[root@rac1 ~]# umount /u01
Check the list of disks
[root@rac1 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 259:0 0 25G 0 disk
├─sda1 259:1 0 500M 0 part /boot
└─sda2 259:2 0 24.5G 0 part
├─ol-root 252:0 0 16.5G 0 lvm /
└─ol-swap 252:1 0 8G 0 lvm [SWAP]
sdb 259:3 0 40G 0 disk
└─sdb1 259:4 0 40G 0 part
└─db-u01 252:2 0 40G 0 lvm /u01
[root@rac1 ~]#
Reboot to check if everything is ok
reboot
Setup Prerequisites
Prerequisites installation
check the Internet connectivity using ping :
# check internet connectivity
ping www.google.com
check cache to download the metadata from online repo:
# check the cache
dnf makecache
Install prerequisites and ASM required packages:
# Search for preinstall package
dnf search preinstall-19c
# Install oracle prereqisites
dnf install oracle-database-preinstall-19c -y
this step is optional if you want to update the system:
# Optional
dnf check-update # list the packages that need for update
dnf update
dnf clean all
Create OS groups for asm administration and operation:
# Create ASM groups
groupadd -g 54327 asmdba
groupadd -g 54328 asmoper
groupadd -g 54329 asmadmin
Add asmdba as secondary group to oracle user:
# add asmdba group to oracle user asmadmin
usermod -a -G asmdba oracle
id oracle
Create Grid user:
# create grid user
useradd -u 54331 -g oinstall -G dba,asmdba,asmadmin,asmoper,racdba grid
id grid
Change the password for Oracle and Grid user:
# create grid oracle user passwords
passwd oracle
echo password | passwd oracle --stdin
echo password | passwd grid --stdin
passwd grid
Create the Directories for the Oracle Grid installation
mkdir -p /u01/19c/oracle/ora_base/db_home
mkdir -p /u01/19c/grid/grid_home
mkdir -p /u01/19c/grid/grid_base
chown -R oracle:oinstall /u01
chown -R grid:oinstall /u01/19c/grid/
chmod -R 775 /u01
Check the NTP service
# chrony both servers
vim /etc/chrony.conf
server 0.jp.pool.ntp.org iburst
server 1.jp.pool.ntp.org iburst
server 2.jp.pool.ntp.org iburst
server 3.jp.pool.ntp.org iburst
systemctl restart chronyd
chronyc sources
systemctl status chronyd
set secure linux to permissive
# change SELINUX=enforcing to SELINUX=permissive
sed -i s/SELINUX=enforcing/SELINUX=permissive/g /etc/selinux/config
# Or Disabled it
sed -i s/SELINUX=enforcing/SELINUX=disabled/g /etc/selinux/config
cat /etc/selinux/config
# Forse the change
setenforce Permissive
# create limitation in security forlder for grid user
cp /etc/security/limits.d/oracle-database-preinstall-19c.conf /etc/security/limits.d/grid-database-preinstall-19c.conf
# rename oracle with grid in this file grid-database-preinstall-19c.conf
# use vim
vim /etc/security/limits.d/grid-database-preinstall-19c.conf
:%s/oracle/grid/g
:x
allow the port 1521 port in the Linux firewall ref-link
# allow the traffic for the port 1521
firewall-cmd --permanent --add-port=1521/tcp
firewall-cmd --list-ports
# OR Stop the firewall and disable it
systemctl stop firewalld
systemctl disable firewalld
Create Env Variables
Switch to the grid user and edit the Grid .bash_profile, before edit the file I will take backup for it first
su - grid
cp .bash_profile .bash_profile.bkp
Copy and paste this to grid home directory
# Node1 Copy this
export ORA_SID=+ASM1
# Node2 Copy this
export ORA_SID=+ASM2
cat > /home/grid/.grid_env <<EOFhost=\\$(hostname -s)
if [ \\$host == "rac1" ]; then
ORA_SID=+ASM1
elif [ \\$host == "rac2" ]; then
ORA_SID=+ASM2
else
echo "Host not meet the option $host"
fi
# User specific environment and startup programs
ORACLE_SID=\\$ORA_SID; export ORACLE_SID
ORACLE_BASE=/u01/19c/grid/grid_base; export ORACLE_BASE
ORACLE_HOME=/u01/19c/grid/grid_home; export ORACLE_HOME
ORACLE_TERM=xterm; export ORACLE_TERM
JAVA_HOME=/usr/bin/java; export JAVA_HOME
TNS_ADMIN=\\$ORACLE_HOME/network/admin; export TNS_ADMIN
PATH=.:\\${JAVA_HOME}/bin:\\${PATH}:\\$HOME/bin:\\$ORACLE_HOME/bin
PATH=\\${PATH}:/usr/bin:/bin:/usr/local/bin
export PATH
umask 022
EOFecho '. ~/.grid_env' >> /home/grid/.bash_profile
# apply below if you run the above script from root otherwise ignore it
chown grid:oinstall /home/grid/.grid_env
apply the profile for the current session and check the environment variables using grid user :
source .bash_profile
env | grep -i "tns\\|oracle"exit
Switch to oracle user and backup the .bash_profile :
su - oracle
cp .bash_profile .bash_profile.bkp
create new bash profile file copy the below script to your terminal and press enter:
# Node1 Copy this
export ORA_SID=PROD1
# Node2 Copy this
export ORA_SID=PROD2
# Create oracle db 19c env profile
cat > /home/oracle/.db19_env <<EOFhost=\\$(hostname -s)
if [ \\$host == "rac1" ]; then
ORA_SID=PROD1
elif [ \\$host == "rac2" ]; then
ORA_SID=PROD2
else
echo "Host not meet the option $host"
fi
ORACLE_HOSTNAME=\\$HOSTNAME; export ORACLE_HOSTNAME
ORACLE_SID=\\$ORA_SID; export ORACLE_SID
ORACLE_UNQNAME=prod; export ORACLE_UNQNAME
ORACLE_BASE=/u01/19c/oracle/ora_base; export ORACLE_BASE
ORACLE_HOME=/u01/19c/oracle/ora_base/db_home; export ORACLE_HOME
ORACLE_TERM=xterm; export ORACLE_TERM
JAVA_HOME=/usr/bin/java; export JAVA_HOME
NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT
TNS_ADMIN=\\$ORACLE_HOME/network/admin; export TNS_ADMIN
PATH=.:\\${JAVA_HOME}/bin:\\${PATH}:\\$HOME/bin:\\$ORACLE_HOME/bin
PATH=\\${PATH}:/usr/bin:/bin:/usr/local/bin
export PATH
LD_LIBRARY_PATH=\\$ORACLE_HOME/lib
LD_LIBRARY_PATH=\\${LD_LIBRARY_PATH}:\\$ORACLE_HOME/oracm/lib
LD_LIBRARY_PATH=\\${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export LD_LIBRARY_PATH
CLASSPATH=\\$ORACLE_HOME/JRE:\\$ORACLE_HOME/jlib:\\$ORACLE_HOME/rdbms/jlib:\\$ORACLE_HOME/network/jlib
export CLASSPATH
TEMP=/tmp ;export TMP
TMPDIR=\\$tmp ; export TMPDIR
EOF# add this to oracle bash profile
cat >> /home/oracle/.bash_profile <<EOFsource ~/.db19_env
alias db19_env='. ~/.db19_env'
EOF# apply below if you run the above script from root otherwise ignore it
chown oracle:oinstall /home/oracle/.bash_profile
chown oracle:oinstall /home/oracle/.db19_env
apply the profile from oracle user
source /home/oracle/.bash_profile
env | grep ORACLE_
exit
Disable Unwanted Services
stop below services Need ROOT Privilege:
systemctl stop tuned.service ktune.service
systemctl stop firewalld.service
systemctl stop postfix.service
systemctl stop avahi-daemon.service
systemctl stop avahi-daemon.socket
systemctl stop atd.service
systemctl stop bluetooth.service
systemctl stop wpa_supplicant.service
systemctl stop accounts-daemon.service
systemctl stop ModemManager.service
systemctl stop debug-shell.service
systemctl stop rtkit-daemon.service
systemctl stop rpcbind.service
systemctl stop rpcbind.socket
systemctl stop rngd.service
systemctl stop upower.service
systemctl stop rhsmcertd.service
systemctl stop colord.service
systemctl stop libstoragemgmt.service
systemctl stop ksmtuned.service
systemctl stop brltty.service
systemctl disable tuned.service ktune.service
systemctl disable firewalld.service
systemctl disable postfix.service
systemctl disable avahi-daemon.socket
systemctl disable avahi-daemon.service
systemctl disable bluetooth.service
systemctl disable wpa_supplicant.service
systemctl disable accounts-daemon.service
systemctl disable atd.service cups.service
systemctl disable ModemManager.service
systemctl disable debug-shell.service
systemctl disable rpcbind.service
systemctl disable rpcbind.socket
systemctl disable rngd.service
systemctl disable upower.service
systemctl disable rhsmcertd.service
systemctl disable rtkit-daemon.service
systemctl disable mcelog.service
systemctl disable colord.service
systemctl disable libstoragemgmt.service
systemctl disable ksmtuned.service
systemctl disable brltty.service
Setup Cluster Network
To setup 2 Nodes Oracle RAC network we need 9 IPs 7 on public network and two IPs on private network for cluster interconnect communications.
Cluster Network
The Current Lab network setup will be simple as shown below
For maximum HA and the Best Practice to have redundant network setup, you need 4 NIC 4 Switches
Host file
add below to host file /etc/hosts
10.10.20.111 rac1.racdomain.com rac1 #DNS
10.10.20.112 rac2.racdomain.com rac2 #DNS
10.10.30.111 rac1-priv.racdomain.com rac1-priv
10.10.30.112 rac2-priv.racdomain.com rac2-priv
10.10.20.113 rac1-vip.racdomain.com rac1-vip #DNS
10.10.20.114 rac2-vip.racdomain.com rac2-vip #DNS
#10.10.20.115 rac-cluster-scan.racdomain.com rac-cluster-scan #DNS
#10.10.20.116 rac-cluster-scan.racdomain.com rac-cluster-scan #DNS
#10.10.20.117 rac-cluster-scan.racdomain.com rac-cluster-scan #DNS
Setup DNS
On first node you can configure DNS but the best practice to have DNS server out of RAC nodes:
Install BIND9
# DNS Server
dnf makecache
dnf install bind bind-utils -y
hostnamectl
Configure BIND
systemctl stop named
systemctl disable named
# backup the file
cp /etc/named.conf /etc/named.conf.bkp
# I wrote a simple script to generate the named.conf based on your system
export DNS_IP="10.10.20.111"export DNS_DOMAIN="racdomain.com"export DNS_NETWORK="10.10.20.0/24"export DNS_BACKWARD="20.10.10.in-addr.arpa"export DNS_FORWARD=$DNS_DOMAIN
export DNS_BACKWARD_FILE="backward.$DNS_DOMAIN"export DNS_FORWARD_FILE="forward.$DNS_DOMAIN"export DNS_HOSTNAME="rac1"export DNS_FQDN=$DNS_HOSTNAME.$DNS_DOMAIN
cat > /etc/named.conf <<EOFoptions {
listen-on port 53 { 127.0.0.1; $DNS_IP; };
listen-on-v6 port 53 { ::1; };
directory "/var/named";
dump-file "/var/named/data/cache_dump.db";
statistics-file "/var/named/data/named_stats.txt";
memstatistics-file "/var/named/data/named_mem_stats.txt";
secroots-file "/var/named/data/named.secroots";
recursing-file "/var/named/data/named.recursing";
allow-query { localhost; $DNS_NETWORK; };
recursion yes;
dnssec-enable yes;
dnssec-validation yes;
managed-keys-directory "/var/named/dynamic";
pid-file "/run/named/named.pid";
session-keyfile "/run/named/session.key";
/* <https://fedoraproject.org/wiki/Changes/CryptoPolicy> */
include "/etc/crypto-policies/back-ends/bind.config";
};
logging {
channel default_debug {
file "data/named.run";
severity dynamic;
};
};
zone "." IN {
type hint;
file "named.ca";
};
include "/etc/named.rfc1912.zones";
include "/etc/named.root.key";
//forward zone
zone "$DNS_DOMAIN" IN {
type master;
file "$DNS_FORWARD_FILE";
allow-update { none; };
allow-query { any; };
};
//backward zone or reverse zone
zone "$DNS_BACKWARD" IN {
type master;
file "$DNS_BACKWARD_FILE";
allow-update { none; };
allow-query { any; };
};
EOF
Forward Backward Zones
# I wrote a simple script to generate forward and backward zones
cat > /var/named/forward.racdomain.com <<EOF\\$TTL 86400
@ IN SOA rac1.racdomain.com. admin.racdomain.com. (
2021040300 ;Serial
3600 ;Refresh
1800 ;Retry
604800 ;Expire
86400 ;Minimum TTL
)
;Name Server Information
@ IN NS rac1.racdomain.com.
@ IN A 10.10.20.111
@ IN A 10.10.20.112
@ IN A 10.10.20.113
@ IN A 10.10.20.114
@ IN A 10.10.20.115
@ IN A 10.10.20.116
@ IN A 10.10.20.117
;IP Address for Name Server
rac1 IN A 10.10.20.111
;Mail Server MX (Mail exchanger) Record
;rac1.racdomain.com IN MX 10 mail.rac1.racdomain.com
;A Record for the following Host name
rac1 IN A 10.10.20.111
rac2 IN A 10.10.20.112
rac1-vip IN A 10.10.20.113
rac2-vip IN A 10.10.20.114
rac-cluster-scan IN A 10.10.20.115
rac-cluster-scan IN A 10.10.20.116
rac-cluster-scan IN A 10.10.20.117
;CNAME Record
;ftp IN CNAME ftp.rac1.racdomain.com.
EOF
cat > /var/named/backward.racdomain.com <<EOF\\$TTL 86400
@ IN SOA rac1.racdomain.com. admin.racdomain.com. (
2021040300 ;Serial
3600 ;Refresh
1800 ;Retry
604800 ;Expire
86400 ;Minimum TTL
)
;Name Server Information
@ IN NS rac1.racdomain.com.
rac1 IN A 10.10.20.111
;Reverse lookup for Name Server
35 IN PTR rac1.racdomain.com.
;PTR Record IP address to Hostname
111 IN PTR rac1.racdomain.com.
112 IN PTR rac2.racdomain.com.
113 IN PTR rac1-vip.racdomain.com
114 IN PTR rac2-vip.racdomain.com
115 IN PTR rac-cluster-scan.racdomain.com
116 IN PTR rac-cluster-scan.racdomain.com
117 IN PTR rac-cluster-scan.racdomain.com
EOF# change the owner
chown named:named /var/named/forward.racdomain.com
chown named:named /var/named/backward.racdomain.com
Test DNS Configuration
# check the configurations
named-checkconf
named-checkzone racdomain.com /var/named/forward.racdomain.com
named-checkzone 10.10.20.111 /var/named/backward.racdomain.com
systemctl start named
systemctl enable named
Use DNS
################################
###### DNS Client Node 1 ######
################################
# edit resolv.conf
cat > /etc/resolv.conf <<EOFsearch racdomain.com
nameserver 10.10.20.111
EOF# edit the network profiles may different in your system
nano /etc/sysconfig/network-scripts/ifcfg-enp0s3
# add this line to this file
DNS1=10.10.20.111
# allow the dns traffic
firewall-cmd --add-service=dns --zone=public --permanent
firewall-cmd --reload
################################
###### DNS Client Node 2 ######
################################
# edit system
cat > /etc/resolv.conf <<EOFsearch racdomain.com
nameserver 10.10.20.111
EOF# edit the network profiles may different in your system
nano /etc/sysconfig/network-scripts/ifcfg-enp0s3
# add this line to this file
DNS1=10.10.20.111
# test from the client
nslookup rac1
nslookup rac2
ping rac1
ping rac2
Clone VM
Poweroff Node 1
Poweroff the Oracle linux VM
poweroff
Clone
Select first node VM from Main menu and right click mouse select Clone then follow below screenshots:
press the expirt mode below windows will show up.
after finish click clone
once clone finished you can see the cloned VM listed as below screen shot
Edit Network
Startup the Second node and change the following:
- Change the IP for both Public and Private network.
- change the hostname as below
[root@rac1 ~]# hostnamectl set-hostname rac2.racdomain.com
[root@rac1 ~]# hostnamectl
Static hostname: rac2.racdomain.com
Icon name: computer-vm
Chassis: vm
Machine ID: f0e024b338264ff68fec7de92dd97d63
Boot ID: 3f0decbb597c45a69d602f14f3e5c641
Virtualization: vmware
Operating System: Oracle Linux Server 8.5
CPE OS Name: cpe:/o:oracle:linux:8:5:server
Kernel: Linux 5.4.17-2136.300.7.el8uek.x86_64
Architecture: x86-64
[root@rac1 ~]#
- Stop DNS service called
named.service
systemctl stop named.service
systemctl disable named.service
shutdown the second node (RAC2)
poweroff
ASM Shared Disks
Create VSAN Disk
Go to Oracle VM VirtualBox Manager click ctrl + D Virtual Media Manager will Pop up create 3 virtual hard dirve with fix size select the size as following
- 5 G for CRS
- 15G for FRA
- 20G for DATA
Repeate above operation for the other two disks
Add Disk on Both Nodes
Node 1
Node 2
Format Disks
Start First Node and using fdisk to format the three disks
fdisk /dev/sdc
fdisk /dev/sdd
fdisk /dev/sde
[root@rac1 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 25G 0 disk
├─sda1 8:1 0 500M 0 part /boot
└─sda2 8:2 0 24.5G 0 part
├─ol-root 252:0 0 16.3G 0 lvm /
└─ol-swap 252:1 0 8.2G 0 lvm [SWAP]
sdb 8:16 0 40G 0 disk
└─sdb1 8:17 0 40G 0 part
└─db-u01 252:2 0 40G 0 lvm /u01
sdc 8:32 0 5G 0 disk
└─sdc1 8:33 0 5G 0 part
sdd 8:48 0 20G 0 disk
└─sdd1 8:49 0 20G 0 part
sde 8:64 0 15G 0 disk
└─sde1 8:65 0 15G 0 part
then startup the second node the shared disks should be formated there:
[root@rac2 ~]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 25G 0 disk
├─sda1 8:1 0 500M 0 part /boot
└─sda2 8:2 0 24.5G 0 part
├─ol-root 252:0 0 16.3G 0 lvm /
└─ol-swap 252:1 0 8.2G 0 lvm [SWAP]
sdb 8:16 0 40G 0 disk
└─sdb1 8:17 0 40G 0 part
└─db-u01 252:2 0 40G 0 lvm /u01
sdc 8:32 0 5G 0 disk
└─sdc1 8:33 0 5G 0 part
sdd 8:48 0 20G 0 disk
└─sdd1 8:49 0 20G 0 part
sde 8:64 0 15G 0 disk
└─sde1 8:65 0 15G 0 part
Setup GI + ASM AFD
For the ASM disk setup will use ASM Filter Driver to configure the disk and managed them.
Upload files
Using NAT port forwarding i can upload the files to first node, to setup port forwarding, go to File -> Preferences -> Network -> Edit Nat Adapter -> Port Forwarding:
or add both nodes if you want to access both of them using putty or ssh client
Then Click Ok,check if the ports (2122,2222) are listening on localhost using below command:
ss -alnt | grep "2*22" # for linux
netstat -ano | findstr "2*22" # for windows
If the ports are not show up, then you may need to poweroff your VMS. and restart virtualbox service, to do so:
sudo systemctl restart virtualbox # for linux
# run services.msc then search for vbox service and restart it
PowerOn the VM first node then run below command from your host machine
ss -alnt | grep "2*22" # for linux
netstat -ano | findstr "2*22" # for windows
Upload the Oracle binaries to Node 1:
scp -P 2122 LINUX.X64_193000_db_home.zip LINUX.X64_193000_grid_home.zip p33803476_190000_Linux-x86-64.zip p6880880_210000_Linux-x86-64.zip grid@127.0.0.1:/u01
Unzip files
unzip /u01/LINUX.X64_193000_grid_home.zip -d $ORACLE_HOME
mv $ORACLE_HOME/OPatch/ $ORACLE_HOME/OPatch_BKP
unzip /u01/p6880880_210000_Linux-x86-64.zip -d $ORACLE_HOME
unzip p33803476_190000_Linux-x86-64.zip -d /u01
Prerequisites
#node1 and node2
ssh-keygen -t rsa
# node2
ssh-copy-id grid@rac1.racdomain.com
# node1
ssh-copy-id grid@rac2.racdomain.com
# ssh grid@rac1 date
# ssh grid@rac2 date
# fix the error INS-06006
cp -p /usr/bin/scp /usr/bin/scp.bkp
echo "/usr/bin/scp.bkp -T \\$*" > /usr/bin/scp
$ORACLE_HOME/runcluvfy.sh stage -pre crsinst -n rac1,rac2 -networks enp0s3:10.10.20.0:PUBLIC/enp0s8:10.10.30.0:cluster_interconnect -method root -verbose
Installation
[grid@rac1 ~]$ export DISPLAY=:0.0
[grid@rac1 ~]$ xhost +
export CV_ASSUME_DISTID=OEL7.9
# Go to grid home and run below command
./gridSetup.sh -applyPSU /u01/33803476/
Before proceed to installation, keep installer running, then proceed to create CRS votting disk for cluster, for more details check out this link
[root@rac1 ~]# source /home/grid/.grid_env
[root@rac1 ~]# export ORACLE_BASE=/tmp
[root@rac1 ~]# asmcmd afd_label CRS1 /dev/sdc1 --init
[root@rac1 ~]# asmcmd afd_lslbl /dev/sdc1
# if you want to remove the label and you see that you create it by mistake with different disk use below command
[root@rac1 ~]#asmcmd afd_unlabel /dev/sdc1 --init
------------------------------------------------------------
Label Duplicate Path
============================================================
CRS1 /dev/sdc1
[root@rac1 ~]#
[root@rac1 ~]# unset ORACLE_BASE
Now We can Proceed with the installation using GUI
Two scripts should be run as root on both nodes
Node 1:
# Script 1
[root@rac1 ~]# /u01/19c/grid/oraInventory/orainstRoot.sh
Changing permissions of /u01/19c/grid/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/19c/grid/oraInventory to oinstall.
The execution of the script is complete.
# Script 2
[root@rac1 ~]# /u01/19c/grid/grid_home/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/19c/grid/grid_home
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/19c/grid/grid_home/crs/install/crsconfig_params
The log of current session can be found at:
/u01/19c/grid/grid_base/crsdata/rac1/crsconfig/rootcrs_rac1_2022-06-06_10-57-45AM.log
2022/06/06 10:58:02 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2022/06/06 10:58:02 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2022/06/06 10:58:02 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2022/06/06 10:58:04 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2022/06/06 10:58:05 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2022/06/06 10:58:06 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2022/06/06 10:58:09 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2022/06/06 10:58:20 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2022/06/06 10:58:24 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2022/06/06 10:58:41 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2022/06/06 10:58:41 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2022/06/06 10:58:46 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2022/06/06 10:58:51 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2022/06/06 10:59:16 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2022/06/06 10:59:53 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/06/06 10:59:56 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2022/06/06 11:00:20 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2022/06/06 11:00:26 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
[INFO] [DBT-30161] Disk label(s) created successfully. Check /u01/19c/grid/grid_base/cfgtoollogs/asmca/asmca-220606AM110058.log for details.
2022/06/06 11:02:11 CLSRSC-482: Running command: '/u01/19c/grid/grid_home/bin/ocrconfig -upgrade grid oinstall'
CRS-4256: Updating the profile
Successful addition of voting disk b064bcb91a2e4f58bfa5b9daa9cb1cc6.
Successfully replaced voting disk group with +CRS.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE b064bcb91a2e4f58bfa5b9daa9cb1cc6 (AFD:CRS1) [CRS]
Located 1 voting disk(s).
2022/06/06 11:03:17 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2022/06/06 11:04:26 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/06/06 11:04:26 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2022/06/06 11:05:45 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2022/06/06 11:06:09 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@rac1 ~]#
Node 2:
[root@rac2 grid_home]# /u01/19c/grid/oraInventory/orainstRoot.sh
Changing permissions of /u01/19c/grid/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/19c/grid/oraInventory to oinstall.
The execution of the script is complete.
[root@rac2 grid_home]# /u01/19c/grid/grid_home/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /u01/19c/grid/grid_home
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/19c/grid/grid_home/crs/install/crsconfig_params
The log of current session can be found at:
/u01/19c/grid/grid_base/crsdata/rac2/crsconfig/rootcrs_rac2_2022-06-06_11-26-28AM.log
2022/06/06 11:26:34 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2022/06/06 11:26:34 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2022/06/06 11:26:34 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2022/06/06 11:26:35 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2022/06/06 11:26:36 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2022/06/06 11:26:36 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
2022/06/06 11:26:37 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2022/06/06 11:26:39 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2022/06/06 11:26:39 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2022/06/06 11:26:51 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2022/06/06 11:26:51 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2022/06/06 11:26:53 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2022/06/06 11:27:00 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2022/06/06 11:27:20 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2022/06/06 11:27:41 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2022/06/06 11:28:06 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2022/06/06 11:28:07 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2022/06/06 11:28:18 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2022/06/06 11:28:39 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2022/06/06 11:29:05 CLSRSC-343: Successfully started Oracle Clusterware stack
2022/06/06 11:29:05 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
2022/06/06 11:29:17 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2022/06/06 11:29:28 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
Click Ok to continue the installation
Check Cluster Status
[root@rac1 ~]# crsctl stat res -t
--------------------------------------------------------------------------------
Name Target State Server State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
ONLINE ONLINE rac1 STABLE
ONLINE ONLINE rac2 STABLE
ora.chad
ONLINE ONLINE rac1 STABLE
ONLINE ONLINE rac2 STABLE
ora.net1.network
ONLINE ONLINE rac1 STABLE
ONLINE ONLINE rac2 STABLE
ora.ons
ONLINE ONLINE rac1 STABLE
ONLINE ONLINE rac2 STABLE
ora.proxy_advm
OFFLINE OFFLINE rac1 STABLE
OFFLINE OFFLINE rac2 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
1 ONLINE ONLINE rac1 STABLE
2 ONLINE ONLINE rac2 STABLE
ora.CRS.dg(ora.asmgroup)
1 ONLINE ONLINE rac1 STABLE
2 ONLINE ONLINE rac2 STABLE
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac2 STABLE
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE rac1 STABLE
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE rac1 STABLE
ora.asm(ora.asmgroup)
1 ONLINE ONLINE rac1 Started,STABLE
2 ONLINE ONLINE rac2 Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
1 ONLINE ONLINE rac1 STABLE
2 ONLINE ONLINE rac2 STABLE
ora.cvu
1 ONLINE ONLINE rac1 STABLE
ora.qosmserver
1 ONLINE ONLINE rac1 STABLE
ora.rac1.vip
1 ONLINE ONLINE rac1 STABLE
ora.rac2.vip
1 ONLINE ONLINE rac2 STABLE
ora.scan1.vip
1 ONLINE ONLINE rac2 STABLE
ora.scan2.vip
1 ONLINE ONLINE rac1 STABLE
ora.scan3.vip
1 ONLINE ONLINE rac1 STABLE
--------------------------------------------------------------------------------
[root@rac1 ~]#
Database Installation
Install DB Software Only
[oracle@rac1 ~]$ cd $ORACLE_HOME
[oracle@rac1 db_home]$ unzip /tmp/LINUX.X64_193000_db_home.zip -d $ORACLE_HOME
[oracle@rac1 db_home]$ $ORACLE_HOME/OPatch/opatch version
[oracle@rac1 db_home]$ mv OPatch/ OPatch_bkp
[oracle@rac1 db_home]$ unzip /u01/p6880880_210000_Linux-x86-64.zip -d $ORACLE_HOME
[oracle@rac1 db_home]$ $ORACLE_HOME/OPatch/opatch version
export CV_ASSUME_DISTID=OEL7.9
# Fix oracl 12c DB INS-06006
$ORACLE_HOME/deinstall/sshUserSetup.sh -user oracle -hosts "rac1 rac2" -advanced -exverify -confirm -noPromptPassphrase
[oracle@rac1 db_home]$ ./runInstaller
run root.sh on both nodes:
Node 1:
[root@rac1 run]# /u01/19c/oracle/ora_base/db_home/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/19c/oracle/ora_base/db_home
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
[root@rac1 run]#
Node 2:
[root@rac2 ~]# /u01/19c/oracle/ora_base/db_home/root.sh
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/19c/oracle/ora_base/db_home
Enter the full pathname of the local bin directory: [/usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
[root@rac2 ~]#
click Ok and close
Create Data,FRA
Node 1:
[root@rac1 run]# source /home/grid/.grid_env
[root@rac1 run]# export ORACLE_BASE=/tmp
[root@rac1 run]# lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 25G 0 disk
├─sda1 8:1 0 500M 0 part /boot
└─sda2 8:2 0 24.5G 0 part
├─ol-root 252:0 0 16.3G 0 lvm /
└─ol-swap 252:1 0 8.2G 0 lvm [SWAP]
sdb 8:16 0 40G 0 disk
└─sdb1 8:17 0 40G 0 part
└─db-u01 252:2 0 40G 0 lvm /u01
sdc 8:32 0 5G 0 disk
└─sdc1 8:33 0 5G 0 part
sdd 8:48 0 20G 0 disk
└─sdd1 8:49 0 20G 0 part
sde 8:64 0 15G 0 disk
└─sde1 8:65 0 15G 0 part
[root@rac1 run]# asmcmd -V
asmcmd version 19.15.0.0.0
[root@rac1 run]# asmcmd afd_lsdsk
---------------------------------------------------------
Label Filtering Path
=========================================================
CRS1 ENABLED /dev/sdc1
[root@rac1 run]# asmcmd afd_label FRA1 /dev/sde1
[root@rac1 run]# asmcmd afd_label DATA1 /dev/sdd1
[root@rac1 run]# asmcmd afd_lsdsk
----------------------------------------------------------
Label Filtering Path
==========================================================
CRS1 ENABLED /dev/sdc1
DATA1 ENABLED /dev/sdd1
FRA1 ENABLED /dev/sde1
[root@rac1 run]#
[root@rac1 run]# ls -l /dev/oracleafd/disks/
total 12
-rw-rw-r--. 1 grid oinstall 10 Jun 6 10:59 CRS1
-rw-rw-r--. 1 grid oinstall 10 Jun 6 13:43 DATA1
-rw-rw-r--. 1 grid oinstall 10 Jun 6 13:43 FRA1
[root@rac1 run]#
Node 2:
[root@rac1 run]# source /home/grid/.grid_env
[root@rac1 run]# export ORACLE_BASE=/tmp
[root@rac1 run]# asmcmd -V
asmcmd version 19.15.0.0.0
[root@rac2 ~]# asmcmd afd_lsdsk
---------------------------------------------------------
Label Filtering Path
=========================================================
CRS1 ENABLED /dev/sdc1
DATA1 ENABLED /dev/sdd1
FRA1 ENABLED /dev/sde1
[root@rac2 ~]## if the above list not updated after you changed from the first node try below command
[root@rac2 ~]# asmcmd afd_scan
# then
[root@rac2 ~]# asmcmd afd_lsdsk
using grid user
asmca
Right Click on Disk Groups list then select Create
Create DB
# using oracle user
dbca
Patch DB
Node 1
Check
Run below command using oracle user
[oracle@rac1 tmp]$ cat /tmp/patch_db.txt
/tmp/33803476/33806152
/tmp/33803476/33815596
[oracle@rac1 tmp]$ $ORACLE_HOME/OPatch/opatch prereq CheckSystemSpace -phBaseFile /tmp/patch_db.txt
Oracle Interim Patch Installer version 12.2.0.1.30
Copyright (c) 2022, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /u01/19c/oracle/ora_base/db_home
Central Inventory : /u01/19c/grid/oraInventory
from : /u01/19c/oracle/ora_base/db_home/oraInst.loc
OPatch version : 12.2.0.1.30
OUI version : 12.2.0.7.0
Log file location : /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatch/opatch2022-06-08_00-33-16AM_1.log
Invoking prereq "checksystemspace"
Prereq "checkSystemSpace" passed.
OPatch succeeded.
Analyze
# analyze
[root@rac1 ~]# source /home/oracle/.db19_env
[root@rac1 ~]# $ORACLE_HOME/OPatch/opatchauto apply /u01/33803476 -oh $ORACLE_HOME -analyze
OPatchauto session is initiated at Wed Jun 8 00:40:20 2022
System initialization log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchautodb/systemconfig2022-06-08_12-40-25AM.log.
Session log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/opatchauto2022-06-08_12-41-03AM.log
The id for this session is 5UVE
Executing OPatch prereq operations to verify patch applicability on home /u01/19c/oracle/ora_base/db_home
Patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
Executing patch validation checks on home /u01/19c/oracle/ora_base/db_home
Patch validation checks successfully completed on home /u01/19c/oracle/ora_base/db_home
Verifying SQL patch applicability on home /u01/19c/oracle/ora_base/db_home
SQL patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
OPatchAuto successful.
--------------------------------Summary--------------------------------
Analysis for applying patches has completed successfully:
Host:rac1
RAC Home:/u01/19c/oracle/ora_base/db_home
Version:19.0.0.0.0
==Following patches were SKIPPED:
Patch: /tmp/33803476/33815607
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33575402
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33911149
Reason: This patch is not applicable to this specified target type - "rac_database"
==Following patches were SUCCESSFULLY analyzed to be applied:
Patch: /tmp/33803476/33815596
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_00-41-22AM_1.log
Patch: /tmp/33803476/33806152
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_00-41-22AM_1.log
OPatchauto session completed at Wed Jun 8 00:42:54 2022
Time taken to complete the session 2 minutes, 34 seconds
Apply
[root@rac1 ~]# $ORACLE_HOME/OPatch/opatchauto apply /u01/33803476 -oh $ORACLE_HOME
OPatchauto session is initiated at Wed Jun 8 00:44:46 2022
System initialization log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchautodb/systemconfig2022-06-08_12-44-52AM.log.
Session log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/opatchauto2022-06-08_12-45-12AM.log
The id for this session is RX22
Executing OPatch prereq operations to verify patch applicability on home /u01/19c/oracle/ora_base/db_home
Patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
Executing patch validation checks on home /u01/19c/oracle/ora_base/db_home
Patch validation checks successfully completed on home /u01/19c/oracle/ora_base/db_home
Verifying SQL patch applicability on home /u01/19c/oracle/ora_base/db_home
SQL patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
Preparing to bring down database service on home /u01/19c/oracle/ora_base/db_home
Successfully prepared home /u01/19c/oracle/ora_base/db_home to bring down database service
Bringing down database service on home /u01/19c/oracle/ora_base/db_home
Following database(s) and/or service(s) are stopped and will be restarted later during the session: prod
Database service successfully brought down on home /u01/19c/oracle/ora_base/db_home
Performing prepatch operation on home /u01/19c/oracle/ora_base/db_home
Perpatch operation completed successfully on home /u01/19c/oracle/ora_base/db_home
Start applying binary patch on home /u01/19c/oracle/ora_base/db_home
Binary patch applied successfully on home /u01/19c/oracle/ora_base/db_home
Performing postpatch operation on home /u01/19c/oracle/ora_base/db_home
Postpatch operation completed successfully on home /u01/19c/oracle/ora_base/db_home
Starting database service on home /u01/19c/oracle/ora_base/db_home
Database service successfully started on home /u01/19c/oracle/ora_base/db_home
Preparing home /u01/19c/oracle/ora_base/db_home after database service restarted
No step execution required.........
Trying to apply SQL patch on home /u01/19c/oracle/ora_base/db_home
SQL patch applied successfully on home /u01/19c/oracle/ora_base/db_home
OPatchAuto successful.
--------------------------------Summary--------------------------------
Patching is completed successfully. Please find the summary as follows:
Host:rac1
RAC Home:/u01/19c/oracle/ora_base/db_home
Version:19.0.0.0.0
Summary:
==Following patches were SKIPPED:
Patch: /tmp/33803476/33815607
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33575402
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33911149
Reason: This patch is not applicable to this specified target type - "rac_database"
==Following patches were SUCCESSFULLY applied:
Patch: /tmp/33803476/33806152
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_00-48-00AM_1.log
Patch: /tmp/33803476/33815596
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_00-48-00AM_1.log
OPatchauto session completed at Wed Jun 8 00:56:59 2022
Time taken to complete the session 12 minutes, 13 seconds
Node 2
Check
[oracle@rac2 ~]$ $ORACLE_HOME/OPatch/opatch prereq CheckSystemSpace -phBaseFile /tmp/patch_db.txt
Oracle Interim Patch Installer version 12.2.0.1.30
Copyright (c) 2022, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /u01/19c/oracle/ora_base/db_home
Central Inventory : /u01/19c/grid/oraInventory
from : /u01/19c/oracle/ora_base/db_home/oraInst.loc
OPatch version : 12.2.0.1.30
OUI version : 12.2.0.7.0
Log file location : /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatch/opatch2022-06-08_01-42-50AM_1.log
Invoking prereq "checksystemspace"
Prereq "checkSystemSpace" passed.
OPatch succeeded.
Analyze
[oracle@rac2 u01]$ su - root
Password:
[root@rac2 ~]# source /home/oracle/.db19_env
[root@rac2 ~]# $ORACLE_HOME/OPatch/opatchauto apply /u01/33803476 -oh $ORACLE_HOME -analyze
OPatchauto session is initiated at Wed Jun 8 01:33:33 2022
System initialization log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchautodb/systemconfig2022-06-08_01-33-40AM.log.
Session log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/opatchauto2022-06-08_01-34-03AM.log
The id for this session is RQSL
Executing OPatch prereq operations to verify patch applicability on home /u01/19c/oracle/ora_base/db_home
Patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
Executing patch validation checks on home /u01/19c/oracle/ora_base/db_home
Patch validation checks successfully completed on home /u01/19c/oracle/ora_base/db_home
Verifying SQL patch applicability on home /u01/19c/oracle/ora_base/db_home
SQL patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
OPatchAuto successful.
--------------------------------Summary--------------------------------
Analysis for applying patches has completed successfully:
Host:rac2
RAC Home:/u01/19c/oracle/ora_base/db_home
Version:19.0.0.0.0
==Following patches were SKIPPED:
Patch: /tmp/33803476/33815607
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33575402
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33911149
Reason: This patch is not applicable to this specified target type - "rac_database"
==Following patches were SUCCESSFULLY analyzed to be applied:
Patch: /tmp/33803476/33815596
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_01-34-26AM_1.log
Patch: /tmp/33803476/33806152
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_01-34-26AM_1.log
OPatchauto session completed at Wed Jun 8 01:36:08 2022
Time taken to complete the session 2 minutes, 36 seconds
Apply
[root@rac2 ~]# $ORACLE_HOME/OPatch/opatchauto apply /u01/33803476 -oh $ORACLE_HOME
OPatchauto session is initiated at Wed Jun 8 01:44:49 2022
System initialization log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchautodb/systemconfig2022-06-08_01-44-54AM.log.
Session log file is /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/opatchauto2022-06-08_01-45-12AM.log
The id for this session is 7F7L
Executing OPatch prereq operations to verify patch applicability on home /u01/19c/oracle/ora_base/db_home
Patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
Executing patch validation checks on home /u01/19c/oracle/ora_base/db_home
Patch validation checks successfully completed on home /u01/19c/oracle/ora_base/db_home
Verifying SQL patch applicability on home /u01/19c/oracle/ora_base/db_home
SQL patch applicability verified successfully on home /u01/19c/oracle/ora_base/db_home
Preparing to bring down database service on home /u01/19c/oracle/ora_base/db_home
Successfully prepared home /u01/19c/oracle/ora_base/db_home to bring down database service
Bringing down database service on home /u01/19c/oracle/ora_base/db_home
Following database(s) and/or service(s) are stopped and will be restarted later during the session: prod
Database service successfully brought down on home /u01/19c/oracle/ora_base/db_home
Performing prepatch operation on home /u01/19c/oracle/ora_base/db_home
Perpatch operation completed successfully on home /u01/19c/oracle/ora_base/db_home
Start applying binary patch on home /u01/19c/oracle/ora_base/db_home
Binary patch applied successfully on home /u01/19c/oracle/ora_base/db_home
Performing postpatch operation on home /u01/19c/oracle/ora_base/db_home
Postpatch operation completed successfully on home /u01/19c/oracle/ora_base/db_home
Starting database service on home /u01/19c/oracle/ora_base/db_home
Database service successfully started on home /u01/19c/oracle/ora_base/db_home
Preparing home /u01/19c/oracle/ora_base/db_home after database service restarted
No step execution required.........
Trying to apply SQL patch on home /u01/19c/oracle/ora_base/db_home
SQL patch applied successfully on home /u01/19c/oracle/ora_base/db_home
OPatchAuto successful.
--------------------------------Summary--------------------------------
Patching is completed successfully. Please find the summary as follows:
Host:rac2
RAC Home:/u01/19c/oracle/ora_base/db_home
Version:19.0.0.0.0
Summary:
==Following patches were SKIPPED:
Patch: /tmp/33803476/33815607
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33575402
Reason: This patch is not applicable to this specified target type - "rac_database"
Patch: /tmp/33803476/33911149
Reason: This patch is not applicable to this specified target type - "rac_database"
==Following patches were SUCCESSFULLY applied:
Patch: /tmp/33803476/33806152
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_01-48-09AM_1.log
Patch: /tmp/33803476/33815596
Log: /u01/19c/oracle/ora_base/db_home/cfgtoollogs/opatchauto/core/opatch/opatch2022-06-08_01-48-09AM_1.log
OPatchauto session completed at Wed Jun 8 02:32:30 2022
Time taken to complete the session 47 minutes, 41 seconds
[root@rac2 ~]#
Data Patch
[oracle@rac1 ~]$ $ORACLE_HOME/OPatch/datapatch -verbose
SQL Patching tool version 19.15.0.0.0 Production on Wed Jun 8 04:22:16 2022
Copyright (c) 2012, 2022, Oracle. All rights reserved.
Log file for this invocation: /u01/19c/oracle/ora_base/cfgtoollogs/sqlpatch/sqlpatch_217606_2022_06_08_04_22_16/sqlpatch_invocation.log
Connecting to database...OK
Gathering database info...done
Note: Datapatch will only apply or rollback SQL fixes for PDBs
that are in an open state, no patches will be applied to closed PDBs.
Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation
(Doc ID 1585822.1)
Bootstrapping registry and package to current versions...done
Determining current state...done
Current state of interim SQL patches:
No interim patches found
Current state of release update SQL patches:
Binary registry:
19.15.0.0.0 Release_Update 220331125408: Installed
PDB CDB$ROOT:
Applied 19.15.0.0.0 Release_Update 220331125408 successfully on 08-JUN-22 02.32.06.874332 AM
PDB PDB$SEED:
Applied 19.15.0.0.0 Release_Update 220331125408 successfully on 08-JUN-22 02.32.14.722388 AM
PDB PRODPDB1:
Applied 19.15.0.0.0 Release_Update 220331125408 successfully on 08-JUN-22 02.32.22.122060 AM
Adding patches to installation queue and performing prereq checks...done
Installation queue:
For the following PDBs: CDB$ROOT PDB$SEED PRODPDB1
No interim patches need to be rolled back
No release update patches need to be installed
No interim patches need to be applied
SQL Patching tool complete on Wed Jun 8 04:22:52 2022
[oracle@rac1 ~]$
Check Version
[oracle@rac1 ~]$ cat s.sh
sqlplus -s / as sysdba <<SQLset pages 100 lines 500
col comp_name for a40
col version for a15
col version_ful for a15
col status for a15
--col con_id for a10
select comp_name, version, version_full,status,con_id from cdb_registry order by con_id;
SQL
[oracle@rac1 ~]$ ./s.sh
COMP_NAME VERSION VERSION_FULL STATUS CON_ID
---------------------------------------- --------------- ------------------------------ --------------- ----------
Oracle Database Catalog Views 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Database Vault 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Real Application Clusters 19.0.0.0.0 19.15.0.0.0 VALID 1
JServer JAVA Virtual Machine 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle XDK 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Database Java Packages 19.0.0.0.0 19.15.0.0.0 VALID 1
OLAP Analytic Workspace 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle XML Database 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Workspace Manager 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Text 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Multimedia 19.0.0.0.0 19.15.0.0.0 VALID 1
Spatial 19.0.0.0.0 19.15.0.0.0 LOADING 1
Oracle OLAP API 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Label Security 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Database Packages and Types 19.0.0.0.0 19.15.0.0.0 VALID 1
Oracle Database Catalog Views 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Database Vault 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Real Application Clusters 19.0.0.0.0 19.15.0.0.0 VALID 3
JServer JAVA Virtual Machine 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle XDK 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Database Java Packages 19.0.0.0.0 19.15.0.0.0 VALID 3
OLAP Analytic Workspace 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle XML Database 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Workspace Manager 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Text 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Multimedia 19.0.0.0.0 19.15.0.0.0 VALID 3
Spatial 19.0.0.0.0 19.15.0.0.0 LOADING 3
Oracle OLAP API 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Label Security 19.0.0.0.0 19.15.0.0.0 VALID 3
Oracle Database Packages and Types 19.0.0.0.0 19.15.0.0.0 VALID 3
30 rows selected.
Manage Cluster Services
To manage cluster components and elements, oracle invented two tools that you can find them in the grid home under bin directory, which they help you to manage and control the cluster, the commands are crsctl and srvctl so what is the difference between them? and how we can use them?
Crsctl command is used to manage the elements of the clusterware (crs, css, evm to be more precise. There are other components of the clusteware such as OCR,voting disk, managed by other tools ) while srvctl is used to manage the elements of the cluster (databases,instances,listeners, services etc) . For exemple, with crsctl you can tune the heartbeat of the cluster, while with srvctl you will set up the load balancing at the service level. Srvtcl was introduced with Oracle 9i and crsctl was introduced with Oracle 10g and both have been improved since. There is sometimes some confusion among DBAs because both commands can be used to start the database, crsctl starting the whole clusterware + cluster, while srvctl is starting the other elements, such as database, listener, services, but not the clusterware. Somewhere in Oracle documentation 10g, it is written that Oracle corporation suggest you to use srvctl command to start the databases in the cluster.
# stop both nodes cluster services
# list help menu for command
crsctl -h
crs check -h
# enable auto start for HAS
crsctl enable crs
# check crs high avialability services are online
crsctl check crs
# will stop once node
crsctl stop crs # -f to force if the cluster is stuck
# stop all cluster services
# you need high availablity service (HAS) and CRS running on both nodes
crsctl stop cluster -all
crsctl stop cluster -n rac1/rac2
crsctl start cluster -all
crsctl start cluster -n rac1
# stop / start instance
srvctl stop instance -d PROD -i PROD2
srvctl start instance -d PROD -i PROD2
# status of database and services
srvctl status database -d prod
# check configuration of the services
srvctl config database -d prod
# modify the configuration of the service
# search for the option
srvctl modify database -h | grep -i pfile
# create service and remove it
[oracle@rac1 ~]$ srvctl add service -d prod -pdb prodpdb1 -service sales -preferred PROD1,PROD2
[oracle@rac1 ~]$ srvctl status service -d prod
Service sales is not running.
[oracle@rac1 ~]$ srvctl start service -d prod -s sales
[oracle@rac1 ~]$ srvctl status service -d prod
Service sales is running on instance(s) PROD1,PROD2
[oracle@rac1 ~]$ srvctl stop service -d prod -s sales
[oracle@rac1 ~]$ srvctl remove service -d prod -s sales
[oracle@rac1 ~]$ srvctl status service -d prod