Dell | Oracle Rapid Deployment Techniques on Linux Ravi Kumar Dell Inc.

1
Dell Oracle Rapid Deployment Techniques on
LinuxRavi KumarDell Inc.
2
Agenda

• Oracle Rapid Deployment Techniques
• Pre OS tasks
• OS installation Red Hat Linux
• Pre Oracle tasks
• Oracle installation
• Post Oracle tasks
• Dell Deployment Kit
• Deliverables
• Testing
• Drill down

3
Oracle Rapid Deployment Techniques
SKIP
4
Pre OS - Tasks

• You are deploying an integrated system
• Read the Oracle documentation
• Make deployment choices
• Oracle 9i RAC DB raw partitions or OCFS for
  shared storage?
• Oracle Collaboration Suite Storage
  infrastructure, storage use existing OID, DB,
  etc, or deploy new servers.
• Select and implement a hardware topology Ex
  RAC
• Gather system components
• Supported Oracle software, patches, etc.
• OS software, errata updates, etc.
• Hardware components servers, switches, HBAs,
  disks, cables, etc.
• Check Oracle minimum/recommended hardware
  requirements
• Ensure latest supported BIOS, firmware, drivers.

Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
5
Example RAC HW Topology Direct Attach - SCSI
1 Gbps
Server
Server
NIC
NIC
PERC
PERC
160 Mbps
SCSI Enclosure
X-over Cable
SCSI Cable
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
6
Example RAC HW Topology Direct Attach
Fiber Channel
1 Gbps
Server
Server
NIC
NIC
HBA
HBA
2 Gbps
SAN
X-over Cable
FC Cable
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
7
Example RAC HW Topology SAN (Basic)
1 Gbps
Ethernet Switch
Server
Server
NIC
NIC
HBA
HBA
2 Gbps
FC SWITCH
SAN
GigE Cable
FC Cable
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
8
Example RAC HW Topology SAN (Redundant)
Ethernet Switch
1 Gbps
Server
Server
NICs
NICs
HBAs
HBAs
Ethernet Switch
2 Gbps
FC SWITCH
FC SWITCH
SAN
GigE Cable
FC Cables
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
9
OS Installation - Tasks

• OS installation must
• Follow IT environment guidelines for deploying
  Linux hosts
• Update kernel and other OS errata, both for
  Oracle functionality and OS robustness, for
  example
• binutils, pdksh 9iAS
• e25 kernel, pdksh 9i RAC
• Update hardware drivers, for example
• megaraid, qla2300_6x, bcm5700, e1000
• Partition boot drive (Oracle product specific),
  for example
• swap, /, /usr, /var, /tmp, /home, /opt, etc.

Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
10
OS Installation CD-ROM

• OS installation can be achieved via
• OS CD-ROM based install
• PXE based network install
• Redeployment partition

Familiar process Slow / manual
Some ks.cfg automation Post-OS manual (errata packages, drivers)
Install time flexibility Inconsistency between servers
CD-ROM based install
/ (sda1)
/usr
/var
/home
/opt/oracle
/tmp
swap
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
11
OS Installation Network

• OS installation can be achieved via
• OS CD-ROM based install
• PXE based network install
• Redeployment partition

Rapid deployment Network issues
ks.cfg automates Post-OS Infrastructure setup
Reusable
Network install
/ (sda1)
/usr
PXE / DHCP Server
/var
/home
/opt/oracle
/tmp
swap
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
12
OS Installation - RP

• OS installation can be achieved via
• OS CD-ROM based install
• PXE based network install
• Redeployment partition

Reusable partition Uses up local disk space
ks.cfg automates Post-OS More work to setup
Rapid redeployment
RP based install
RP (sda1)
/
/usr
/var
PXE / DHCP Server
/home
/opt/oracle
/tmp
swap
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
13
OS Installation RP Details

• Dell recommends the use of a redeployment
  partition
• The RP can be created via CD-ROM, network, or
  imaging
• RP enables rapid redeployment
• RP ensures consistent install on all servers (IT
  compliance, RAC)
• Enables scale out (grid) computing from the OS
  layer
• Key difference w/ Network-based is self-reliance

Traditional Partitioning
RP Partitioning
/ (sda1)
RP (sda1)
/usr
/
/var
/usr
/home
/var
/opt/oracle
/home
/tmp
/opt/oracle
swap
/tmp
swap
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
14
OS Installation RP Contents 1

• RP must be the first partition on bootable drive
  i.e., /dev/sda1 or /dev/hda1
• Use standard DOS style MBR and mark RP partition
  active
• RP directories
• /boot Contains grub / lilo boot loader
• /linux Contains kernel (vmlinuz) and ramdisk
  (initrd)
• /ks.cfg RH Kickstart configuration file,
  contains RH install information such as
  partitioning, network setup, X-windows setup,
  etc.
• /Oracle Contains Oracle Product Disks
• /RedHat Contains RedHat OS Disks

Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
15
OS Installation RP Contents 2

• RP directories contd
• /custom/scripts Scripts that can be called from
  ks.cfg (post)
• /custom/rpms RPMS for errata, drivers etc,
  installed from a script in ../scripts
• /custom/files Files (.tar, .gz, .txt etc),
  needed during installation

ks.cfg post /custom/scripts contents
mkdir p /mnt/RPmount /dev/sda1 /mnt/RPcd /mnt/RP/custom/scriptsfor SCRIPT in ls do ./SCRIPTdone 10-switch-active.sh 20-install-rpms.sh 30-apply-patches.sh 40-configure-network.sh
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
16
Pre Oracle - Tasks

• Pre Oracle must
• Configure network
• Configure NICs in server for interaction with
  Network environment.
• Update kernel parameters in /etc/sysctl, for
  example
• shmmax, shmmin, files-max, etc.
• Create Oracle user, group, Oracle directories and
  permissions. For example
• Users ias, oracle
• Groups oinstall, dba, ias_admin
• Homes /opt/oracle/home, /home/ias, /u01/oracle
• Set parameters in root/oracle user profiles, for
  example
• ORACLE_HOME, TMP, TMPDIR
• Tweak linux configuration, for example
• Remove ldap and ldaps from /etc/services for 9i AS

Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
17
Pre Oracle - Manual

• Pre Oracle tasks can be
• Manual
• Script-based
• Script-based kicked off during OS install ks.cfg
  post

Flexible Slow
Interactive Inconsistency between servers
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
18
Pre Oracle Script-based

• Pre Oracle tasks can be
• Manual
• Script-based
• Script-based kicked off during OS install ks.cfg
  post

Automated Less flexible
Non-interactive Output to Log Non-interactive
Consistent install for multiple servers Scripts have to be delivered to server
Enables Grid Scripts must be developed / tested
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
19
Pre Oracle Script-based

• Pre Oracle tasks can be
• Manual
• Script-based
• Script-based kicked off during OS install ks.cfg
  post

Automated Least flexible
Non-interactive Output to log Non-interactive
Hook into RP or network-based install Scripts must be developed / tested
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
20
Oracle Installation - Tasks

• Oracle Installation must
• Install any pre-Oracle product services
• Oracm, gsd (RAC)
• Install Oracle
• RAC, SN DB, 9i AS, Collaboration Suite
  (Infrastructure, Storage, and Middle tier), 11i,
  etc.
• Apply any patch sets
• Update OUI (if necessary)
• Apply patch set(s)
• Apply other hot fixes
• Validate ORACLE_HOME and other environment
  variables in Oracle user profile

Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
21
Oracle Install - Manual

• Oracle installation tasks can be
• Manual
• Script-based
• Script-based kicked off during OS install ks.cfg
  post

Flexible Slow
Interactive Inconsistency between servers
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
22
Oracle Install Script-based

• Oracle installation tasks can be
• Manual
• Script-based
• Script-based kicked off during OS install ks.cfg
  post

Automated Less flexible
Non-interactive Output to Log Non-interactive
Consistent install for multiple servers Scripts have to be delivered to server
Enables Grid Scripts must be developed / tested
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
23
Oracle Install Script-based

• Oracle installation tasks can be
• Manual
• Script-based
• Script-based kicked off during OS install ks.cfg
  post

Automated Least flexible
Non-interactive Output to log Non-interactive
Hook into RP or network-based install Scripts must be developed / tested
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
24
Post Oracle - Tasks

• Automate some tasks
• Scripts
• OUI response files

• Post Oracle tasks
• Configure Oracle services
• Create a new database (RAC, DB)
• Load servlets, jsps, html, etc. (9iAS)
• Configure Linux boot behavior
• Configure Oracle services to startup at boot
• Create other users
• Collaboration suite users, DB users, etc.
• Test Oracle services functionality
• Tune Oracle services for performance

Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
25
Oracle Deployment Techniques Summary
Post Oracle
OS install
Pre Oracle
Oracle Install
Manual
Manual
Manual
Manual
Script
Network
Pre OS
Script
Script
RP
Script
Script
Techniques
Kit
Pre OS
OS Install
Pre Oracle
Oracle
Post Oracle
26
Dell Deployment Kit
SKIP
27
Dell Test MethodologySolution Components
Oracle Test Focus
Oracle Database
Database
OS/OCFS versions
Red Hat AS Updates/Major Release N and/or OCFS N
Red Hat AS Updates/Major Releases N-1 and/or OCFS
N-1
Servers
PE2650, 4600, 6600, 6650
PE2650, 4600, 6600, 6650, 8450
PERC 3/DC
PERC 4/DC
QLA2342
QLA2340
QLA2310
HBA / RAID
Switch
DA
SW3800
SW3200
PV220S U320
PV220S U160
Storage
CX200
FC4700-2
CX600
CX400
EMC Test Focus
Techniques
Kit
Test
Deliverables
Drilldown
28
Dell Test Methodology

• Dell performs comprehensive tests on 9i RAC
  Clusters of 2-8 nodes and 9i DB Single Node
  products
• Level 1 Testing Functionality Testing
• Integration Testing Ex Oracle OCFS Power
  Path
• Functional Testing Ex Install Wizard and
  Configuration Wizard
• Bounds / Coverage testing
• Documentation testing
• Level 2 Testing Integration Testing
• Performance / stress testing
• Multiple Configurations Ex 2x2650, 4x6650,
  8x8450, CX200, CX400, CX600 etc.,
• Destructive testing while running stress Ex
  Power Path, Private interconnect
• Documentation testing

Techniques
Kit
Test
Deliverables
Drilldown
29
Deployment Kit drilldownWhat does it do for the
User?

• Provides a Dell certified and tested software
  stack for a tested hardware stack. Customers
  know that this exact software combination that
  has been tested in combination with the hardware.
• This CD Kit Performs a turnkey installation
  (eliminates need for manual OS, and Oracle
  install).
• Creates a redeployment partition which installs
  the system quickly and reduces redeployment time
  and complexity.
• Installs/configures/updates the OS Red Hat
  Linux.
• Installs/configures/updates Oracle 9i R2
  Database (RAC and SN).
• Provides configuration wizards for Oracle
  configuration.

Pre OS
OS Install, Pre Oracle, Oracle
Post Oracle
Techniques
Kit
Test
Deliverables
Drilldown
30
Deployment Kit drilldownInstall Wizard
Operation 1
Dell PowerEdge 2650
F2 setup
DELL
Techniques
Kit
Test
Deliverables
Drilldown
31
Deployment Kit drilldownInstall Wizard
Operation 2

• Server has blank drives
• Server is running OS from CD
• Embedded Environment

Installation and Deployment Media Build
23006 Initializing Installation . . . Please
wait. . . 1 Dell Certified Config 2.3 for
Oracle 9i Release 2 Single Node Only 2 Dell
Certified Config 2.3 for Oracle 9i Release 2
With Cluster Option 3 Abort Installation 4
Command Prompt (rescue mode) Enter the number of
the solution that you would like to install
Techniques
Kit
Test
Deliverables
Drilldown
32
Deployment Kit drilldownInstall Wizard
Operation 3

• Red Hat Linux CDs are inserted

Enter the number of the solution that you would
like to install Insert Advanced Server CD 1
got cd.. Insert Advanced Server CD 2 got
cd Insert Advanced Server CD 3 got cd.
The Red Hat CDs are copied to the
Redeployment Partition (RP).
Techniques
Kit
Test
Deliverables
Drilldown
33
Deployment Kit drilldownInstall Wizard
Operation 4

• The Oracle CDs set are inserted.

Enter the number of the solution that you would
like to install Insert Oracle CD 1 got
cd.. Insert Oracle CD 2 got cd Insert
Oracle CD 3 got cd.
The Oracle CDs are copied as ISOs into the
Redeployment Partition (RP).
Techniques
Kit
Test
Deliverables
Drilldown
34
Deployment Kit drilldownInstall Wizard
Operation 5

• System Reboots.
• Begins reading dynamically
• generated Red Hat kickstart file.

Language fr_FR, de_DE Hard Drive Partitions /
growable /tmp /var /home PACKAGES post /updates/
kickstart2.sh
Techniques
Kit
Test
Deliverables
Drilldown
35
Deployment Kit drilldownInstall Wizard
Operation 6

• System Reboots.
• Begins reading dynamically
• generated Red Hat kickstart file.

runInstaller
9.2.0.1
9.2.0.2
Techniques
Kit
Test
Deliverables
Drilldown
36
Deployment Kit drilldownPost Install Operation

• Before the reboot, the Post-Install executes a
  number of scripted tasks
• Install of Kernel
• Drivers
• Install of Oracle
• Modifications to the system
• Etc.

9.2.0.2
Techniques
Kit
Test
Deliverables
Drilldown
37
Deployment Kit drilldownConfiguration

• After reboot, system is ready to be configured
  (Post Oracle)
• Configuration Wizard for raw partitions
• Scripts / instructions for OCFS

9.2.0.2
Techniques
Kit
Test
Deliverables
Drilldown
38
Dell Deployment Kit Summary
Post Oracle
OS install
Pre Oracle
Oracle Install
Manual
Manual
Manual
Manual
Script
Network
Pre OS
Script
Script
RP
Script
Script
Techniques
Kit
Test
Deliverables
Drilldown
39
Q AThank You