Title: Project Backup ,Recovery
1Project - Backup ,Recovery Storage Networks
- Prof Abuzneid
- Student Manohar R Goluguri (365728)
- Rong xu (469833)
2Backup Recovery
- Backup
- In general terms Backup means - to have a copy of
the data item somewhere else in case you
lose the original. - To ensure protection against accidental loss of
user data , database corruption, hardware
failures and even natural disasters\ - Job of an administrator to make sure that backups
are performed and backup tapes are stored in
secured location.
3- Recovery/restore
- Restore describes an operation that copies
backed- up data from secondary storage to
a primary storage device - Computing equipment is not perfect and primary
storage can fail .Data can be lost for other
reasons So when data is lost a restore will bring
back the last best copy of the data . - A combination of full and incremental backups
will restore most , if not all data.
4- Creating a Backup and Recovery Plan
- Data backup is an Insurance plan. Important files
are accidentally deleted all the time . Mission
-critical data can become corrupt. Natural
disasters can leave offices in ruins. A Solid
backup and recovery plan - helps in recovering the data from these
- Figuring out a backup plan
- Time consuming to create and implement backup
plan To figure out -- what data needs to be
backed up -- How often ? -
5To help create a plan following to be concidered
- How important is your data on your system
- Importance of data goes a long way in determining
whether backup is required or not and how it
should it backed up e.g. For critical data , such
as a database we may want to have a redundant
backup sets that extend the back up for several
backup periods For less important data , such as
daily userss file, elaborate backup plan is not
required. - What type of information does the data contain
- Data unimportant to one may be important to
someone else. Thus type of information the data
contains can determine if a backup is required
as well as when and how the data should be
backed up. -
6- What type of information does the data contain
- Data unimportant to one may be important to
someone else. Thus - type of information the data contains can
determine if a backup is - required as well as when and how the data
should be backed up. - How often does the data change.
- The frequency of change can affect your
decision how often the data - should be backed up. E.g. data that changes
daily should be backed daily - How quickly do you need to recover the data
- Time is an important factor in creating a
backup plan. For critical systems you may need to
backup online swiftly . To do this you will have
to alter your backup Plan -
7-
- Do you have equipment to perform backup
- You must have backup hardware to perform backups.
To perform timely backups you may need several
backup devices and several sets of backup media.
Backup hardware includes tape drives , optical
drives and removable disks - Who will be responsible for the backup and
recovery plan - Ideally someone should be a primary contact
for the organizations backup. This person will
also be responsible for performing the actual
backup and recovery of data. - What is the best time to schedule backups
- Scheduling backups when system use is as low as
possible will speed the backup process. However
you cant always schedule backups for off-peak
hours . So you will need to carefully plan when
key system data is backed up
8- Do you need to store backups off-site
- Storing copies of backup tape off-site is
essential to recovery of your - systems in case of a natural disasters. In
off-site storage locations - should include copies of the software required
to install for - reestablishing operational systems
-
9 Basic Types of Backup Many techniques
for backing up and the technique to be used
depends upon the type of data and how
convenient the recovery process to be.
Attribute called Archive in windows explorer is
used to determine whether a file or
directory needs to be backed up.If the attribute
is ON The file may need to be backed up .
The basic types are Normal/Full Backup All
files that have been selected regardless of the
setting of the archive attribute. When the a
file is backedup the archive attributed is
cleared If the file is later modified,attribute
is set which indicates that it needs backing up
10- Copy Backups
- All files that have been selected are backed
up , the archive attribute - on files is not modified.This allows you to
perform other types of - backups on the files at a later date
- Differential backups
- Designed to create backup copies of files
that have changed since the l - last normal backups. The presence of the
attribute indicates that the - file has been modified and only files with
attribute are backed up. - Incremental backups
- Designed to create backups of files that have
changed since the most - recent normal or incremental backup
- Daily Backups
- Designed to backup files the day the file has
been modified -
-
-
11- Generally in the backup plan full backup are
performed on weekly basis - and supplement this with daily , differential
or incremental backups. - Also can create an extended backups for
monthly and quarterly - that includes additional files that are not
backed up regularly - Difference between Differential and
incremental backup is extremely - important . Table shown is self explanatory
- Next Steps.See Slide no. 13
12 13- Selecting Backup devices and media
- Many tools are available for backing up data .
Some are fast and expensive - others are slow but very reliable . The backup
solution thats right for the - organization depends on many factors including
- Capacity
- The amount of data that you need to backup on
a routine basis. - Can the backup hardware support the required
load given your time - and resource constraints
- Reliability
- The reliability of the back up hardware and
the media . Can you afford - to sacricifice reliability to meet budget or
time needs ? -
-
14- Extensibility
- The extensibility of the backup solution .
Will this solution meet the - needs as the organization grows .
- Speed
- The speed with which data can be backed up
and recovered . Can - you afford to sacrifice speed to reduce
costs ? - Cost
- The cost of the backup solution. Does it fit
into the budget ?
15 Common Backup solutions Capacity, reliability,
extensibility, speed and cost are the issues
driving Backup plan. Understanding how these
issues affect the organization will help in
selecting an appropriate backup solution. Most
commonly used backup solutions include. Tape
drives Tape drives are the most commonly used
backup devices . Tape drives use magnetic tape
catridges to store data . Magnetic tapes are
relatively inexpensive but are not highly
reliable. Tape can break and stretch. They can
loose input overtime. The average capacity of
tape catridge ranges from 100 MB to 2 GB.
Compared with other backup solutions, tape
drives are fairly slow, still the selling point
is the cost.
16- Digital audio tape ( DAT ) drives
- DAT drives are quickly replacing standard
tape drives as the prefered - backup devices . DAT drives use 4mm to 8mm
tapes to store data - They are expensive than the standard tape
drives , but they offer more - speed and capacity .
- 4mm - 30MB/min and 16 GB capacity
- 8mm - 10 MB/min and 36 GB capacity
- Auto Load tape systems
- Auto loader tape system use a magazine of
tapes to create extended - backup volumes capable of meeting the high
capacity needs of the - enterprise.
- With an Auto loader system, the tapes with
the magazine are
17- Are automatically changed as needed during the
backup or recovery - process .Most auto loader tape system use DAT
tapes. Typically system - uses magazines with between 4 and 12 tapes. It
has high cost. - Magnetic optical drives
- Magnetic optical drives combine magnetic tape
technology with optical - lasers to create a more reliable backup
solution than DAT . Magnetic - optical drives use 3.5 inch and 5.25 inch disks
that look much similar - to floppies but are much thicker.Typically
magnetic optical disks have - a capacity between 1GB and 4GB
- Tape Juke boxes
- Similar to auto loader tape system.Juke boxes
are magnetic optical - disks rather than DAT tapes to offer high
capacity solutions. These -
18- Systems load and unload disks stored internally
for backup and recovery operation. High cost. - Removable Disks
- removable disks such as Iomega Jaz, are
increasingly used as backup - devices .Removable disks offer good speed and
ease of use for a - simple drive or single drive or single system
backup. However, the - disks drives and the removable disks tend to
be more expensive than - standard tape or DAT drive solution.
- Disk Drives
- Disk drives provide the fastest way to backup
and restore files . With - disk drives ,one can accomplish in minutes
what takes a tape drive - hours . So when business needs mandate a
speedy recovery nothing - beats disk drive. High costs and less
extensibility.
19- Buying and using tapes
- Selecting a backup device is an important step
toward implementing a backup and recovery plan.
But you will also need to purchase the tapes or
disks or both that will allow you to implement
your plan. The number of tapes you need depends
on how much data , how often and how long we are
backing the data . Always additional datasets
will come in handy. - Typical Way to use backup tapes is to set up a
rotation schedule whereby 2 or more sets rotated.
It increases tape longevity by reducing the tape
usage . - Most common Tape rotation schedule is 10 -tape
rotation . Table - Shows the 10 tape rotation using incremental
backups. This is meant 9 to 5 schedule around the
world. For 24x7 environment 14 tapes rotation
with 2 sets of 7 tapes is required.
20 21 RAID Technology ( Random array of independent
disks ) It groups individual disk drives into
a logical unit that functions as one or more
virtual disks. This can improve reliability ,
performance or both. RAID Uses parity data
or sidk mirroring to allow the disk array to
continue operating without loss of data after a
disk failure. After the failed disk is
replaced , the unit automatically rebuilds the
lost data in the RAID group from information
stored on the other disks in the group. The
rebuilt RAID group contains a replica of
information it would have held if the disk module
had not failed. This is the key component of
high availability.
22 There are different utilities that can be used
to bind modules into logical disk units (
called RAID Groups ) Industry has defined the
following RAID Levels RAID - 0 ( non-redundant
individual access array ) RAID - 1 ( mirrored
pair ) RAID - 1/0 ( mirrored pair ) RAID - 3
( parrallel access array ) RAID - 5 (
individual access array )
23Storage networks ( SAN )
- It is the newest concept and technology for
providing fast and reliable mass storage. SAN
meets todays need to store - enormous amounts of data and deliver the data at
tremendous speed It is fast, reliable and highly
scalable - Next generation high speed network architecture
- SAN Is identified by a special connection
architecture known as fiber channel - SAN is identified by one or more ( usually more
) servers connected to infinetely variable
number and arrangement of storage device by means
of fibre channel , hubs, switches, bridges.
24 - A san topology has three distinct features
- Storage is not directly connected to network
clients - Storage is not directly connected to the servers
storage devices are - interconnected
- A distinguishing feature of the storage area
network is the wealth - of storage devices that can be attached to SAN
. - Connection technology for SAN is fibre channel
- Current speed of fibre channel is 1 Gbps
- Plans to increase speed upto 4 Gbps
- Fibre channels can connect devices over
relatively long distances - upto 500m between device and hub upto 10
km between hubs
25 Storage networks
- Connectivity and scalability
- Todays computer systems environments are
very limited in the number - of devices that can be connected together and
also limited in that - configurations do not easily allow the
introduction of new technology, - protocols
- Fiber channel addresses these issues by
allowing - 2 to over 16 million ports that can be
concurrently logged into a - fabric with a 24 bit address identifier.
- Introduction of new technology like laser
light - transportation of different protocols
simultaneously -
26Types of backups
- Memory data backup
- The simplest example of back up is to save the
data in an applications memory to a file. The
file can be a simple application data file, a
database, or a system storage such as registry or
directory storage like Active Directory. We dont
normally call this backup, but the idea is the
same, and the line can be blurred considerably.
For example, PDA devices usually dont have a
disk, and the application data is stored in
memory and later backed up to the disk of an
external system such as a PC.
27 Types of backups
- Application File data backup
- The application files are normal visible files
stored in a location that you can easily access.
You use the application to open the file and work
on it. Youd want to back the files up in case
the system crashes. - Application program backup
- This means to make a copy of the application
installation disk(s). - Database backup
- A Database, depending on the database management
system (DBMS), can be stored in one file or
multiple files. On the other hand, multiple
databases can be stored in one file or one set of
files. Database backup the file(s) used by the
database.
28Internet-based storage and backup
- Now many companies offer internet based PC
management, data storage and backup - Relation between Backup and network
- Backup is normally divided into two large
categories, local and network. The distinction is
not always clear, especially with mainframe
systems. The channel extension technology shows
that the originally limited channels between the
system and its storage devices, somewhat like
cables connected to a computer.
29Critical Data Backup (CDB)
- Optimized for Internet access with line speeds as
low as 28.8 Kbps - State-of-the-art security
- Fully automated backups and restores
- Uses the same technology employed by many of the
world's largest companies - Supports Windows 95, 98, ME, NT, 2000
30What does Channel Extension do?
- Data processing centers manage information and
applications that are essential for daily
business interaction. - Documents need to be processed.
- Statements need to be printed.
- data needs to be stored off-site.
- Users need to access data housed on host
resources.
31What does Channel Networking do?
- Channel networking overcomes cable limits
for mainframe channel-attached devices. It
enables peripherals like printers, check sorters,
and graphics terminals to be located far from
their hosts, with little or no performance
penalty. It includes - Channel to channel extension
- The use of channel networking
- Channel networking solution
- Channel networking applications
32Channel to Channel Extension
- Two host systems to communicate directly, but
cable distance limitations require the systems to
be in the same data center. - Two hosts far apart can be connected for high
volume data transfer if they were located in the
same facility. - Channel extension can mix and match older
computer system with incompatible channels to
extends their useful life.
33Channel networking Features
-
- Guaranteed data deliver (CRC checking)
- No distance limitations
- Shared data links for extension applications
- Protocol conversion for ESCON, Bus-and-Tag,
SCSI, etc. - Sophisticated network management
- Peripheral connectivity options (printers,
graphics terminals, - digital imaging, etc.)
- Dynamic alternate paths to eliminate disruptions
- Remote dial-in support
34The use of channel networking
- Channel networking includes
- Data center consolidation
-
- Distributed processing
- Outsourcing
- Mainframe to mainframe connections
- Peripheral extension
35Channel extension connections
- Optical fiber channel connections transmit over
multimode fiber, which sends data over multiple
paths for distances within 2 miles. - Channel extenders transmit over single mode
fiber, which sends data over a single path for
distances of up to or more than 18 miles. - The channel extender increases the distance of
possible connections.
36SCSI Extender fiber Channel Converter
- Used in several applications involving the
transfer of data between fiber channel and SCSI
devices - Full Fiber Channel Compliance.
- Disk Tape Device Support.
- Standard SNMP with RJ45 connection
- to 10Base Ethernet LAN provides
- connectivity management.
- Ethernet or Serial Configuration.
- Easy remote/local setup and firmware
- upgrades.
378200 Channel Extension System
- Drives remote host peripherals at rated speed
regardless of distance. - Provide a high level of system redundancy
ensuring that critical applications are always
available. - Allows the data center manager to remotely access
diagnostic and performance data. - Provides the ability to be proactive in network
diagnostic efforts by transmitting alarm traps
anywhere in the world.
38Enterprise Systems Connection (ESCON)
- A set of IBM and vendor products that
interconnect S/390 computers with each other and
with attached storage, locally attached
workstations, other devices using optical fiber
technology and dynamically modifiable switches
called ESCON Directors - ESCON, Fiber Channel, and SCSI 3 alternative
technologies used in SAN (storage area network).
39Back Recovery Software
- Backup for UNIX and NT systems
- Many different utilities are available
- Developed by University of Maryland . It is as
advanced as a - free backup utility gets , and has a large
user community. - It allows you to set up a single master backup
server to backup - multiple hosts to a single backup drive.
- It can backup a large number of workstations
running multiple - versions of Unix
40- afbackup
- - It is a cleint server backup system
allowing many - workstations to backup to a central
server . - - It can backup simultaneously or serially
- - Backups can be started from a remote
server or by - running cron jobs on the clients.
- - Any streaming device including a disk
partition acting - as a virtual tape can be used as a
storing device. -
-
41 hostdump.sh - Used to make a quick backup
prior to making any modifications to a
clients server. - All you need to do is to
specify the following and it does the rest
- which device to use - what level of
backup to perform - a logfile to log to
- one or more servers to backup up - It
automatically parses the fstab/vfstab files and
detects all locally- mounted filesystems.
Itf the filesystem supports dump ( or some
variation of it ) it will use dump. If not,it
will use cpio - Builds a complete table of
contents of what it is about to backup - Adds
the text file to the front of the tape - After
completion of the backup it rereads the tape and
places complete file listing of all file
systems as the last file on the tape
42- Kbackup
- A GUI -driven backup tool for UNIX. Among its
many features are - User friendly, menu driven interface
and command line interface for - inclusion in automated scripts
- High reliability , thanks to using long
established tools like afio or tar -
- automated unattended backups
- full or incremental backups
- support for tape drives , floppies or
removalble media, remote backup - across networks
- Support for compression, encryption and
double buffering -
43Free Backup recovery utilities
- Some other Free Backup recovery utilities
- BURT - Is an extension for Tcl/Tk 8.0
designed to perform - backups to and recoveries from
tapes - rsync - It is an open source utility that
provides fast - incremental file transfer .
- CD Backup - especially designed for making
automated - backups and storing
them on CD-Rs - Taper - Taper is a user friendly archive
program especially - designed for backing up to
tape drives - Also Supports backing up to
files on a hard disk
44Backup Informix,Oracle Sybases
- Oraback.sh Automates hot backup and recovery
of Oracle 7.x and 8.x - databases to disk or
tape using oracles alter tablespace - begin backup commands .
Supports around 30 Unix flavours - syback.sh Automates hot backup and
recovery of sybase 11.x database - to disk or tape using
Sybase s dump database command. - Also supports around 30
Unix flavours - infback.sh Automates hot backup and recovery
of informix 5.x-7.x - database using
tbtape/ontape . -
-
45Record System Configuration for disaster Recovery
- Do you have a clue what the configuration of the
box was before it caught fire? - Tools below will help to save that kind of
information - Duplicate.sh
- Supports only Solaris systems . Presents an
alternative to mirroring root - drive . It creates a standby root mirror
,automatically copying the current - root drive to an alternative drive. It then
sets the boot disk NVRAM - parameter to cause the server to alternate
which disk it boots from.This - way while installing a new piece of software
the system automatically - boots off the alternative drive when it comes
back. Better way to mirror the
root drive. -
46The SysAudit Utility
- The SysAudit Utility discovers and records
system configuration - information such as
- Disk partitioning information
- Volume manager configuration
- File system configuration
- It records this information in a file that can
later be cross checked against current
configuration.
47The Sysinfo Utility
- Supports several different Unix Platforms .
- It displays various types of information about
a hosts hardware and - operating system hardware .
- It is intended to provide information in both
human readable and program - parsable formats
- System admin use Sysinfo to obtain hardware
asset information and OS - configuration information
- e.g. Host name
- Host name aliases
- Host network addresses
- Host id etc.
-
48Bare -metal recovery
- When Operating system drive is destroyed , the
only choice is a bare -metal - recovery
- Bare-metal tools are already available in the
following Unix Flavours - AIX, IRIX, True-64 Unix, HP-UX
- Solaris Linux systems requires
indivduals to come up with own - utility
- Custom Utilities can also be made for AIX,
IRIX, True-64, HP-UX.
49Commercial Backup Software Automation Tools
- My Legato Networker tools
- These tools include an improved bootstrap and
failed backup - reporting script and tools to automate
library automations . - My Veritas Netbackup tools
- These tools include a calander based scheduler
, a script to - turn the data format into a human -readable
date, and tools to - automate libarary operations
50Storage Area Network Vendors
- Fibre channel Host Bus Adapters ( HBAs )
- Atto
- Emulex
- Qlogic
- JNI
- SCSI-to Fibre Routers Vendors
- Atto
- Crossroads
- Chaparral
51Fibre Channel Hub/Switch Vendors
Ancor Compaq Brocade
EMC Emulex Veritas Gadzooks
Xiotech Inrange JNI Mcdata Prisa
Storagetek Vixel