ITC Enterprise Storage Facilities NAS, TSM and SAN

1
ITC Enterprise Storage Facilities -NAS, TSM and
SAN

• Presented By
• Syed Tariq Maghrabi
• Email stariq_at_kfupm.edu.sa

2
Session Discussion

• Enterprise Storage Roadmap and Goals
• Network Attached Storage
• Automated Backup Facilities
• Storage Area Network
• Discussion

3
Storage and its Importance

• Data is critical
• Users need uninterrupted and secure access to
  data (Payroll Data or SIS)
• Reliable storage backend needed
• Storage Application centric or User centric

4
Application-Centric Storage Management
5
Why are Storage Requirements Increasing?

• User Demands
• Network users today have an increasing appetite
  for large files which quickly eat up storage
  capacity
• Large graphics files, engineering CAD/CAM files,
• Imaging applications,
• Large databases,
• Internet growth and need to store e-mails
• Office suite and other data-intensive
  applications
• and much more

6
Plus new technology increases the need for
more storage

• Bandwidth of LANs has increased at least
  seven-fold over recent years
• Huge amounts of data are shuttled around the
  campus or over remote networks at high speed

7
Online Storage Facility

• Agenda for Discussion
• Chief motivation for Implementation
• What is Online Storage
• Features of Network Attached Storage
• Who is eligible to use this facility?
• How to use this facility?
• Data Protection
• Benefits

8
NAS Overview

• Network Attached Storage ( NAS)
• Preferred method of adding storage to a network
• Used for
• File sharing,
• On-line local or remote back-up,
• Internet and intranet data storage
• much much more

9
Network Attached Storage

• Connects Storage to Ethernet networks
• Designed for file sharing and data storage in
  local area networks
• High performance Disks used
• RAID protected
• Flexible and scalable

10
File System

• Storage Accessed over TCP/IP
• File Sharing using standard
• NFS,CIFS,HTTP etc
• File System handled by NAS unit

LAN
How does NAS work?
11
(No Transcript)
12
The KFUPM Filer

• Model F-820 from Network Appliance
• 1TB storage Capacity (Planned upgrade to 2TB very
  soon)
• Uses its very specialized operating System Data
  Ontap 6.3.1
• Multi-protocol Support
• Modes NT, UNIX, Mixed

13
Features

• Snapshot Technology
• A snapshot is a read-only image of the entire
  filer file system that reflects the state of the
  file system at a point in time
• Snapshot files carry the same permissions as the
  original file
• Every directory in the filer's active file system
  contains a directory named .snapshot, through
  which users can access old versions of files in
  that directory.
• Snapshots enable end-users to recover older
  versions of files that were accidentally changed
  or deleted

14
Features (Contd..)

• Quotas
• WAFL
• Auto Support
• NDMP Support
• RAID protection
• Variable RAID size
• Redundant components
• Scalable

15
Features for Users

• Faculty and Staff have been given 100MB of online
  storage.
• Users can save and access critical data
• Useful for online access of data from anywhere in
  KFUPM Network
• 25MB quota per Student
• Roaming Profiles of Faculty and students
• Important tool for data protection

16
Accessing the Filer

• KFUPM Win 2000 Domain users are given the storage
  as a network drive on logon
• Non Domain users need to map to the Filer
• Details on http//www.kfupm.edu.sa/itc/sos/nas/nas
  .htm

17
Drive Mapping Procedure
18
(No Transcript)
19
(No Transcript)
20
Antivirus Setup
21
File Backup Features on the Filer

• NDMP Based
• Uses TSM for Control
• Quantum Tape Library connection
• File Level Backup and Restore
• Ensures data protection

22
NAS- Recap

• Almost any machine that can connect to KFUPM
  network can use NFS or CIFS protocol to connect
  to the KFUPM Filer and share files.
• The Filer identifies data by file name and byte
  offsets, transfers file data or file meta-data
  (file's owner, permissions, creation data, etc.),
  and handles security, user authentication, file
  locking
• Allows greater sharing of information especially
  between disparate operating systems such as Unix
  and NT.
• File System managed by NAS head unit
• Backups and mirrors (utilizing features like
  NetApp's Snapshots) are done on files, not
  blocks, for a savings in bandwidth and time.

23
Advantages

• Faculty and Staff have been given 100MB of online
  storage.
• Useful for online access of data from anywhere in
  KFUPM Network
• 25MB quota per Student
• Roaming Profiles of Faculty and students
• Data fully protected from viruses
• Data Backed up regularly

24
Offline Backup and Recovery

• Agenda
• Need for Backup procedures
• Tivoli Storage Management KFUPM
• Automation of Backup Procedures
• Backup Schedules and Policies
• Tape Library
• Servers
• Advantages

25
Why do I have to backup?

• Data - The most crucial asset
• If anything can happen, it will
• Backup is necessary
• Insurance against human or unforeseen errors
• What is Backup?
• Copy of data
• Local - Copy to own device
• Remote -Copy to other device (Server or Tape)

26
What if we didnt backup??
27
KFUPM Backup Solution

• Requirements
• Full Automation
• UNIX, LINUX, and Win2000 client backup support
• No operator intervention for Tape Operations
• Single solution for all backup needs including
  SAN and NAS
• Solution Tivoli Storage Management

28
Architecture of TSM

• Database and Recovery Log
• Runs on-site on the AIX server
• Server is TSM 5.1.5 and Clients are 5.2
• Storage Pools
• All critical servers under this umbrella
• Crucial and important facility for data protection

29
(No Transcript)
30
Backup Features

• Automated, unattended schedules for WinNT/2000
  and AIX / Linux servers
• Disk storage pools fasten the backup process
• Incremental backups
• Tape Storage Pool Migration

31
Automation Features

• Client Schedules
• Database backup
• Tape reclamations
• Disk to tape data migration
• Inventory expiration

32
Backup Policy

• 1 Active and 4 inactive file versions, one
  deleted version
• Policies enforced based on domains
• Different domains for Unix and Win2000
• Dynamic update of policies as needed

33
Automated Tape Library

• IBM 3583 LTO Automated Tape Library
• Two 3580 LTO drives support simultaneous
  operations
• Up to 72 cartridges provide a maximum media
  capacity of 28.8 TB of compressed data.
• Aggregate sustained data transfer rate of up to
  1.4 TB per hour with 6 Ultrium 2 drives
• Cartridge capacity is 100GB (200GB compressed)

34
Some servers under TSM

• Active Directory Infrastructure servers
• AIX / Linux servers
• WebCT / Web-courses servers
• Network Services servers
• Web-servers and Smart Card Project Servers
• PM and Student Affairs servers
• Application Servers
• KFUPM Filer

35
Advantages

• Provides Centralized Backup and Recovery for 45
  critical University Servers
• Fully Automated, runs unattended
• Ensures Critical Data Availability
• KFUPM site data protection is assured with
  scheduled daily automated backups

36
KFUPM SAN
37
KFUPM High End Storage Requirements

• Provide a cost effective enterprise storage
  solution for all platforms, AIX, Linux, W2K,
  and z/OS
• Improve application responsiveness performance
  of DB2 backend based applications
• Eliminate the usage of unprotected disk for all
  servers in the
• enterprise
• Size disk to the application requirements
  eliminate wasted disk
• Deploy a technology that can grow with KFUPM
  needs on demand
• Improve the backup window for critical
  applications

38
Solution SAN

• SAN is a dedicated high performance network to
  move data between heterogeneous servers and
  storage resources
• A Fibre Channel based SAN combines the high
  performance of an I/O channel and advantages of a
  network
• Processes block I/O protocols like FCP (SCSI) or
  FICON
• When Fibre Channel switches are used in a SAN,
  the network is referred to as a fabric

39
SAN Concept
40
(No Transcript)
41
SAN components

• SAN servers
• Switches
• Storage Servers
• NAS Gateways
• Fibre Channel Adapters

42
Practical SAN setup
43
(No Transcript)
44
(No Transcript)
45
ESS Logical configuration steps

• Break up disk capacity into units to be
  externalized
• Unit is the LUN (Logical Unit Number)
• A LUN is all or part of an ESS disk group
• Associate LUNs with servers
• SCSI Both LUNs and servers are associated with
  an ESS SCSI host adapter port
• Fibre Channel LUNs are associated with server
  host bus adapters by Worldwide Port Name (WWPN)
• Tool used is ESS Specialist

46
Types of Logical ESS Disks

• There are 2 kinds of logical disks in an ESS
• S/390 Count-Key-Data
• Fixed Block
• There are 2 kinds of fixed block LUNs
• 512-byte block UNIX, Windows NT/2000
• 520-byte block AS/400

47

• KFUPM Site Layout
• 3.4 TB of RAID-5 protected storage
• 1TB of storage is allocated to the z/800 server
  in Mod-3 and Mod-9 volume formats
• 2.4 TB is available for Open System Servers like
  AIX, x440 Wintel Servers etc in LUN sizes of 85GB
  and 80GB.

48
Attachment

• z/800 server is connected to the ESS-800 via
  FICON
• Open System Servers are connected to the ESS-800
  either via NAS 300G Gateway or directly to the FC
  Switch F-16 or F-08
• Tape Library is connected to the switch via SAN
  DATA Gateway

49
SAN- Recap

• Only server class devices with Fibre Channel can
  connect to the SAN.
• The Fibre Channel of the SAN has a limit of 10km
• A SAN addresses data by disk block number and
  transfers raw disk blocks.
• File Sharing is operating system dependent and
  does not exist in many operating systems
• File System managed by servers
• Backups and mirrors require a block by block
  copy. A mirror machine must be equal to or
  greater in capacity compared to the source
  volume.

50
Benefits of SAN to KFUPM

• Physical Server consolidation
• Faster Transaction based applications (Example
  Mail, Registration)
• High performance FC delivers data at 200MBps
• Improved backup and recovery
• Flash copy up to 4 TB

51
Review

• Online Storage (Filer)
• Automated Backup Setup
• Storage Area Network
• Advantages for KFUPM

52

• Questions and Discussion