A Technical Look at Adabas 2006

1
A Technical Look at Adabas 2006

• Becky Albin
• Chief IT Architect
• Software AG
• Becky.Albin_at_softwareagusa.com

2
Product Portfolio
Open Standard Access
Data Replication Distribution
Database Administration
Productivity and Performance Products
Event Replicator for Adabas
SQL Gateway
Adabas Manager
Delta Save
Adabas Vista
Adabas Online Systems
SOA Gateway
Cluster Services
Adabas Review
Parallel Services
Fastpath
Adabas Statistic Facility
Adabas Base Technology Adabas v8.1 - Mainframe
(z/OS, VSE, z/OS.e, VM, BS2000, MSP) Adabas v5.1
UNIX, Linux, OpenVMS and Windows
Mainframe platforms only
3
Adabas Big Picture - Proven Performance
Enterprise-wide Interoperability
Application
Java
.NET
3GL
Natural
Cross-platform
Tamino XML Server
Data Management
Administration
Data Access
Text Retrieval
SQL
Java
XML
SOA
Security
Cluster
External e.g. RACF

• Availability
• Load Balancing

Monitoring
Performance

• Partitioning
• Save/Restore

Data Organization
Statistics
Windows, Unix. Linux, Mainframe
Utilities

• Replication
• Transaction

Data Distribution
VSAM
DL/1
DB2
Apps
4
(No Transcript)
5
Adabas Projects
6
Adabas Projects

• Event Replicator for Adabas (VSE in beta)
• Event Replicator for Adabas (Open Systems)
• Data Archiving
• Search Engine
• Encryption
• High Availability/Clustering (Open Systems)
• Adabas VISTA (Open Systems)

7
Event Replicator for Adabas on Open Systems
Windows

Event Replicator Designer
Event Replicator Designer GUI
Linux, Windows, HPUX, AIX, Solaris
Data Dictionary
SQL Gateway
Adabas v6.1 for Open Systems
Linux, Windows, HPUX, AIX, Solaris
DBID 1
DBID 15
DBID 100

Message Queue
Event Replicator Server
Event Producer
Event Replication Engine
Target Database
Data Dictionary
SQL Gateway
8
Adabas SQL SOA Gateways
9
SQL SOA The Big Picture
10
Adabas v8.1for Mainframes
11
Adabas v8
Rule

• An Adabas V8 nucleus will support and execute all
  features as supported by a V74 nucleus

12
Adabas v8

• New Features
• Lifting Repeating Field Limits
• Lifting Record Limits
• Lifting Extent Limits
• New Field Formats
• Enhanced Direct Call Interface
• Adabas System Manager

13
Adabas v8 Lifting Limits - MU/PE limits

• Lifting Repeating Field limits MU/PE limits
• Increase to 2 bytes - 191 to 65,534 occurrences
• Actually 4 bytes potentially allowing 2 billion
  occurrences
• Occurs at the file level
• Count field in Index Block increased by three
  bytes
• Re-invert required for PE descriptors
• New Hyper-exit required for expanded MU/PE count
• HEXV8V7 module for Hyper-exit conversion for non
  MUPEX files
• Link with existing Hyper-exit

14
Adabas v8 Lifting Limits - MU/PE limits

• Lifting Repeating Field limits MU/PE limits
• Occurs at the file level
• Increase to 2 bytes - 191 to 65,534 occurrences
• Actually 4 bytes potentially allowing 2 billion
  occurrences
• Count field in Index Block increased by three
  bytes
• Re-invert required for PE descriptors
• Modification of Hyper-exit required for expanded
  MU/PE count

15
Adabas v8 Lifting Limits - MU/PE limits

• Lifting Repeating Field limits MU/PE limits
• Response Code 55, sub-code 9 if gt 191 occurrences
  and Format Buffer has only 1 byte
• Compressed Data Storage Record layout for MU/PE
  fields
• xC0 gt 191 occurs of MU/PE
• Byte indicating of count bytes
• Count bytes
• ex xC0020204
• 516 occurrences

16
Adabas v8 Lifting Limits - MU/PE limits

• Lifting Repeating Field limits MU/PE limits
• May result in
• Larger records not fitting into one data storage
  block or
• LWP (Work Pool) size definition may need to be
  increased to accommodate the update a higher
  count of occurrences.
• LP (WORK Part 1) size definition may need to be
  increased to accommodate the large number of
  occurrences.
• PLOGSIZE may need to be increased to accommodate
  the large number of occurences
• LFP (Internal Format Pool ) size definition may
  need to be increased because the Internal Format
  Element has increased. The total format may be as
  large as 2G.

17
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Large Record Support
• Compressed Record may exceed one physical Data
  Storage Block
• Optional feature that is set at the file level
• Simple Spanned Records supported
• Primary Record and 4 Secondary Segments/Records

18
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Large Record Support
• Logical record will be split at the field level
• Data Storage will reflect an Expanded Record
• Primary Record allocated as always
• Secondary Records allocated with different AC
  extents
• Secondary ISN allocation transparent to the
  application
• FCB to reflect both AC allocations
• Impact on the FCB for AC allocations
• Segment of a logical record may be read/updated
  independent of other records
• Index structures only contain primary ISN

19
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Large Record Support

20
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Simple Large Record
  Support

AC
FCB
Data
Secondary Address Convertor
AC2
AC1
AC
Primary Address Convertor
 
Contiguous blocks
OR
Non contiguous blocks
 
 
 
 
21
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Large Record Support
• Physical sequential commands will automatically
  skip the secondary records in the data storage.
• Read by ISN will be unaffected
• Primary records are included in TOP-ISN and
  MAX-ISN.
• Maximum Record Length, specified for a file, will
  have no relevance for file supporting this
  feature.
• Utilities that report on maximum record length
  will now state n/a.
• ISN settings for the utility (e.g. MIN-ISN option
  with Load) will refer to the primary ISNs only
  (NOT secondary)
• Primary ISNs will be counted from MINISN to
  MAXISN, and secondary ISNs will be counted from
  MINSEC to MAXSEC (MAXISN2)
• A larger NH and NISNHQ parameter may be needed

22
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Large Record Support
• Segmentation is done at field level
• Segmentation by byte is done for long alpha
  fields and long wide fields
• All utilities that use compressed or uncompressed
  data are enhanced to support spanning of the
  logical record across multiple records on the
  operating system files
• ADAULD UNLOAD retains SPAN attribute
• Increased space is needed to store both the BI/AI
  and DVT of a spanned record
• This can also be for several update threads
  running in parallel
• LWP/PLOGSIZE/LP

23
Adabas v8 Lifting Limits Large Record Support

• Lifting Record Limits Large Record Support
• Data Storage Spanned Record Header
• 2 bytes Inclusive Length of this segment
• 4 bytes reserved
• 4 bytes Current ISN
• 2 bytes Record Indicator Primary (x0081)/Segment
  (x0041)
• 4 bytes ISN next Segment
• 4 bytes ISN Primary ISN
• Data Storage Non-Spanned Record Header
• Same as always
• 2 bytes Inclusive Length
• 2 bytes x0004

24
Adabas v8 Lifting Limits - Large Object Field
Types

• Lifting Field Limits Large Object Field Types
• Single field up to 2G in size (2,147,483,643
  bytes)
• Store/Retrieve an entire LOB
• Defined as ZERO length
• Binary and Character LB fields
• Fields may contain any type of date, example
• Jpegs
• AVI files
• PPT, XCL
• Large documents
• Images
• Fingerprints
• Separate file entity for LOB field types
• Requires change to ACB
• Support for segmented Buffers
• Permit Length optimization with communication
  protocol

25
Adabas v8 Lifting Limits - Large Object Field
Types

• Lifting Field Limits Large Object Field Types

FCB
FCB
Primary file
Lob file
AC
Data
AC
AC
Address Convertor for Primary file
Address Convertor for LOB file
Lob File
AC
Lob Fields
File
Primary fields
 
26
Adabas v8 Lifting Limits - Large Object Field
Types

• Lifting Field Limits Large Object Field Types
• ADALOD LOAD FILE11,NAMEBASE-FILE
• ADALOD LOBFILE12
• ADALOD MAXISN100000,DSSIZE5000B
• ADALOD ...
• ADALOD SORTSIZE100,TEMPSIZE100
• ADALOD LOAD FILE12,LOB,NAMELOB-FILE
• ADALOD BASEFILE11
• ADALOD MAXISN500000,DSSIZE500000B,NISIZE4000B,U
  ISIZE40B
• ADALOD ISNREUSEYES,DSREUSEYES,INDEXCOMPRESSIONY
  ES
• ADALOD ...
• ADALOD SORTSIZE100,TEMPSIZE100

27
Adabas v8 Lifting Limits - Large Object Field
Types

• Lifting Field Limits Large Object Field Types
• May have any of the options NU, NC, NN, NV, NB,
  or MU.
• NV-option (no conversion) specifies that no
  conversion is to occur
• NB-option (no blank compression) for alphanumeric
  or wide character fields
• NC-option (SQL Null Value) for Field may contain
  a null value
• NN-option (SQL not Null) for Field defined with
  NC option must always have a value defined

28
Adabas v8 Lifting Limits - Large Object Field
Types

• Lifting Field Limits Large Object Field Types
• Cannot have the options FI (fixed) or LA (long
  alpha).
• Cannot be a descriptor or a parent of a special
  (phonetic, sub-, super-, or hyper-) descriptor
• Cannot be specified in a search buffer
• May be part of a simple group or a PE-group
• FBL21-10. to select first 10 occurrences of
  LO field
• FBL21-N. not allowed to have an opened ended
  notation of a LO field within a PE

29
Adabas v8 Lifting Limits - Large Object Field
Types

• Lifting Field Limits Large Object Field Types
• Defined to FDT as A or W
• Not as B, to get Binary use both NV and NB
  options
• B format can imply byte swapping, which does not
  apply to binary LB fields
• Zero length

30
Adabas v8 Lifting Limits Physical Extents

• Lifting Physical Extent Limits GCB Changes

• two blocks in Asso
• Fixed area location
• Database features
• Version
• Replication
• UES
• Physical Extents
• Physical Extents extended

Work
Work
Asso
Asso
Asso
Asso
Asso
Asso

• Increase ASSO/DATA physical extents up to 99
• Standard 3390 can have 75 ASSO/DATA/DSST extents
• Removing five-extent limits provides better 24x7
  support

31
Adabas v8 Lifting Limits Logical Extents

• Lifting Logical Extent Limits FCB Changes

File Control Block
FCB
Fixed Area

• one block in Asso
• Fixed area location
• Extent RABNs
• File features
• MU/PE
• Spanned DS
• LOB support
• FDT location
• File extent info
• LOB Info

Extents info
AC
DATA
FDT
DATA
MI
AC
AC
UI
NI
MI
NI
NI
NI
NI
NI

• Increase logical file extents for NI, UI, DS
  allocations
• Maximum depends on size of Associator block
• 3390 can have around 40 extents of each type
• Or there could be more of one type and less for
  another
• Removing five-extent limits provides better 24x7
  support

32
Adabas v8 Lifting Limits ASSO Structure

• Lifting Logical Extent Limits Adabas V7 ASSO
  Structure

Associator
Fixed Area (RABNs 1-30)
GCB

File Control Blocks (1- maxfiles)
FCB

FDT
Field Definitions (4maxfiles)

PPT

• Variable Area of Associator
• Normal Index
• Upper Index
• Main Index
• DS Space Table
• Address Convertor
• PPT

DSST
MI
NI
AC
NI
UI
AC
UI
MI
33
Adabas v8 Lifting Limits ASSO Structure

• Lifting Logical Extent Limits Adabas V8 ASSO
  Structure

Associator
Fixed Area (RABNs 1-30)
GCB

File Control Blocks (1- maxfiles)
FCB

Field Definitions (nmaxfiles)
PPT
FDT
FDT
FDT

• Variable Area of Associator
• Normal Index
• Upper Index
• Main Index
• DS Space Table
• Address Converter
• PPT
• Field Definitions

DSST
MI
NI
AC
NI
FDT
UI
FDT
AC
UI
MI
34
Adabas v8 Lifting Limits FDT changes

• FDT Changes
• May be larger than 4 blocks
• Will move from the fixed area to the dynamic area
  in Asso
• Increase Field Definition Element size (10 bytes
  to 20 bytes)
• Support new Field data types of Large Object
• Support only I and S options for LF command
• new Command Option X to allow the read of the
  extended FDT
• Extend Long Alphas to specify lengths gt 253 and lt
  16K
• Positioned for the future e.g.Date/Time formats

35
Adabas v8 Lifting Limits Direct Call Interface

• Enhanced Direct Call Interface
• Needed for RBL gt 32K
• Needed for LOBs
• Needed for segmented Record Buffers
• Format Buffers will map the Record Buffers 11
• Increased number of Command Option fields
• Increased number of Additions Field
• Increased size for User area
• Positioned for the future

36
Adabas v8 Lifting Limits Direct Call Interface

• Enhanced Direct Call Interface
• Adabas Calling Procedure between V7 and V8

RBL (B2)
ABD
RBL (B4)
Call Adabas using ACB FB RB SB VB IB
Call Adabas using ACBX FB1 FB2 FB3.FB10
RB1 RB2 RB3 RB10 SB VB IB
37
Adabas v8 Lifting Limits Direct Call Interface
38
Adabas v8 Lifting Limits Direct Call Interface
39
Adabas v8 Lifting Limits Direct Call Interface
40
Adabas v8 Lifting Limits Direct Call Interface
Adabas Control Block Extended 172 bytes
41
Adabas v8 Lifting Limits Direct Call Interface

• Enhanced Direct Call Interface
• Adabas Calling Procedure between V7 and V8
• User exits 1 and 4 will be replaced by exits 11
  and 14
• Original ACB will still be supported
• Nucleus will primarily run in ACBX mode
• Conversion normally performed during router logic
• New Adalinks will no longer be provided in source
  form
• New ACBX interface required only with new features

42
Adabas v8 - Miscellaneous Topics

• Expanded System File numbers
• Adabas system file numbers can now be two-byte
• Adabas v8 requires APF authorization
• New ADARUN parameter
• EXCPVR
• Used when running APF authorized

43
Adabas v8 - Miscellaneous Topics

• I/O Optimization
• Format-1 CCWs are used
• Reduces storage below 16M line
• Control how page-fixing occurs by using ADARUN
  EXCPVR
• Dropped support of VSAM containers for
  ASSO/DATA/WORK
• HEXV8V7 module
• Front-end stub, link with existing Hyper-exit
• Used for Hyper-exit conversion for non MUPEX
  files
• Converts 4-byte index to 1-byte index

44
Adabas v8 - Utilities

• ADACNV
• Must convert from a v72 or v74 database
• Cannot REVERT if using
• More than 5 physical extents
• More than 5 logical extents on any file
• Spanned records
• MUPEX set
• LB fields
• NB option
• System file w/2-byte FNR

45
Adabas v8 - Utilities

• ADAORD
• RESTRUCTURE from v5.n, v6.n, v7.n allowed as
  input to v8 STORE
• ADASAV
• Database level RESTORE only possible from v8 SAVE
• File level RESTORE possible from any v5.1 or
  higher ADASAV SAVE
• Restoring from v8 to previous versions
• v7.4
• v7.2
• v7.1 (AU713084/AU713085)
• No v8 features used

46
Adabas v8 - Utilities

• ADACMP
• ADACMP data sets from Adabas v5.1 or higher as
  input to ADALOD
• V8 ADACMP data sets can be used as input to
  v5.3.3 or later
• Providing no new v8 features used
• MUPEX
• ADALOD
• Accepts input from v5.1 or higher ADAULD or
  ADACMP
• ADAULD
• V8 ADAULD data sets can be used with v5.3 or
  higher

47
Adabas v8 License Key

• JOB00826 IEF403I SABRA238 - STARTED -
  TIME12.50.47
• JOB00826 ADAN02 00238 Nucleus run without
  protection log
• JOB00826 ADAL01 00238 2007-01-05 125047 CLOG
  not active
• JOB00826 ADAN7C 00238 ENTIRE CONVERSION SERVICES
  INITIALIZED
• JOB00826 ADANL9 00238 ADALIC license could not
  be loaded
• JOB00826 ADAN03 00238 ADABAS coming up
  
• JOB00826 ADAN01 00238 A D A B A S V8.1.2 is
  active

48
Adabas System Manager for Simplified DB
Administration
49
Adabas Manager
System Management Hub Integration for Computer
Associates Unicenter IBM Tivoli
50
Adabas Manager

• General database info
• info Icon

51
Adabas Manager

• File List info
• paging
• modifiable columns

52
Adabas Manager

• File List info
• use of drop boxes

53
Adabas Manager

• File info
• Column sorting option

54
Adabas Manager

• Container info
• Drop box for different view option

55
Adabas Manager

• User Queue info
• check boxes
• Execute function

56
Adabas Manager
Thread monitoring
57
Adabas Manager

• General Statistics
• use of graphics
• different panels

58
Adabas Manager

• Maintenance info
• sorting

59
Event Replicator for Adabas
60
Event Replicator for AdabasArchitecture Overview
ODBC
61
Adabas v5.1for Open Systems
62
Adabas v5.1 for Open Systems
XML Web Services
Databases

• Adabas V5 for Open Systems
• (Windows, Unix, Linux)
• More compatibility to Adabas on the Mainframe
• Greater SQL capability and closer integration
  with the Adabas SQL Gateway
• Greater utility functionality
• More 24 X 7 capabilities

Natural 3GL

• Openness
• SQL for Adabas (ODBC, JDBC. OLE DB Ado.NET)
• Web Services / XML

Java .NET
SQL Reporting Tools
63
Adabas v5.1 for Open Systems

• V5.1 Features
• MU and PE occurrences higher than 191 (32k)
• Non Descriptor Search capability
• UNICODE Support
• Long Alpha (LA option) Fields
• 16k
• Descriptors can be upto 1142 bytes

64
Adabas v5.1 for Open Systems

• V5.1 Features
• LF Command
• For mainframe compatability
• SQL DDL support - Create/Drop Table/Column
• Record counter for SQL Support
• Faster processing of SELECT COUNT() FROM
  TABLENAME
• Number of records stored in FCB
• Backward Compression
• Main/Upper Indices

65
Adabas v5.1 for Open Systems

• V5.1 Features
• No limit on File extents
• SQL CREATE TABLE does not require size
• Dynamic Hold Queue
• Tolerate Corrupted Index
• Rsp code 48 if index is accessed

66
Adabas v5.1 for Open Systems

• V5.1 Features
• WORK dataset reorganization
• Part 2 3 are combined
• Parameters removed
• Allocated from temporary working space
• WORK is used for Part 1 processing only
• LP parameter removed
• Unlimited SORT space for S2/S9
• LS parameter removed

67
Adabas v5.1 for Open Systems

• V5.1 Features
• Automatic extension of temporary Work space
• Nucleus or Utilities, SORT and TEMP used
• Dynamically allocated and released
• Automatic container file extensions
• ASSO/DATA
• Expands last extent or
• New container created
• ADANUC/ADADBM

68
Adabas v5.1 for Open Systems

• V5.1 Features
• Utility Changes
• ADACMP
• ADADBM
• ADADCU
• ADAFDU
• ADAFRM
• ADANUC

69
Adabas v6.1for Open Systems
70
Adabas v6.1 for Open Systems

• V6.1 Features
• Large Object Support
• Spanned Data Storage Records
• ACBX

71
The Next Generation

• Thank you!