Title: CMG%202007
1CMG 2007
- MXG Vendor Session
- December 5, 2007
- San Diego, California
2- I. WPS Technical Notes
- 1. Current Status of MXG testing WPS
- 2. Run time comparisons
- 3. Revisions to SAS Clone Article
- 4. Summary
- II. Major enhancements in 25.11 since 24.24.
- III. MXG 25.11 is very close to final 25.25.
31. Current status of MXG testing under WPS Betas
in November, 2007.
- MXG QA compile-only (dummy INFILEs) TYPExxx and
TYPSxxxx members - This exercised the MXG DATA-step Code for
compile errors, - and created DOCVER to compare the contents of
WPS-built - datasets (variables, LENGTHs, LABELs,
FORMATs). - Steps 1 thru 36 of the QAJOBXX were
tested. - -Default BUILDPDB with 480MB SMF File
- -Tailored BUILDPDB with IMACEXCL with 480 MB
SMF File - -TYPETPMX with small file - verified 72
position FORMATs worked. - -TYPENTSM with test file - verified
open-system-style MXG code.
- WPS Betas were often updated daily, and as errors
were - encountered in MXG tests on z/OS and
Windows/XP, a new Beta was generated which did
correct each error that could be fixed
short-term. The current Beta tested was World
Programming System 2.02 (02.02.00.08458) of Nov
27.
4c. MXG Version 25.11 is required for testing
under WPS its updates eliminate the need for
user modifications to MXG Software, and new
WPS-specific members (CONFIGW2, MXGWPSV2,
JCLINSTW, AUTOEXEW) were added.
d. Facilities used by MXG Software not yet in WPS
for z/OS INFILE CCHHR option - needed only
for TYPEEREP (EREP,SYS1.LOGREQ) VIEWS
- for CPU I/O performance, used in
VMXGSUM. invoked over
60 time in QA BUILDPDB, and in
all ASUMxxxx and TRNDxxxx members.
Eliminates a full pass of the
input data. PROC CONTENTS - minor,
does not report High Block Used size.
e. Facilities used by MXG Software not yet in WPS
for z/OS and Windows INFILE with ftp
access method - performance slower, more disk
space SAS/GRAPH, SAS/STAT, SAS/ETS, etc.
Currently WPS supports the Base DATA Step
Support and a few PROCs, including PRINT,
MEANS, CONTENTS, GPLOT, GCHART, with more
planned.
f. Output differences - minor PROC MEANS
printed output - some values printed with one
digit more
resolution by WPS.
- no error in output values spot checked
- prevents automated output
comparisons
5g. Untested - most due to complexity or time to
set up multiple inputs WPS Workbench
Interactive Human Interface VERY different
Uses Eclipse
Significant Learning Curve DATA Libraries
on TAPE WEEKBLDT, MNTHBLD special TAPE
format to DISK, DISPMOD, etc. TESTTRND,
TESTANAL - requires extensive test data
ANALxxxx - requires test data
ASUMxxxx - except ASUMJOBS, ASUM70PR
were tested. UTILxxxx -
specialized utilities for MXG Tech Support
Internal SORT - on z/OS, internal SAS SORT
may be required when
BY list variables arent in first 4096. NFS
Files - not tested. Broken VBS
files - not tested.
6h. Migration issues - see WPS Migration
Instructions On z/OS, copy all archived
SAS Data Libraries on DASD (including HSM
migrated) to tape (Sequential) format with the
SAS System first. WPS can read SAS Data
Libraries in SEQUENTIAL format on tape or DASD.
WPS cannot read DASD format SAS Data
Libraries
i. Customer reports Several MXG customers
have been running their BUILDPDB on z/OS.
Early tests had to make source-level-changes to a
few MXG members. Most had relatively simple
BUILDPDBs with minimal tailoring.
7j. MXG Support Position for testing of WPS
Release MXG 25.11 and WPS 2.2 or later
are required. Your current MXG Software
License Agreement states Merrill agrees
to provide continuous product support for MXG in
the following areas When error
conditions (i.e., the SAS execution
of MXG code produces either a return
code or an ABEND) are the results of
errors in MXG Code, they will be corrected.
If you encounter an error testing MXG under
WPS You should report the error to
WPS Technical Support for initial
investigation. If WPS support
believes the error is an MXG problem, they can
contact MXG, or may choose to refer you
to MXG Support. MXG Support may then
request you to send data to MXG -
the raw data file that caused the error
- your site's USERID.SOURCLIB (tailoring)
source library(s) If the error can be
replicated under the SAS System, it will
be corrected per our license terms.
82. Run time comparisons
BUILDPDB,ASUMJOBS,ASUM70PR with 448 MB SMF File
z/OS Comparison
CPU TCB Elapsed ----------- Compressed
---------------- minutes minutes
Work Size PDB Size CICSTRAN Size SAS
3.88 5.20 209 MB 55 MB
59 MB WPS 10.67 18.50 233 MB
59 MB 67 MB
Windows/XP Comparison SAS 1.20 2.18
Note 1 65 MB 63 MB WPS
1.93 2.71 Note 1 78 MB
70 MB z/OS tests were executed on
IBM 2094 CPU Model S08, SU_SEC9708.
Windows tests were executed on Intel Duo Core
T5500 _at_ 1.66 GHz. Note 1 Neither WPS nor
SAS provide a way to track maximum work
space on ASCII
93. Revisions to SAS Clones article in MXG
Technical Newsletter FIFTY WPS is no
longer vapour-ware. The company has bent
over backwards to provide corrections.
Performance of WPS, when written in JAVA, was so
poor (run times were at least ten times
worse than the current Beta) that the
product no longer uses JAVA, so it cannot exploit
ZAAP engines. Items listed in
sub-paragraphs i, ii., iii., and iv. have all
been addressed to my satisfaction, with the
exception of the items that are listed
above in this note. Pricing has been
significantly reduced from those original IBM
prices. As an example, an MXG site in the USA
was quoted an IBM price for a 21 Value Unit
system (about 1000 MIPS) of 42,000 first
year and 8,400 for renewals. WPS can be
licensed through IBM or through World
Programming their home page is at
http//www.teamwpc.co.uk
104. Summary Most of MXG has compiled
successfully under WPS on both z/OS and
Windows/XP. BUILDPDB has compiled and
processed SMF data on both z/OS and
Windows/XP. A lot of MXG still needs to
be tested with data. WPS is still in
development. WPS will roll this Beta into
a GA release of WPS 2.2 this week. WPS on
z/OS requires thrice the CPU and Elapsed Run Time
of SAS. WPS on Windows/XP CPU and run
times are similar to SAS run times. Disk
Space required on both platforms are similar.
So, it is your choice at this time to test
MXG under WPS. And, it's your evaluation
of your MXG programs that should determine
if you believe that WPS is "Ready for Prime Time"
at your site, with your current CPU and
run times and the MXG programs that you
utilize.
115. QA Steps successfully compiled and executed
with dummy input. STEP 3. CREATE FORMAT
LIBRARY STEP 4. RUN TESSNT STEP 5.
RUN TESSIBM STEP 6. RUN TESSIBM1 STEP
7. RUN TESSIBM2 STEP 8. RUN TESSIBM3
STEP 9. RUN TESSUSER STEP 10. RUN TESSUSR1
STEP 11. RUN TESSOTHR STEP 12. RUN
TYPSCMHM STEP 13. RUN BUILDPD3ASUMS
STEP 14. RUN BUILDPDBASUMS STEP 15. RUN
TYPERMFV STEP 16. RUN TYPECMFVTYPEMVCI
STEP 17. RUN TESSHSM STEP 18. RUN TESSFACO
12 STEP 20. RUN TESSVM STEP 21. RUN
TESSCRAY STEP 22. RUN TESSHPCS STEP 23.
RUN TESSUNIA STEP 24. RUN TESSUNIK STEP
25. RUN TESSQAPM STEP 26. RUN TESSQACS
STEP 27. RUN TESSTUX STEP 28. RUN TESSPW
STEP 29. RUN ASUMPRTR STEP 30. RUN
TYPEIMS7 STEP 31. RUN TESSIMSD STEP 32.
RUN COPYSTEP STEP 33. RUN TESSTRND -
partially completed, not WPS fault. STEP 34.
RUN TESSMNTH STEP 35. RERUN TYPE-S FOR NON
PROC SORT FOR DATASET LABEL STEP 36. RUN
CROSSREF STEP 37. RUN DOCVER - output
DOCVER file is identical.
13MXG Version 25.11, dated Dec 6, 2007. In 7014
members 2,297,784 lines, creates 4278 datasets,
118,561 variables. Major enhancements added
in MXG 25.11. TYPE111 25.241 Support for
CICS CTG 7.1.0 new SMF 111 record. TYPE7072
25.224 CPUTYPE tests are replaced with ZARCHMDE
tests. This means that with
MXG 25.11 or later, a new IBM
CPUTYPE will NOT require a new MXG Version.
TYPETPMX 25.239 Support for Thruput Manager SLM
and DB2 data. TYPE82 25.257 Support for ISCF
HCR7750 TKE Logging update. TYPEEVTA 25.255
Support for Action Software's EventAction user
SMF. TYPE85 25.234 New variables in OAM
subtype 32-35 records. TYPE78 25.236 Zero
obs in TYPE78IO with Change 24.171 if z/OS 1.7.
TYPEEVTA 25.255 Support for Action Sofware's
EventAction SMF record. TYPERMFV 25.246
Updates for CPU Segmentation changes. TYPENTSM
25.253 Support for new NTSMF objects for MSSQL.
TYPETNG 25.221 Support for VM Ware VSX Systems
in CA NSM records. TYPETNG 25.235 New
Solaris, AIX, and many RedHat objects added.
VMXGSUM 25.248 New LNSUMOUT8 will make all
output to length 8. UTILEXCL 25.256 Macro
variable MXGDEBUG revised for IMACEXCL plus!
EXITCICS 25.240 MCTSSCRL now tested vs MCTMNOPN
for CICS Compressed. TYPE110 25.240 MCTSSCRL
now tested vs MCTMNOPN for CICS Compressed.
UPRINDOC 25.226 Utility prints NAME and LABEL of
all variables. TYPE30 25.260 MXG 25.10,
INTRVLTM missing for TYPETASK'OMVS' ANALACTP
25.254 Sample report summarizes DB2 Package data
to UOW. CONFIGW2 25.252 MXG updates for
testing MXG Execution under WPS.
14 Major enhancements added in MXG 25.10.
TYPE7072 25.205 Support for z/OS 1.9 up to 54
CPUs per MVS,INCOMPAT TYPERMFV 25.204 CFI
Segmentation eliminates RMF III skipped CF data.
ANALDB2R 25.202 VARIABLE QBnTDPIO NOT FOUND
error corrected. TYPE70 25.212 ZIPACTTM,
PCTZIPBY corrected for Dedicated zIIPs.
ASUMCELP 25.209 Duplicate observations in
PDB.ASUMCELP eliminated. TIMEBILD 25.209
Optional SYNC59 timeshifting using TIMETABL.
Major enhancements added in MXG 25.09.
IMPORTANT CHANGES Almost none! Only
UTILEXCL in 25.08 had an error, but these other
fixes/enhancements are now ready
for prime time UTILEXCL 25.193 MXG 25.08
ONLY LABEL IMACICU3 NOT FOUND. TYPERMFV 25.191
Support for RMF Monitor III CFI table
enhancements. TYPESRDF 25.195 Support for
EMC's SRDF/A user SMF record. READDB2 25.189
New PDBOUTYES, old PDBOUT changed, writes to
WORK. ANALDB2R 25.189 New PDBOUTYES, old
PDBOUT changed, writes to WORK. RMFINTRV
25.199 SMF70GIE now reset to 00/15 if SYNC59YES
is used. TYPE89 25.198 SMF89HOF,SMF89DTO
were incorrect due to typo. UTILCSV 25.197
UTILCSV creates a CSV (or TAB) Delimited flat
file. UTILBLDP 25.196 Large MACKEEP string
caused strange results. TYPE92 25.192 New
ID92 ST14 INPUT EXCEEDED if not a RENAME.
15Major enhancements added in MXG 25.08.
IMPORTANT CHANGES TYPETNG 25.181 Support
for CA NSM RedHat 4.01 Linux perf cube.
TYPE7072 25.176 Support for APAR OA18244,
Blocked Workload z/OS 1.9. TYPE7072 25.163
Support for Capacity Groups variables in TYPE70.
ASUM70PR 25.163 Capacity Group summarization,
PDB.ASUM70GC/ASUM70GL. TYPEQACS 25.178 AS400
APAR QAPMDISK with LRECL456 added new data.
ADOCDB2 25.172 Example to process DB2 datasets
to separate DDNAMES. TYPEDB2 25.169 _RDB2ACC
DB2 Parallel event "analysis" example. Many
25.179 UPCASE,LOWCASE,STR,BQUOTE,QUOTE,
etc. Doc 25.179 Use LET MACxxxx STR(
text ) to pass text.
Major enhancements added in MXG 25.07.
CRITICAL CHANGE TYPE78 25.141 APAR OA21799
for HiperPAV, ABEND, SMF78HIX invalid.
Installing HyperPAV can create invalid
RMF 78-3's that cause BUILDPDB
to ABEND as it reads RMF 78's.
Change 25.141 will detect bad records and avoid
the ABEND, but you will need
to install the IBM PTF for the
APAR to correct the invalid data values.
16IMPORTANT CHANGES/ENHANCEMENTS Many
25.140 Prelim z/OS 1.9 (fails if 54-CPs, See Ch
25.205) TYPECIMS 25.139 Support for IMF
Version 4.3 (INCOMPATIBLE). TYPE74 25.140
APAR OA17070 supports CF Level 15 measurements.
TYPE89 25.138 Support for APAR OA20314 new
SMF89LPN/SMF89ZNA. TYPE80A 25.137 Support for
unknown TOKDANAMs, prevents ABEND. UTILLPDS
25.136 Utility to count used/defined PDS
Directory Blocks. TYPE7072 25.135
LCPUCAP/LCPUCAPC Labels include "Hard CAP".
TYPE42 25.153 MXG 25.06 only, false INVALID
TYPE42 SUBTYPE 5 error. TYPEVMXA 25.151 180
Error _MPRCAPC not found, DEBUG prints removed.
ASUM70PR 25.150 ASUM70PR created PCTCPUBY GT
100, final fix? ASUM70PR 25.150 ASUM70PR now
supports INTERVAL/CECINTRVSHIFT. ADOCITRM
25.149 Doc. Maps ITRM dataset names to MXG
name. ADOCDB2 25.148 Doc. How to create
DB2ACCTB/DB2ACCTP in separate DDs. ANALRMFR
25.146 ERROR NO DATASETS TO LOOKUP correction.
TYPERMFV 25.145 RMF III dataset ZRBLCP missing
obs for many LPARs. UPCMEMDZ 25.144 ASCII
utility to determine memory available to MXG.
TYPE71 25.143 SWAPrates were set missing if
zero, now can be zero. VMXGINIT 25.143 New
MXGMISS macro variable changes TYPE71 SWAPrates.
17 Major enhancements added in MXG 25.06. TYPE30
25.116 MXG 25.05, negative EXECTM, INTRVLTM,
GMTOFF30 wrong. TYPE110 25.041 Support for
CICS/TS 3.2 (INCOMPATIBLE). EXITCICS 25.041
INFILE Exit for CICS/TS 3.2 SMF record
compression. TYPEBTE 25.107 Support for CA
Brightstor Tape Encryption SMF. TYPE80A 25.131
Support for CRL PUBLISH and SET UID RACFEVNT 52,
79. TYPEFERT 25.133 Support for Williams Data
FERRET product user SMF. TYPECLAR 25.130
Support for Clarion Disk Array flat files.
TYPE119 25.119 SMF 119 from z/OS 1.8 caused
INVALID DATA messages. TYPESYNC 25.117 INVALID
ARGUMENT due to incorrect HEX4/HEX3 formats.
ASUMUOW 25.121 Enhanced to keep each CICS
segment response time. ASUMHSM 25.113 HSM
Summary enhanced with "HSM COMPLEX" HSMPLEX.
IHDRIDMS 25.112 CA IDMS PerfMon support enhanced
with "IHDR" exit. TYPENMON 25.110 Support for
DISKBUSYn for all NMON Disk Monitoring.
TYPERACF 25.134 Support for IRRDBU00 record
types 0560,0561,0562. TYPE80A 25.131 Support
for TOP SECRET (INCOMPAT) '90'x,'00'x VRSN.
18MXG Version 25.05, dated Jun 7, 2007. Major
enhancements added in MXG 25.05. TYPEITRF
25.103 Support for IBM OMEGAMON TRF ITRF V550
and V560. TYPENMON 25.104 Full support for
NMON, Nigel's Monitor for AIX/unix. TYPEDB2
25.090 Support for PK37354 SMF 101 Subtype 4 in
DB2 9. TYPEDB2 25.097 Variable THREADTY blank
if non-DDF transaction. TYPE30 25.089
GMTOFF30 calculation corrections and problems.
CONFIGV9 25.101 MEMLEAVE10M SORTBLOCKMODE now
set in CONFIGV9 UTILBLDP 25.098
UTILBLDP(BUILDPDBJES3 ... enhancement.
19Major enhancements added in MXG 25.04. TYPE21
25.083 Fix for support for APAR OA20077 Device
Bytes TYPE21. TYPEXAM 25.082 Support for XAM
Release 3.6, many new data. TYPENMON 25.073
Support for LPAR and IOADAPTR Nigel's NMON data.
SYSLOG 25.070 Support for SYSLOG file
enhanced, all records output. TYPENDM 25.081
Support for NDM-CD type 'NM' records creates
NDMNM. DALYTAPE 25.072 Sample tape reports
from STC VTS SMF MXGTMNT. TYPERMFV 25.079
ZRBLCP dataset had only first LPARs
observations. TYPEDB2 25.064 Several QISE
variables were wrong. TYPEDB2 25.075 QBGL
variables in DB2 V8.1 now supported, were wrong.
TYPETMS5 25.084 FILSEQ in TMS.DSNBRECD could be
wrong, mult-vol-file. ANALDB2R 25.068 SQL Text
QW0141TX was not printed, coding error.
UTILBLDP 25.071 Products that need
deaccumulation now protected. UTILBLDP 25.065
Default list of ASUMxxx to be included,
MXGINCL. VMXGRMFI 25.069 Service Class Names
can be "wild-carded" VMXGUSE 25.067 Revised
to invoke _STY70 UTILBLDP recommended. FORMATS
25.063 Additional SWAP reason codes added to
MG079SR. Doc 25.078 List of MXG-issued
USER ABEND values source member.
20Major enhancements added in MXG 25.03.
CONFIGV8 25.037 SORTEQUALS should NOT have been
in CONFIGV8, V9 only. TYPE119 25.035 Support
for SMF 119 for z/OS 1.8 (INCOMPATIBLE).
TYPE1415 25.047 Support for APAR OA19502,
SMF14KET Key Exchange Time TYPE21 25.040
Support for APAR OA20077, uncompress read/write
bytes TYPEAIXT 25.039 Support for AIX Tapas-C
performance data files. TYPESAMS 25.055
Support for SAMS objects 2151,2226,2229 and
2231. TYPETDS 25.052 Support for TDSLink
Version 630 ZCOST datasets. TYPECSM 25.050
Support for CrossSysplexManager user SMF record.
TYPSCOCR 25.034 Support for CopyCross (now VTF
Mainframe 2.1.0) SMF. VMXGDUR 25.044
Interval QUARTER, SEMIANN, ANNUAL now
supported. TYPEHSM 25.042 Process HSM with
different SMF IDs/different SYSTEMs. ASUMTAPE
25.040 Uncompress read/write SMF21DBR/DBW kept
in ASUMTAPE. ASUMUOW 25.054 QWACSPCP,QWACTRET
added to PDB.ASUMUOW for OTE. ASUMCEC 25.053
PDB.ASUMCEC, PCTCPUBY GT 100, DURATM LT
CECINTRV. BLDSMPDB 25.048 Corrections to
BLDSMPDB, new SORTEDBY option.
21Major enhancements added in MXG 25.02. MXG
25.02 was created to protect sites who set the
NOSORTEQUALS option (i.e., changed the
SORTEQUALS default). NOSORTEQUALS causes
invalid data in ASUM70PR-built datasets.
CONFIGV9 25.028 OPTION NOSORTEQUALS caused
errors in ASUM70PR. VMXG70PR 25.028 OPTION
NOSORTEQUALS caused errors in ASUM70PR.
Other New Support and corrections added in MXG
25.02 ASMTAPEE 25.033 Support for ASMTAPEE
ML-40 assembly under z/OS 1.8. ANALRMFR 25.032
IRD corrections to RMF reports. TYPE42DS 25.030
TYPE42DS had carried-forward IOCOUNT and other
vars. TYPE70 25.028 IORATEn per-engine I/Os
corrected for IRD. VMXGPRAL 25.028 Print All
utility now compares all datasets in LIBs.
UCOMPSOE 25.028 Utility to compare SORTEQUALS
and NOSORTEQUALS output ANALFIOE 25.026 Divide
by zero message protected.
22Major enhancements added in MXG 25.01. The
MXG 24.24 Annual Version is VERY solid, with only
these three relatively minor corrections
TYPENTSM 25.015 INCOMPAT MXG CHANGE for NTSM
WEEKly requires action. TYPE7072 25.013
PCTMVSBY in PDB.TYPE70PR was wrong if IRD was
active. ASUM70PR 25.001 NRICFCPU,NRIFLCPU were
wrong if you have more than 1. Other New
Support and corrections added in MXG 25.01
TYPEIMS7 25.006 Support for IMS Version 10
(INCOMPATIBLE) IMS log. TYPEBVIR 25.011
Support for TS7700 SMF records. TYPE7 25.025
Support for APAR OA19453 for 4-byte LOSTRECS
count. TYPE74 25.003 NREXPOSR was wrong for
HyperPAV devices. EXITCICS 25.017 New "CICS"
INFILE EXIT for CICS compressed SMF data.
IMACICMR 25.007 Optional CICS CMRDATA,
CMDUDATA/CMDDBCCP reversed. IMACICOB 25.008
Optional CICS OMDBDB2LN now spelled as OMBDB2LN.
IMACICOM 25.008 Optional CICS OMMLN now spelled
as OMMQLN. Please read CHANGESS for the
complete list of major enhancements. See
member NEWSLTRS or the Newsletters frame at
www.mxg.com for current MXG Technical Notes
that used to be in CHANGES.