Embarcadero Technologies Real World Data Integration

1
Embarcadero TechnologiesReal World Data
Integration

• March 2005

we make data work
2
Agenda

• Data Integration
• Common Challenges
• Case Study FDIC
• Why is Metadata important?
• Maintainable Data Integration
• Planning ahead - Extensibility
• MDDS Spotlight DT/Studio
• About Embarcadero Technologies
• Questions and Answers

3
Data Integration

• An average of 48 applications and 14 databases
  are deployed throughout a typical Fortune 1000
  company
• IDC
• 35-40 of all programming efforts today are
  devoted to developing and maintaining programs to
  transfer information between databases
• Gartner Group

4
Common Challenges

• Growing complexity of IT environments
• Consolidations, mergers acquisitions create
  heterogeneous environments
• New technologies such as Linux, Web services, and
  XML introduce additional complexity
• Data sources are constantly updated and changed
  data sources must be easily understood
• Increased focus on business information expanding
  reach of ETL
• ETL is becoming a key part of how organizations
  consolidate information as the usage grows,
  solutions must become more accessible to a wider
  group of developers
• Developers looking for highly flexible solutions
• Organizations do not want to be limited by
  capabilities of the ETL solution
• Developers want the flexibility of scripts in
  order to insure that their solution scales as new
  data sources are integrated
• Organizations want to leverage existing assets
• Developers do not want to have to learn outmoded
  scripts they do want to take advantage of
  industry standards
• Organizations often make significant investments
  in technologies and want to continue to leverage
  those assets moving forward

5
Additional Environmental Challenges

• Mechanical challenges of data integration
• Data quantity
• Physical location
• Latency
• Frequency
• Systems and networks topology
• Contextual challenges of data integration ? our
  focus
• Structure
• Inter-relationships
• Custody
• Handling procedures and processes

6
Case Study FDIC

• Name Federal Deposit Insurance Corporation
• Primary Business Banking
• Annual Revenue (US) 1.6 billion
• Number of employees 5,200
• Yearly Revenue Growth () -10
• Corporate Web Site http//www.fdic.gov

7
Case Study FDIC

• Primary Databases DB2 v. 7.1 for OS/390, MS SQL
  Server 7.0 and 2000
• Custom Applications back-end, mid-tier and
  front-end development platforms Cold Fusion
  applications, Custom Reporting applications,
  other web interfaces
• Hardware Standards IBM (mainframe) and Dell (PC)

8
Case Study FDIC

• Migrate main datasets from IBM DB2 to Microsoft
  SQL Servers for satellite applications
• Create satellite applications based on migrated
  SQL Server datasets
• Sanitize the migrated data for use with their
  development and test environments to insure
  development accuracy while masking sensitive data

9
Case Study FDIC

• Solution Requirements
• Data Modeling in order to fully understand and
  document existing data sources as well as model
  new ones.
• Database Administration to manage the data
  sources as well as centralize on a central
  administration environment
• ETL in order to move data from their various
  environments

10
Keeping Integration in Context

• Metadata understanding your data before making
  the leap
• Data coupled with its metadata is significantly
  less complex
• Persisting metadata from source, through
  transformations, to target keeps the integration
  process in context
• It is a prerequisite to data integration efforts
• Data integration an extensible service
• On-demand availability of integrated data to
  applications and application services
• Integration tasks designed and deployed quickly
  and easily
• Service-oriented approach inherently creates an
  audit trail
• Extensible architecture insures that the solution
  can scale with your environment

11
Model-driven Data Integration

• Model-driven Data Integration (MDDI) is a
  service-oriented data integration approach that
  leverages standards-based models and ensures a
  continuum of traceable and auditable metadata
  through the integration process

12
Why MDDI for ETL?

• Integrated models and extensive metadata use
• Captures the know-how of integration processes
  by retaining associated models
• Staff may change organizational memory is
  captured and documented
• Ensures that the accurate instance of the data is
  referenced through the use of intuitive logical
  models
• Reporting of task execution metrics
• Useful for compliance related audit trails
• Proactive service level management
• Machine-generated (meta) documentation
• Facilitates collaboration through
  self-documentation
• Different detail levels for different audiences
• Standards-oriented
• Technology standards
• Notational standards
• Service-oriented
• Applications and other consumers of integrated
  data can access it as a service within the
  infrastructure

13
Benefits of an Extensible Architecture

• Insure that you never need to supplement your ETL
  solution with external scripts
• Integrate existing in-house solutions
• Permanently expand the list of transformations
  available in the tool with custom plug-in
  transformers.
• Take advantage of open source and other available
  solutions on the market such as
• Web Services (SOAP) from Apache (www.apache.org)
• UDDI connectivity from jUDDI (www.juddi.org)
• Bioinformatics related functions via Biojava
  (www.biojava.org)
• Fully integrate with your environment
• Integrate management facilities into your own
  environment
• Embed the DT/Engine directly into other software
  products (perfect for ISVs)

14
Data Integration Spotlight DT/Studio
Key Benefits and Implementations

• Easy to use
• DT/Studio leads its category in the number of
  out-of-the-box transformations, practically
  eliminating the need for hand-coding.
• DT/Studio offers the best source/target analysis
  capabilities in the ETL category via its use of
  model-driven design.
• Low Cost of Development and Ownership
• DT/Studio has the lowest acquisition cost among
  the products with similar capabilities.
• DT/Studio does not require expensive consultants
  to develop and implement tasks, thus reducing the
  total cost of ownership dramatically.
• Plug-in Architecture Simplifies Flexibility and
  Extensibility
• DT/Studio provides extensible APIs that allow
  users to add custom business logic and
  functionality into their transformations while
  retaining meta-data.
• DT/Studio is entirely java-based, which allows
  for concurrent product releases across multiple
  platforms.
• Low Operational Impact
• DT/Studio comes with automation interfaces that
  allow command-line invocation of tasks, enabling
  unattended execution of pre-defined jobs.
• DT/Studio provides built-in scheduling and
  notification capabilities. In addition, users can
  chain tasks, run jobs at pre-defined intervals
  and enforce dependencies across tasks.
• Built-in Design and Runtime Reporting Features
• DT/Studio provides advanced reporting features
  that provide valuable metrics to measure process
  quality. Using DT/Studio reports, data
  professionals can proactively manage their
  environments rather than having to react to
  failing processes.

15
DT/Studio Product Preview

• DT/Studio Demo

16
Brought to you by
Embarcadero Technologies is a publicly held
software company that provides data lifecycle
management solutions. We enable our customers
to cost-effectively manage and optimize their
critical data and database infrastructures,
allowing them to obtain better results with
fewer resources.
17
Company Highlights

• Large, loyal customer base
• 11K corporate customers, 70K end users
• 97 of Fortune 100
• 90 retention rate (maintenance renewal is not
  mandatory very high rate)
• Industry leading solutions
• Portfolio of data lifecycle management products
• Higher RD investment rate (30) than any other
  profitable vendor in our market segment
  (competitor avg 22)
• Talent base with real-world experience products
  built for and by DB professionals
• Strong execution
• Cash-flow positive every quarter since 1995
  (founded in 1994)
• Continued revenue growth and profitability
• EMBT outperformed NASDAQ and DJ Software indices
  in the last 12 months.

18
Embarcadero Product Strategy
19
we make data work

• Data the heart of enterprise IT
• ER/Studio define and leverage metadata
• DT/Studio integrate disparate data
• Database foundation of data-centric
  applications
• DBArtisan manage heterogeneous databases from
  a single console
• Rapid SQL develop cross-platform database code
• Application delivering the data to end users
• Performance Center monitor data performance
  and availability
• Extreme Test test and ensure application and
  data performance

20
Embarcadero The Choice for Leverage
People
Intellectual Assets
Embarcaderos Data Lifecycle Management Solutions
21
Trusted by Industry Leaders
             
Healthcare /Services
Technology /Telecom
11,000Customers
FinancialServices
Consumer Goods /Entertainment
                 
Government
Energy /Manufacturing
Sonat EnergyServices
22
Leading Technology Partners
23
Q A

• www.embarcadero.com