ESAJRC workshop

1

• ESA/JRC workshop

Lucio Colaiacomo l.colaiacomo_at_eusc.org Marcello
Moretti m.moretti_at_eusc.org
2
Content of Presentation

• Introduction
• EUSC background and subordination
• Imagery Data
• Infrastructure
• Example of one EUSC scenarios

3
EUROPEAN UNION SATELLITE CENTRE (EUSC)

• 1991 WEU Council decided to set up the WEU
  SATCEN at Torrejon Air Base, Madrid
• 1993 Building inaugurated
• 1997 SATCEN declared fully operational
• 68 personnel

WEU SATCEN
EU SATCEN

• 1 Jan 2002 transferred to EU (JOINT ACTION)

4
JA Art. 2 Mission

• The Satellite Centre shall support the
  decision-making of the Union in the context of
  the CFSP, in particular of the ESDP, by providing
  material resulting from the analysis of satellite
  imagery and collateral data, including aerial
  imagery as appropriate,
• A Member State or the Commission may address
  requests to the SG/HR, who, if the capacity of
  the Centre allows, will direct the Centre
  accordingly,
• Third States may also address requests to the
  SG/HR, who, if the capacity of the Centre allows,
  will direct the Centre accordingly,
• International Organisations such as the UN, OSCE
  and NATO, may also address requests to the SG/HR,
  who, if the capacity of the Centre allows, may
  direct the Centre accordingly,

5
Products to support

• Indications and warnings
• Support to arms control
• Support to military operations
• Peace-keeping, -making, -enforcement
• Humanitarian missions
• Treaty verification
• Counter-proliferation
• Counter-terrorism

6
Geospatial Intelligence
7
European UnionTreaty on the European Union (TEU)
I
II
III
European Communities
Common Foreign and Security Policy
Cooperation in Justice and Home Affairs
Art. 11 - 28 TEU
Art. 29 - 42 TEU
European Economic Community
EURATOM
Intergovernmental Cooperation
Intergovernmental Cooperation
8
EU Institutions
Decentralised Agencies
European Parliament
Court of Justice
Europ. Court of Auditors
Commission
European Central Bank
Econ. and Social Committ.
Council
Committee of the Regions
European Investment Bank
European Investment Fund
European Ombudsnan
9
(No Transcript)
10
Imagery
11
Primary Sources of Commercial Satellite Imagery
OPTICAL
LANDSAT (UNITED STATES)
SPOT (FRANCE)

EROS (ISRAEL) IKONOS (UNITED STATES) QUICKBIRD
(UNITED STATES)

RADAR
ERS (EUROPEAN SPACE AGENCY)
RADARSAT (CANADA)
12
Primary Sources of Commercial Satellite Imagery
13
Sources of Non-Commercial Imagery
Helios 1
14
Situation at Satcen

• Software
• Big number of different COTS operationally used
• Reduced integration among them
• Few of them are compliant with standards

15
EUSC Network Configuration and Topology

16
Portal Concept and Basic EUSC Workflow and
Infrastructure
Note SATCOM is planned and may extend
the existing normal Internet connection
EXTERNAL PORTAL (SECURE)
Point-to-Point Link to Brussels and EDSP
Net (emails and attachments)
Arc, Erdas, ErMapper
INTERNET (OPEN)
WMS WFS
SATCOM Satellite Communication
Secure Data Transfer e.g. via removable disk or
CD-ROM
SIGMA Keyhole
5
1
Secure Data Transfer e.g. via removable disk or
CD-ROM
Catalog GIB
6
2
CORBA
5
3
1 Ordering Process 2 Image is received 3 Metadata
entered in catalog 4 Image archived 5 Image
processed 6 Assembly for Delivery
Erdas
Image Server Keyhole ?
4
INTERNAL PORTAL (SECURE)
Note Image Server in preparation
Internal WMS, WFS
17
Operations organization
18
(No Transcript)
19
(No Transcript)
20
Google earth fusion
21
Google earth fusion
22
Google earth fusion

• ? Integration with ArcSDE and Oracle Spatial
  databases
• ? Supports distributed ingest processing across
  up to 64 CPUs
• ? Easy-to-use GUI
• ? Project metaphor create projects for
  different collections of data
• ? Auto-ingest scriptable engine to
  automatically synch with changing datastores
• ? Complete Undo Capability
• ? Support for all language formats
• Support for common GIS data formats

23
Google earth fusion
Vector formats
Image formats

• ? TIFF/GeoTIFF, JPEG, JPEG2000, AAIGrid, AIG,
  USGS, DOQ, SID, TIF, BMP, TGA, DTED, ECW, GIF,
  GRASS, Erdas Imagine (HFA, IMG)
• ? PNG, USGS SDTS DEM, USGS ASCII DEM, Raw Binary
• ? Portable Pixmap Format (.pnm)
• ? Atlantis MFF Raster (.hdr)
• ? National Imagery Transmission Format (.ntf)
• ? PCIDSK Database File (.pix) (.bil,.bip),CADRG,
  others

• ? .shp
• ? .map
• ? NIMA MUSE
• ? Generic ASCII
• ? US Census Tiger Line Files (.rt1)
• ? GDT, TeleAtlas
• ? .tab, .dgn
• ? VPF Files
• ? OpenGIS GML Files (.gml)
• ? Generic Text (.csv, .txt)

24

• Moving from current situation to a web services
  approach considering the data issue as kernel
  element of the migration
• Towards the usage of European Spatial data
  infrastructure to receive data and delivering
  geospatial intelligence

25
EUSC-Reference Facility The Scope

• The EUSC-RF is a distributed computing
  environment with the following aims
• To improve the workflow during the processing of
  a task and the collaboration between the
  personnel involved (Planning Officer, Task
  Manager, Data Manager, System Administrator,
  Image Analyst)
• To provide where applicable better tools to
  support the specific needs of the different roles
  involved in the workflow of the task
• To enable access to data acquired from a third
  party or created by EUSC during previous tasks
• To enable access to existing, EUSC external
  resources available via internet or virtual
  private networks
• To enhance the dissemination of information
  contained in a task deliverable to the customer
• The EUSC-RF shall be open and standards-based

26
What is the EUSC-RF? The Baseline Configuration

• An EUSC-RF Baseline Configuration is to be
  established in an ongoing activity targeting a
  fully operational capability.
• The RF-BC will be used as a demonstrator and to
  create awareness within the Centre.
• The EUSC-RF Baseline Configuration will focus on
  the following specific aims
• To provide guidelines and tools to better support
  the task processing workflow based on the current
  operational infrastructure, using where
  feasible components implementing Open
  Geospatial Consortium Specifications
• To access the ESA SSE Portal and to the NASA
  Portal from the EUSC Internet network to test
  and evaluate the benefits of integrating a portal
  into the RF architecture in the following phases
  to integrate web services (KIM..HMA..)

27
What is the EUSC-RF?

• In order to achieve the future aims of EUSC and
  the RF services sought will
• Enable the evaluation of hardware and software
  components for their fitness-for-use before
  integrating them in the operational EUSC
  infrastructure by testing the complete workflow
  of a task execution
• Facilitate the transition from a file-based
  communication into a robust service-based network
  based on the OpenGIS Reference Model
• Enable the evaluation of SCOTS software
  components implementing OpenGIS specifications
  and addressing EUSCs needs (ISO 19115 metadata ,
  STANAG , MIL-PRF-89045)
• Support the iterative development of
  complementary EUSC-specific software components

28
Developing the EUSC-RF in steps

• The RFQ will comprise three steps
• Step 1 Enabling the operational infrastructure
• Step 2 Adding Services
• Step 3 Additional Deployment of Services

29
Developing the EUSC-RF in steps
30
Cervantes project
31
Step 1 Enabling the operational infrastructure

• Intention
• Improvement of the operations of the Centre by
  providing support for the specific task related
  workflow of the Centre.
• Create a foundation for additional capabilties
  added in subsequent steps
• Step 1 consists of three parts
• Implement a repository for data containing all
  task-related information of the Centre including
  images, maps, feature data, documents,
  gazetteers, metadata and task-handling
  information
• Implement software components for the ingestion
  of data into that Data Repository
• Implement a first version of the Internal Portal
  including a Task Management Tool and a Discovery
  Client for the Data Manager (which includes a
  Catalog Service and a Gazetteer Service Interface
  to the Data Repository)

32
Step 1 Enabling the operational infrastructure
33
Data Import Components

• Data converters for all data formats required by
  the Centre for ingestion into the Data Repository
• List on the following slides
• Quality Control External data is imported into
  the Data Repository, but not visible or
  exportable before the data has been reviewed and
  released by the Task Manager or a data expert
• Note The services accessing the Data Repository
  need to support this
• Data import process updates also metadata (manual
  entry by data manager where required)
• Data imports must take not only inserts, but also
  updates and deletes of data items into account
  especially for vector features (predecessors,
  representations on other levels)

34
Data Import Components

• Image Scenes
• Satellite types providing imagery used by the
  Centre
• Spot
• ERS
• Landsat
• IRS
• Radarsat
• KV
• Ikonos
• Eros
• Quickbird
• Aster
• GeoTIFF
• JPEG2000 with GML

35
Data Import Components

• Task Information
• GIB (migration)
• EUSC-RF Task Information
• Task Data
• EUSC task data
• Existing tasks on CD-Rom or from file system
  (Migration)
• Gazetteers
• NGA (NGIA)
• Collins-Bartholomew
• Documents
• PDF

36
Data Import Components

• Collateral Data
• Janes
• IMINT-KDB
• Feature Data
• GML (EUSC Application Schema)
• VMAP Level 0 in VPF
• VMAP Level 1 in VPF
• VMAP Level 2 in VPF
• Shape
• Scanned Maps

37
Portal application framework
38
Web Mapping Server example
Source ISO/DIS 19128
39
Web Mapping Server example
Source ISO/DIS 19128
40
Web Mapping Server example
Source ISO/DIS 19128
41
Task Result as Hyper-document
Can we explore the document content is this
helpful ?
Do we need an audit trail for the
interpretation?
42
Images and GML
Geometry
Range Parameters
Values
Value File
Feature Instances
GML Default Style
Decompress selected parts of the image and
associated features
Spatial Index
Image Metadata
43
Internal Portal

• Information Discovery Client
• Access a (Spatial) Object Service -- a
  generalization of the different data services
  Feature, Catalog, Gazetteer and Coverage Service
• Map Viewer
• Portrayal Service (Images, Maps, Features using
  IDSS symbology)
• Task Management Tool
• Access directly while tasks are in progress
• Query all tasks through Object Service

44
Step 1 Enabling the operational infrastructure

• Authentication, Access Control, Backup and
  Recovery mechanisms will use the standard
  capabilities of the Operating System and the
  Oracle database.
• A watchdog capability is required checking
  regularly if files referenced from the Oracle
  database and stored in the file system do still
  exist.
• A Coordinate Transformation Engine to be used by
  the different data conversion tools and services
  is required. Implementation as a service.

45
Step 1 Enabling the operational infrastructure

• Several sequential activities need to be carried
  out during this step for the complete RF
  implementation
• Validation of the RF implementation in the GADNet
• Establish a Interface Control Procedure
• Transfer of the RF implementation to OITS-Net
• Validation of the RF implementation in the
  OITS-Net
• Data Ingestion into the Data Repository
• Start production

46
Step 1 Enabling the operational
infrastructure ESA Heterogeneous Mission
Accessibility ?

• In addition to the internal Information Discovery
  Client capabilities, the Data Manager must have
  the possibility to externally discover and
  visualize metadata posted by image and data
  providers ? Discovery Client in the network
  connected to the Internet

47
Step 2 Adding Services

• Step 2 consists of four parts
• Part 1 Introducing or Enhancing
• Feature Service
• Coverage Service
• Portrayal Service
• Style and Symbol Service
• Part 2 Enhancing the Internal Portal
  capabilities by enabling access to the data in
  the Data Repository and support for the added
  services
• Part 3 Exporting views from the Data Repository
  (i.e. adaptation of the data conversion tools
  implemented in Step 1)
• Part 4 Installing a version of the Internal
  Portal in the external network as an External
  Portal with limited capabilities for accessing
  the external Data Repository (i.e. initially an
  empty copy of the internal Data Repository filled
  with exported views)

48
Step 2 Adding Services
49
Step 2 Adding Services
50
Step 3 Additional Deployment of Services

• Closer Integration of the information capturing
  clients
• Service Registry / SOA Service Oriented
  Architecture

51
Step 3 Additional Deployment of Services
52
Step 3 Additional Deployment of Services
53

• Google earth at Satcen 12 Terabytes
• -10000 satellite images
• -10000 maps
• Collateral information

54
Issues

• Multiple European constellations needed to ensure
  guaranteed independent access to EO resources
• Independent EO Ground Segment for tasking and
  data delivery
• Security and reliability aspects to be properly
  addressed

55
Issues

• European Ground Segment to guarantee
• tasking,
• access
• delivery
• archival and preservation of EO data products
• service support environment

56
Standardisation Requirements
The huge variety of commercial software and
hardware, jointly with the increasing number of
data types impose a more stringent

• GML-JPEG2000

• EO Ground Segment protocol definition and
  standards for
• Catalogue access
• Tasking
• Product order
• Archive access
• Processing
• Security
• Data Delivery
• Data Quality Assurance
• Data and Product Certification

• OGC/ISO ?

57
Service issues

• Speeding up the setup of a secure european
  network to share classified information
• Provide access to geospatial and auxiliary data
  and services, from satellites to collateral data
• Service registry at european level
• GMES data policy revision ? (problem of sharing
  archives)
• or its limitation to metadata (so possible double
  purchasing at european level)
• Agencies mission revision ?

58
Thank you very much for your attention!