NRGIS Data Store

1
NR-GIS Data Store
Joe Gregson NR GIS Coordinator
NR Geospatial and Information Technology
Team Inventory and Monitoring Program National
Park Service
2
Natural Resource and Service-wide GIS Metadata
Database and Data Server System(NR-GIS Data
Store)
NR-GIS Data Store Application Development Team
Chris Dietrich Danelle Malget Christie
McDonald Lisa Nelson Dan Warner Qian Hong Wu
3
NR-GIS Data Store Nomenclature

• NR-GIS Metadata and Data Store
• Web application with user interface for the
  NR-GIS Metadata Database and NR-GIS Data Server
• NR-GIS Metadata Database
• Oracle database that indexes XML metadata records
  in modified Dataset Catalog format
• NR-GIS Data Server
• Physical host and HTTP/FTP services to store and
  access data and metadata files (1 TB storage)
• NPS Metadata Editor
• XML-based, desktop metadata editor to support
  NR-GIS Data Store NPS Metadata Profile.

4
Natural Resource and Service-wide GIS Metadata
Database and Data Server System(NR-GIS Data
Store)

• Enterprise Data Management and NPS-wide Metadata
  System Goals
• Integration of Existing and New Projects
• Services and Technical Support
• Current Status and Future Plans

5
Overview of Enterprise Data Management
User Access
Data Repositories
Information Services
Data Stewards
NPS Focus, Clearinghouse, Partners
Public
Online Data Repositories
Offline Data Repositories
Data Store, NatureBib, NPSpecies, Others
PrivateNPS Users
Partner Data Repositories
- Stewards manage respective data and metadata -
Repositories maintain data holdings and support
stewards and services - Services support
internal/external users and bureau/agency mandates
6
Dynamic Services Enterprise GIS Architecture
Extra-NPS IMS/SDE Services
Intra-NPS IMSSDE Services
Internet
Data Exchange
NPS Park Data
The National MapNational Geographic Geog.
Network, etc. Publishing NPS Data
NPS National Data
NPS Regional Program Data
Partner/Vendor Data Sources
7
Infrastructure Requirements

• Data standards to allow sharing and roll-up of
  base data and updates
• A central repository of standard, "master" data
  layers to organize data and collect updates
  (e.g., file server or geodatabase)
• A common process for data stewards to post
  retrieve updates of data and share with partners
• Technical and application development support to
  maintain infrastructure and assist with deploying
  applications/systems

8
NPS-wide Metadata System Goals

• General consensus of the IM, NR, GIS, and
  NPSFocus programs to
• Reduce the complexity and duplicity of existing
  systems and workflow
• Develop an integrated system to fulfill user
  requirements and government mandates

9
Natural Resource and Service-wide GIS Metadata
Database and Data Server System(NR-GIS Data
Store)

• Enterprise Data Management and NPS-wide Metadata
  System Goals
• Integration of Existing and New Projects
• Services and Technical Support
• Current Status and Future Plans

10
NPS Metadata System Plan
Local Users
E.g., Legacy Systems
NPS GIS Clearinghouse in ISITE
Editor Applications (101 ways)
Internet Users
Parse,etc.
Moved to NR-GIS in Summer 2004
Web Apps.DataCat, NR FTP Data Search
Process,Archive,etc.
NR IM Inventories
Migration to NR-GIS ongoing from Spring 2004
11
NPS Integrated Metadata System Plan
RevisedSystem
Editors SMMS, ArcCat., Dataset Cat.to NPS
Metadata Ed.
Create, Edit, Parse, etc.
Internet Users
Data and Metadata Upload Tools (In Work)
Local Users
Download Batch Tools (In Work)
NR-GIS Data Store in Oracle and XML based on NPS
Metadata Profile
Metadata Clearinghouse in NPS Focus

• Development in work
• Data transfer in 3/05

• Read version now
• Uploads in 3/05

12
Integrate Existing and New Projects

• Backend Operations
• Legacy and Stovepipe Systems
• Data Standard NPS Metadata Profile
• Front-end Interoperations
• Web Links to Data and Metadata
• Directed Searches coded URL links with
  variables to return custom search results from a
  web database application
• Web Services

13
Backend Operations Legacy Systems

• NPS GIS Clearinghouse (metadata/data)
• Dataset Catalog (web and desktop)
• Metadata Editors ArcCatalog,SMMS,NPS
• NSDI Clearinghouse, GOS NPSFocus
• NR FTP (data server and web search app.)
• NatureBib (BibKey and data transfer)
• NPSpecies/Biodiversity Data Store
• NPS GIS Imagery Database
• NR Universal Web Login (UWL) System
• GIS and NRDT (BOFAT) Standards
• NR Inventory Status and Tracking

14
Backend Operations NPS Metadata Profile

• Based on FGDC COTS Implementations
• Extensible Mark-up Language (XML)
• Extension(s) of FGDC Standards
• Concatenates Current Standards/Profiles with NPS
  Requirements (esp. IM needs)
• FGDC Geospatial Content Standard
• FGDC Biological Data Profile
• ESRI Profile of the FGDC Geospatial Std.
• NPS Information (parkcode, stewards, etc.)

15
Backend Operations NPS Metadata Profile

• Implementation
• Std. XML Document Type Definition (DTD)
• Drafted Addendum to FGDC Documentation
• XSL/XSLT Stylesheets for Custom Display

16
Define standard with XML DTD/schema

17
Create Addendum to FGDC Documentation
18
Develop XSL transforms for display
19
GIS Data Standards
20
Front-end Interoperations

• Web Links to Data and Metadata
• http//nrdata.nps.gov/...
• Directed Searches
• Display w/in NR-GIS Data Store Interface
• Currently operational for park data
• Version 2 will include NatureBib, NPSpecies
  (Biodiversity Data Store), and other projects
• Web Services (Version 3)
• Query and return data for backend ops.
• Display w/Other Applications Interface
• True Interoperability
• Enhanced NatureBib and NPSpecies tools

21
Natural Resource and Service-wide GIS Metadata
Database and Data Server System(NR-GIS Data
Store)

• Enterprise Data Management and NPS-wide Metadata
  System Goals
• Integration of Existing and New Projects
• Services and Technical Support
• Current Status and Future Plans

22
Infrastructure, Services, and Support

• Enterprise Data Management
• Static Services (clearinghouse, file-based data
  and metadata)
• Dynamic Services (ArcSDE, ArcIMS)
• Infrastructure
• User Services and Technical Support

23
Infrastructure

• NR Web Application Servers
• NR WASO Web Applications
• NR-GIS ArcIMS Applications (in work)
• IM Networks Applications (planned)
• Data Server (1 TB available to users)
• NR Database Servers
• Oracle, SQL Server? (under discussion)
• NR-GIS Geodatabase (Oracle, in work)
• Network Connectivity
• Bandwidth 2 T-1 (3 megabits/second)
• Internet/Extranet and Intranet
• DOI/OCIO IT Policies and Mandates

24
User Services and Technical Support

• Provide Services, Not Stewardship!
• RD requirements and standards
• Acquire and maintain infrastructure
• Plan and develop applications and tools
• Manage NR-GIS Data Store
• Technical Support
• Provide Training (metadata, data mgmt., GIS)
• Assist with data and metadata issues
• Advise on technical issues data modeling, DB
  design, standards development, RDBMS and
  ArcSDE/IMS implementation, and web applicaton
  deployment

25
Natural Resource and Service-wide GIS Metadata
Database and Data Server System(NR-GIS Data
Store)

• Enterprise Data Management and NPS-wide Metadata
  System Goals
• Integration of Existing and New Projects
• Services and Technical Support
• Current Status and Future Plans

26
Current Status of NR-GIS Data Store

• Making final push to release Version 1
• Beta test in mid-February
• Release Version 1 in late-March 2005
• Final clean-up of GIS Clearinghouse, base carto
  (partial), and imagery metadata
• Send public metadata records to NPS Focus
• Training goal for May 2005
• Combined NRDT and NR-GIS Data Store

27
Current Status of NR-GIS Data Store

• Functionality of Version 1
• Search and display of public records (done)
• Directed search for NPS units metadata
• Secure logins to manage records
• Upload NPS Profile metadata files in XML
• Upload related data files to Data Server
• Add/edit keywords for NPS and GOS
• NPS Metadata Editor
• Beta release for NPS Information section editing
  in March 2005

28
Future Plans for NR-GIS Data Store

• Functionality of Version 2
• Advanced search and display
• Directed searches for NatureBib, NPSpecies, and
  general web applications
• Upload/synchronization of existing records
• Upload/management of private or sensitive data
  and metadata
• Dynamic updates of public records to NPSFocus,
  GOS, and NSDI Clearinghouse
• Release of GIS/NRDT standards tracking
• Batch load tools including Dataset Catalog
• Integration w/NPS Metadata Editor

29
Future Plans for NR-GIS Data Store

• Functionality of Version 3
• Data retrieval web service for NatureBib,
  NPSpecies, and general web applications
• Data synchronization web service for NPS
  Metadata Editor
• Any new functional requirements identified in
  previous versions

30
For the latest news and more information, visit
NR-GIS Metadata and Data Store Help
at http//science.nature.nps.gov/nrdata
NR-GIS Data Store Application Development Team
Chris Dietrich Danelle Malget Christie
McDonald Lisa Nelson Dan Warner Qian Hong Wu