A Profile on the Grid Data Engine (GridDaEn)

1
A Profile on the Grid Data Engine (GridDaEn)
Xiao Nong Email xiao-n_at_vip.sina.com www.griddaen
.org www.datagrid.com.cn
2
GridDaEn Focus

• Integration
• Integrate heterogeneous mass storage resources
  located in multiple domains
• Effective and secure data operations
• Access, storage, dispatch, replication, and
  movement
• Transparent Federated services
• Name transparence
• Location transparence
• Protocol transparence
• Uniform access

3
GridDaEn Overview
Environment
Data Center 2
Data Center n
Data Response
Publishing
NFS
Data
4
GridDaEn Architecture

• Access interface layer
• Data service interfaces for grid users
• System service layer
• Metadata service
• Data service
• Monitor service
• Security service
• Data operation layer
• Access interfaces to fabric storage

5
GridDaEn Architecture
6
GridDaEn Components

• DRBData Request Broker
• MDISMetaData Information Server
• GridDaEnSISecurity Infrastructure
• GridEyeMonitor System
• GridDaEnSM System Management

7
Distributed Data Access and Management
Client
High-level MDIS
MDIS
Optimization and Scheduling
Data Service
Data Service
Data Service
Local MDIS
Local MDIS
Local MDIS
Data Center A
Data Center B
Data Center C
8
Data ServiceDRB Data Request Broker

• Access dispatch
• System status and location of data
• Data management
• Uniform viewglobal logical view of data
  resources
• Data replicating and moving
• Data operation
• Posix like APIs create, open, read, write,
  close, etc.

9
Data ServiceFederated DRB Service

• Distributed collaborated service
• Remote data access
• Distributed data storage
• Collaborate management
• Distributed cache and replica
• Management of cache and copies
• On-demand storage and access
• High performance data transport

10
Metadata Information Service

• Global MDIS server
• System information
• Index information
• Local MDIS server
• Domain information
• File information

11
Metadata Information Service

• Metadata access and management
• Uniform data namespace
• Data locating, registration, and publishing
• System information management
• Data discovery
• Replication policy and management
• Nearest replica access
• Control of replica privileges
• Management of replica lifetime

12
GridDaEn Security

• GSI Compliance
• Only use Proxy function of GSI
• Separate GSI from Globus Toolkit
• GridDaen Security Functionality
• Secure authentication
• Communication encryption
• Single sign on
• Role-based authentication management
• Multi-level user mapping

13
GridEye Monitor System
up-level system

• Based on GMA
• Producer/consumer model
• Web Service Interface
• Multi-layer structure
• Local monitor--LM
• Global monitor--GM

Global domain
GM
manager
14
GridDaEn Tools

• User administrative client
• User data operation client
• UIs supported
• Graphic user interface
• Command line
• APIs and SDKs

15
GridDaEn v1.0 Features

• Virtualized resources
• Uniform operation and management
• Coordination of autonomic system
• High usability and security
• Scalability
• Multi-level authorization
• Performance optimization

16
Our Future Works

• GridDaEn v1.0
• Now available in our website
• www.griddaen.org
• www.datagrid.com.cn
• GridDaEn v1.1
• web service Based
• Available on 2005-1
• GridDaEn v2.0 beta
• Structured data and semi- structured data
  supported
• Related database ,XML database
• More native file system and access protocol
  supported
• Performance optimization
• Available on 2005-4