Title: E-Science
1E-Science Grid Computing in China
- Dr. Jin-Peng HUAI Beihang University
May 10, 2004
2Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
3Opportunity of e-Science
distributed
Provide new opportunity and challenge for
information science technology
4Evolvement of Internet-oriented Software
Evolvement of Computing Paradigm
Scope
Internet Application
Client/ Network
Network Application
Client/ Server
Word Processing
Mainframe Computing
Mathematic Computing
Internet
Host PC
Intranet
5Evolvement of Internet-oriented Software
Evolvement of Access Methods
Scope
Internet Apps
Web Services
XML/HTTP
Network Apps
Services
MOM
ORB
Homogeneity Apps
Components
Objects
Program
granularity/coupling
compact
loose
coupling
6Past PresentContributions of Computing
Technologies
- A New Approach to do Research
- High Energy Physics
- Earth Simulation
-
- An Effective Manner to do Communication
- E-Mail
- FTP
- WWW
-
- Help the RD Cooperation by providing a
convenient Intercommunication Manner
7Todays RD ActivitiesBrings New Requirements
- Collaboration in Wider Area
- Cross the boundary of Domain, Subject,
Organization - Share the Resource / Collaborate between Resources
Domain Typical Project Main Characteristic
high-energy physics Long Experimental Period High Volume of Experimental Data Rapidly Aggregation and Sharing of Analysis result Participation of scientists all over the world
Biologic computing Distributed storage of genic data Diverse Data/Metadata Format Dynamic Information
8Current status of RD Resources (1)
- Great Gross of RD Resource
- Global
- Data Resource 7PB/year
- Computing Capacity First 50 Computers in Top500
(November, 2003) 570TFlops - In China
- Computing Capacity First 50 Computers in Top100
- 30TFlops
- Hundreds of National Key Labes
- More RD Instruments then whole EU!
9Current status of RD Resources (2)
- Lack of Effective Usage of RD Resources
- the using efficiency of science instrument of
China is less than 25, while in some developed
countries it is more than 150
10Summary
- 2 Basic Understandings for RD Resources
- Need of more sharing and cooperating
capabilities. - Great Total Amount with limited utilization.
- So, It is necessary to give a better approach to
- SHARE the resource capacity in Wider Area.
- COLLABORATE among more Resources to solve
BIGGER problems - Give scientist a more EASY-TO-USE interface to
help them using the environment with TRANSPARENCE.
11Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
12How to evaluate the Value of Computing
Technology to science research
- In the past
- Computing capability the only evaluation means
- In a network computing environment
- We need another dimension
- SHARING COLLABORATING Capability!
KFlops
MFlops
GFlops
TFlops
Computing Capability
Internet
VS
13How to evaluate the Value of Computing
Technology to science research
- X Sharing and cooperating capability
- Y Computing capability
Computing capability
TFlops
GFlops
MFlops
Sharing and cooperating capability
intranet
extranet
internet
14How to evaluate the Value of Computing
Technology to science research
Computing capability
Network-based Research Environment (e-Science)
TFlops
GFlops
Internet
MFlops
Sharing and cooperating capability
intranet
extranet
internet
15So
- So , The key of Network-based Science Research
Environment ( or E-Science) is - Give an Infrastructure to improve the
- sharing capability
- collaborating problem solving capability
- of RD resources from multi-domains and
multi-organizations!
16E-Science Related Project
17E-Science Related Project
- Projects
- UK e-Science
- PACI/DTF/EDTF
- Science Grid
- DoD GIG
- EU DataGrid
- Industry
- CORBA,DCOM, J2EE, Web Services
- IBM Business on Demand/Business Grid
18Sharing CollaborativeTwo Threads
- Sharing of
- Information
- Enterprise Computing
- CORBA, COM, EJB.
- Computing Power
- Cluster, Metacomputing
- Computing Grid
- Key points!
- Service-oriented
- or Service-centric
- Middleware
Network Computing
19Sharing CollaborativeEnterprise Computing
Cooperation scale
Service oriented Computing
P2P computing
Inter- organization
Web Services
Distributed object Component technology
Inner- organization
OO technology
Inner- department
Resource sharing scale
local
global
20Sharing CollaborativeEnterprise Computing
Cooperation scale
Inter organization
Inner organization
Inner department
Resource sharing scale
local
global
21Sharing CollaborativeGrid Computing
Cooperation scale
Cross subject
Service-oriented Grid Computing (OGSA)
Internet computing
subject
Meta-computing or Computational Grid
Special problem
Resource sharing scale
local
global
22Sharing CollaborativeGrid Computing
Cooperation scale
Cross subject
Single subject
Special problem
Resource sharing scale
local
areal
global
23Putting them altogether
Cooperation scale
Cross subject
Single subject
Special problem
Resource sharing scale
local
global
24Conclusion
- 2 Threads are now merging
- Enterprise Computing
- Grid Computing
- 2 Key Technology for Resource sharing and
collaborating - Service centered is an important technical trend
to construct large scale distributed system - Middleware is an important approach to bring
interoperation and integration to RD resources
25Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
26Grid/E-Science Projects in China
- NSFC
- Network-based Science Research Environment (NSFC
e-Science Key Project) - Ministry of Science and Technology
- National High-tech Project (863)
- High Performance Computers and its Kernel
Software - Chinas Network-based Software Platform
- Ministry of Education
- ChinaGrid An Education Application Grid
- Chinese Academy of Science
- China Science Data Grid (SDG)
27Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
28Essence of the Project
Application demands Set D (Demand)
Dynamic Mapping between Set D R To achieve MAX
VALUE of the whole system Max (Wd ? benefit (D)
Wr ? usage (R) )
MD? R
Forecasting Optimizing
Resources Set R (Resource)
T
29Essence of the Project
Application demands Set D (Demand)
Treating Resources as services Masking
the heterogenous resources Services Composition
Cooperative work of resources Service-Oriented
Architecture loose coupling,
dynamic composition Middleware
Simplify the development, deployment and
management of system
Dynamic Mapping between Set D R To achieve MAX
VALUE of the whole system Max (Wd ? benefit (D)
Wr ? usage (R) )
MD? R
Forecasting Optimizing
Resources Set R (Resource)
T
30Testing Environment of NSFC E-Science Project
- Testing Environment
- Testing bed
- Network Physical Resources
- Testing Software Infrastructure
- Middleware
- Common Services
- Testing Applications
31Testing Environment Software Infrastructure
- The basic idea of software platform
- Resources encapsulation
- Service share
- Cooperative work
- Dynamic binding between application and resources
- Service Composition describe the complex job.
high-energy physics
Biology computing
Atmosphere inspection
The integrated testing-bed platform For science
activity environment
Computing resources
Storage resources
Instrument and equipment
Software resources
32Testing Environment Software Infrastructure
User Supporting Layer
Security and system Mngt.
Dev. Methods Tools
Application Support Layer
Resource Service Layer
33Software Infrastructure3 Objectives
- Collaborate-able
- Dynamic Relations between Resources
- Multi-granularity Collaboration (Data, Service,
Process) - Manageable
- Uniform Resource Abstraction
- Management Architecture
- Self-Orgnization, Self-Configration,
Self-Optimization - Trust-able
- Trust Management Policy based Access Control
- Reliability Fault-Detection, Fault-Tolerance,
QoS Mngt.
34Software Infrastructure9 Key Technologies
high-energy physics
Biology computing
Atmosphere inspection
support
Domain Apps Development Methods Technologies
Platform Architecture
User Supporting Tech. (GUI, Portal, Programming
model)
Management
Security
Res. Integrating Mngt. (MDS.)
Service Composition Collaboration
guide
assistant
Common Services (for Resource Sharing)
Resources Encapsulation Service Runtime
Management
compatible
Computing resources
Storage resources
Instrument and equipment
Software resources
35Software InfrastructureArchitecture
Security and system management
Development Methods and Tools
36Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
37National High-Tech Project (863)
- High Performance Computers and its Kernel
Software System. (CNGrid) - Technical Objectives
- Testing-bed Next Generation National Information
Infrastructure - Industry-Level Apps e-Science, Environment,
Manufactures - RD of Grid-enabled High Performance Computers
- Technical Breakthroughs in Grid Research
Architecture, Middleware, Application, Security
Management.
38Research
- Develop a Grid-aware HPC with more than 4TFlops
- Construct a China National Grid With 5-7TFlops
Computing Capabilities. - Develop a Grid Middleware with Own IP Rights
- Construct Several Killer Applications in
Science Research, Economy Construction, Society
Development and National Defense. - Develop Several National Standards on Grid
Technology
39China National Grid An Overview
Research
Environment
Manufacturing
Service
Appl. Grids
Development Environment
User Environment
Grid Software
Grid System Software
HPC
Database
Data
Apps
Grid Resources
Internet
40Grid Nodes across China
41High-Performance Computer Research Development
- Develop two gt4TFlops HPCs
- Lenovo
- Intel 64-bits Itanium 2 processor
- Peak Speed 5.324 Tflops
- Dawning
- Adopt AMD 64-bits processor (Opteron)
- Expected peak value capability10 Tflops
42Lenovo DeepComp 6800
- Finish in Nov, 2003
- Performance
- Floating Spped 5.324Tflops
- Linpack Benchmark Floating Performance4.183TFLOPS
- Rank 14 in Top500 (Nov,2003)
- Total Performance Rate 4.183/5.324 78.5
- Jan 2004 Installed in China National Grid
- North Primary Node
- Computer Network Information Center of Chinese
Academy of Sciences (CNIC/CAS)
43Grid Software
- Feb 2004 Final Release Version
- Mar 2004 Deploy to CNGrid Nodes
- Grid System Software
- Heterogeneous resources oriented
- Communication
- Basic Resource Mngt, User Mngt Job Scheduler
- Network File System
- Application Development Environment
- Debugging Environment
- Performance Tunings Tools
- Grid Usage Environment
- Grid Community (Web Portal)
- GSML Grid Service Markup Language (similar with
HTML)
44Grid Software Layered Architecture
compute
data
software
others
Application Layer
security service
Job service
User management
Data service
Grid monitor
Grid management
User environment
Grid software
System Layer
Information service
Grid resorces(machines,programs,equipments,file
systems,databases) Wrapped into WS or GS
Resource Layer
45Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
46China Science Data Grid
- Lead By
- Computer Network Information Center (CNIC), CAS
- Integrating Science Data from more than 40
institutes across China - Geographical Distributed
- Heterogenous Metadata Format
- Heterogenous Database / Data Format
- Applications
- China Virtual Observatory (CVO)
47Science Data Grid Middleware Architecture
Application
Applications
SecuritySystem
Info. Service
Grid API
Applications oriented Unified Program Interface
Data Res. Broker
Multiple Data Resources Cooperate Access
Uniform Access Int.
Uniform Access Interface of Single Data
Resource
Local Data Mngt System various of RDBs, File
Systems
Local Data System
databases
48Science Data Grid Middleware Software Modules
Structure
49Science Data Grid Data Services Architecture
50Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
51China Grid Forum - CGF
- Found in October 23, 2002
- Target
- Promote Grid RD Capabilities
- Exchange Experience
- Establish Technical Standards
- Build a Bridge between academe and industry
52China Grid Forum-CGF
- The 1st CGF was hold in September 12th, 2003
- Organization structure
- Consultant council
- executive council
- Working group
- Grid architecture
- Data grid
- Information gird
- Application grid
53Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
54Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- Founded in 1952, with Merger of the Aeronautical
Departments of 8 Famous Universities, including
Tsinghua University and Beiyang University.
55Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- 1952 BIA Beijing Institute of Aeronautics
- 1988 BUAA Beijing University of Aeronautics
Astronautics - 2002 BUAA Beihang University
56Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- Now BUAA has evolved into a Multi-disciplined
Research-oriented University of Science
Engineering with an emphasis on Aviation and
Space Travel. - It is one of the important bases for educating
and training High-Quality personnel and
conducting scientific research in China.
57Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- . BUAA is situated in Zhongguancun Science Park,
next to Chinas National Olympic Center - . With an area of 120 hectares, and a new campus
in the suburbs of city with an area of 100
hectares is under construction.
58Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- BUAA is listed in the top 12 key Universities and
receives development funds from the Central
Government of China. - The BUAA library has a total area around 24,000
square meters and a seating capacity of 2,100 in
13 reading-rooms, and a collection of 1,200,000
books, journals and electronic publications.
59Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- BUAAs Sports Facilities include a modern
gymnasium capable of holding international
competitions, a sports ground with sophisticated
facilities, a swimming pool, and in-door tennis
courts.
60National University Science Park
61(No Transcript)
62(No Transcript)
63(No Transcript)
64Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- Faculties and Students
- 3100 Faculty and Staff Members
- 360 Professors
- 690 Associate professors
- 14 Academicians of Chinese Academy
- Over 26,000 students, including 8000 are
- Graduate students and post-doctoral researchers
65Beihang UniversityBeijing University of Aero.
Astro. (BUAA). Since 1952
- Education Systems
- 14 schools
- 5 departments
- 6 educational organizations
- 45 undergraduate programs
- 72 master's programs
- 44 doctoral programs
- 12 post-doctoral stations
66Many staff members studied in the UK.
- Edinburgh University Prof. LI Wei, President of
BUAA, Academician of CAS - UMIST Prof. TANG Xiaoqing, Vice-President of
BUAA Prof. CHEN Zongji, Deputy Director of the
Academic Committee Prof. ZHANG Qi, Deputy
Director of the Graduate School - Glasgow University Prof. TAO Zhi, Dean of the
School of Jet Propulsion - Prof. YAN Ying, Director of International
Division of BUAA, gained her PhD from Ulster
University - etc.
67Recent cooperation with UK
BUAA UK Universities Cooperation Contents Starting Date
School of Material Science and Engineering QMUL Master Education Sept. 2001
School of Science Brunel University Theory and Computation on Non-linear Engine System Apr. 2002
School of Mechanical Engineering and Automation Kings College London Application of Organization Theory in Astronautics Apr. 2003
Bioengineering Department QMUL Master Education Sept. 2003
School of Mechanical Engineering and Automation Cranfield University Master Education Sept. 2003
School of Material Science and Engineering University of Manchester Research on Invalidation Mode of Heat Barrier Coating Jan. 2004
68Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
69Related Works in BUAA
- In charge of 863 Grid Project (CNGrid)
- Taking the Lead in the NSFC e-Science Project
- Upstanding Cooperation relationship with
Enterprises (Intel, IBM, Nokia) - Excellent RD Group in China
70Related Works in BUAA
- Network Computing and Software
- WebSASE Web Service based Application Supporting
Environment - Grid middleware Web Service based Grid System
WebSASE4G - Domain-Oriented Software Production Platform -
SoftproLine - Network Security
71 Web service and Grid computing
- Web service
- a novel middleware in application data and
function sharing on Internet. - a business application pattern on Internet
- provides description,index ,query, accessing,
communication and interaction criterion through
International standard open protocols (i.e.
UDDI?WSDL?SOAP and so on) - widely adopted/supported by enterprises.
72 Web service and Grid computing
- Grid Computing and Web Service orient similar
application requirements and scenes - Grid computing pays attention to specific
application pattern(VO, On-Demand),while web
services emphases normalized software
realization(W3C standard) - Web service provides a simple, effective and
standard realization pattern for constructing
Grid computing infrastructures on Internet - Integration of Web service and Grid computing has
been represented in numerous Grid Computing
research and development Projects in and aboard
such as GT3
73WebSASE An Overview
- Web Services-based Application Supporting
Environment Web service-oriented middleware and
software running supporting environment which
unifies application deployment, running, monitor
and management. - Supporting simple Web service and complicated Web
service applications
74WebSASE An Overview
- Web service complicated application Pattern
- use MVC pattern for reference to construct
application - Deal with business logic by Web service recursion
nesting - Provides means to concentrated exhibition and
customization the users view
75WebSASE Architecture
76WebSASE Components Using Scenario
77WebSASE4G An Overview
- What is WebSASE4G?
- A web service-oriented Grid application
supporting Environment (WebSASE for Grid) - WebSASE4Gs characters
- Web service technology abstract based and
realized grid services including resource
services, common services and domain services. - Realized unified grid services publication,
running and management ,providing open grid
service running environment - Constructing grid service basic architecture
which supporting resource services, common
services and domain services running
78WebSASE4G Technical Architecture
Image process
Grid application
biology information
remote education
Mass data
Hydrodynamics
5 Grid service Security control mechanism
Grid service Common Supporting platform
4 Distributed Management And Monitor Mechanism
7 Grid service exhibition and unified
accessing mechanism
2 Metadata And Distributed Information Service
architecture
3 Grid job schedule and
coordination mechanism
6 service data storage and Effective
trans- Mission mechanism
1 Grid service representing? mutual operation
mechanism And grid service container
Grid Resource
Heterogeneous resource
79WebSASE4G Components Architecture
Image process
Grid application
biology information
remote education
Mass data
hydrodynamics
Grid Service Portal End-user oriented interaction
Java-based SOG-API
5 Grid service Security control mechanism
4 Distributed Management and Monitor
mechanism
Grid service Common Supporting platform
7 Grid service exhibition and unified
accessing mechanism
GS Designer auxiliary toolkit
Grid Service Workflow Engine Service-oriented job
description, schedule and running
GISA providing Unified Services view
CA SOAP Secure communication
AMC Plugins
2 Metadata And Distributed Information Service
architecture
3 Grid job schedule and
coordination mechanism
6 service data storage and Effective
trans- Mission mechanism
1 Grid service representing? mutual operation
mechanism And grid service container
Grid Service Server Resource integration and
service control
Grid Resource
Heterogeneous resource
80 WebSASE4G is a service-oriented, OGSA-based
computing Environment which provides necessary
running platform and auxiliary development
toolkits.
WebSASE4G resource (service) and service
instances status monitor
Web-based job schedule and implement monitor
81WebSASE4G kernel system
WebSASE4G is a service-oriented, OGSA-based Grid
supporting Platform which provides necessary
running platform and auxiliary development
toolkits developed by BUAA.
UDDI server
BHU WSDesigner Simplifies grid Services
development
Visual composed service Modeling toolkit
82Grid application Aero Astro Digital Museum
Human-machine interaction Mechanism
airplane exhibit hall
Museum entrance
Realization technology
83Grid application Virtual Olympics Museum
virtual five-birds Play
Museum content
????
Virtual five-birds Play
Realization technology
84Domain-oriented Software Production Line
- Application practice indicates that 70 percent of
the errors in grand software system development
are made in the process of requirement and design - Requirement project describing the problem and
restriction-what is it? - Software architectureproviding the blue print to
problem solving -abstract description to
structure, function behavior, cooperation and
mutual operation among data and function process
components-How ? - ProblemHow to make graceful transition and
coherent evolution from requirement modeling to
architecture ?
85SoftproLine
- Software stipulations model GOP which unified
description to software principal part, objective
and operation . Based on multi-classes logic and
natural homostasis mapping GOP establishs
graceful mapping between formalized stipulations
and software design - Bringing forward rule-based description language
RDL and ontological language and model to???? - presenting soft-bus based multi-engine
coordination architecture which supporting
natural matching from software architecture to
component and developing a domain-oriented
software production platformSoftProLine applied
in many domain to realize zero programming
86SoftproLine
Operation application target
Cooperation info bus
Component adapter
Distributed component service
Operation service engine 1
Operation service engine 2
Operation service engine 3
Operation service engine 4
Operation service engine n
Schedule engine
Knowledge repository
Application service supporting platform
Information storage supporting platform
Common service Platform
87Network Security
- Design and analysis for network security
protocols - Access Control of distributed systems
- Secure group communication
88Network Security Backgrounds on Security
Protocols
Vulnerability of security protocol
The attack cost is lower, but the consequence is
serious.
89Network Security Main Problems on Security
Protocols
- Two fundamental problems
- 1.Theoretic model
- How to model the run environment and security
properties for security protocols? - 2.High computational complexity
- A large number of participants.
- Infinite message operations and exchanges
- Concurrence and interleaving runs of protocols
-
90Network Security Results of security protocols
A novel cryptographic protocol algebra model is
Proposed
- A new algebra theory is built for describing the
run and security of protocols. - Attack acts and security properties of protocols
are characterized with algebraic and logic
techniques.
We built the rigorous mathematical basis and
developed a new approach to the formal analysis
of security protocols
91Network Security System for security protocols
An efficient automatic analysis system (SPA) is
developed
The efficiency of ACT-SPA
92IntegrationOur Aims...
?Perfect Running EnvironmentEffective Software
Development
Security and User Management
Software producing plat for domain (Softproline)
Tools for registry and deploy
Software resource
Web service Grid service running supporting
plat
System platform
93Agenda
- Motivations
- Technical Analysis
- E-Science Grid Computing in China
- NSFC Network-based Research Environment
- National High-Tech Project (863)
- China Science Data Grid (SDG)
- China Grid Forum
- Related Works in Beihang University
- Beihang University A Brief Introduction
- E-Science Related Works in Beihang University
- Possible Cooperation
94What to do next?
- joint RD group in common interesting domain
through some exchange program - joint hold related Int. Con.
- establish Sino-UK joint e-Science working Group,
testing-bed or apps. - Other Cooperation between the University and BUAA
95Question?