Introduction to PGRADE Portal handson

1
Introduction to P-GRADE Portal hands-on

• Gergely Sipos
• sipos_at_sztaki.huMTA SZTAKI
• Hungarian Academy of Sciences

portal.p-grade.hu
2
Open the tutorial sheets from ISSGC webpage

• www.issgc.org ? Programme

3
Infrastructure
Client machines
MyProxy name issgc08 MyProxy password issgc08
portal.p-grade.hu/multi-grid
P-GRADE Portal(SZTAKI, Budapest)based on v2.7
GILDA MyProxy server
Proxy
Proxy download
gLite
GILDA Grid services
4
Exercise 1Import and execute a pre-defined
application Traffic simulation
Generates the road network map of Manchester
Put traffic lights and cars on the map. Simulate
road traffic.

• Download workflow archive
• Import to your account
• Open workflow in editor
• Map jobs to GILDA broker
• Submit workflow
• Monitor execution
• Download result

Compares and visualizes the density of cars
5
Exercise 1Import and execute a pre-defined
application Traffic simulation
Generates the road network map of Manchester
Put traffic lights and cars on the map. Simulate
road traffic.

• Download workflow archive
• Import to your account
• Open workflow in editor
• Map jobs to GILDA broker
• Submit workflow
• Monitor execution
• Download result

x.jpg
Compares and visualizes the density of cars
6
Exercise 2 Solve matrix multiplication on
GILDA(one job workflow)

• Job executable
• C code, compiled on GILDA UI
• Expects command line parameters M V
• Knows nothing about the grid
• Job input/output files
• Program reads matrixes from two files called
  INPUT1 and INPUT2
• Program writes result matrix into file called
  OUTPUT
• Local execution on a PC ./multiply M V
• Task Execute the program on EGEE, transfer input
  and output files in Sandboxes from the client

INPUT1
INPUT2
3 32 1 31 1 13 3 3
3 35 2 76 7 93 8 2
Binaryexecutable
3 325 35 29 14 17 18 42 51 54
OUTPUT
7
Exercise 3 Save the multiplication OUTPUT on a
Storage Element and register in a File Catalog
INPUT1
INPUT2

• Modify output file type from Local to Remote
• Specify a logical file name as target location
• lfn/grid/gilda/tutorials/issgcXX

3 32 1 31 1 13 3 3
3 35 2 76 7 93 8 2
Binaryexecutable
lfn/grid/gilda/tutorials/issgcXX/
gLite File Catalog
gLite Storage Element
Logical file name is defined by you
3 325 35 29 14 17 18 42 51 54
Storage Element is selectedautomatically by
gLite middleware
OUTPUT
8
Exercise 4 Combine jobs to build a
MatrixOperations workflow

• AB, 0T AB, 1

Matrix A
Matrix B
A B
A B , 0
A B , 1
A B , 0 T
( A B , 0 T ) ( A B , 1 )
B
9
Tutorial sheet
Available on www.issgc.org
Login to Portal
Portal accounts user01 user40 use your
numberPortal passwords user01 user40
Recommended to work in pairs
No need to wait for jobs to finish proceed to
next exercise
10
Explanation of user authentication
MyProxyserver
Proxy
VOMSserver
GILDAservices
Tutors generated and uploaded your proxy
issgc08issgc08
P-GRADE Portal server
userXX userXX
Login psw based authentication
Proxy based authentication
11
Trick Job level fault tolerance

• Exclude erroneous sites from the grid by
  controling the brokering process
• Open the JDL editor of the job in the Workflow
  Editor
• Write other.GlueCEInfoHostname ! hostname
  into the Ranks requirements window
• Automatic job resubmission
• Add ShallowRetryCount 3 into JDL

12
Demo

• Parameter study exercise with P-GRADE portal
• Exercise is available on ISSGC webpage

13
PS TutorialMatrix multiplication PSparameter
study workflow with 5 parameters
Multiplication job
1 2 3 4 5 6 7 8 12
. . .
. . .
. . .
2 1 3 1 1 1 3 3 3
Matrix2
14
PS Tutorial Matrix multiplication PSparameter
study workflow with 5 parameters
1 2 3 4 5 6 7 8 Y
Auto generator
9 lt Y lt21, step 3
Auto generator
Multiplication job
1 2 3 4 5 6 7 8 9
1 2 3 4 5 6 7 8 12
1 2 3 4 5 6 7 8 15
. . .
. . .
. . .
2 1 3 1 1 1 3 3 3
Input files stored on SEs and registered in LFC
catalog
Matrix2
Output files stored on SEs and registered in LFC
catalog