CondorG

1
Condor-G
2
Goal Answer your questions

• What is Condor-G?
• What is Condor-C?
• How can they be used?

3
Why didnt we discuss it earlier?

• Our lecture came before other technologies like
  Globus

4
What is Condor-G?

• Condor-G is not a separate program
• Condor-G is the grid universe
• Recall Condor has universes to describe type of
  job
• Vanilla
• Standard
• Java
• Parallel (MPI jobs, and others)
• Another universe
• Grid

5
What is Condor-G?

• Condor-G lets you submit jobs to other grid
  systems
• Originally G was for Globus
• Today G stands for Grid because it applies to
  several systems
• Minimal changes to your submit description

6
Condor(Vanilla)
Condor-G(For GT4)

• Universe vanilla
• Executable analysis
• Arguments 20 10
• Log analysis.log
• Output analysis.out
• error analysis.err
• transfer_input_files x, y
• should_transfer_files YES
• when_to_transfer_outputON_EXIT
• Queue

Universe grid grid_resource gt4
https//ice-st-b01.pdc.kth.se Fork Executable
analysis Arguments 20 10 Log
analysis.log Output analysis.out error
analysis.err transfer_input_files x,
y Queue
7
Recall Condor Running Job
condor_submit
condor_schedd
condor_startd
condor_shadow
condor_starter
Job
8
Basic Condor-G Running Jobwith GT4
Basic case No matchmaking Advanced Can use
matchmaking
9
Condor-G with Matchmaking
Custom Advertiser
10
Which Grid Systems?

• Condor-G works with
• Globus 2
• Globus 4
• Nordugrid
• Unicore
• PBS
• LSF
• Condor

11
Why Condor-C?

• Connect two Condor pools
• Pools may be under different administrative
  control
• Easier connectivity requirements
• In general schedd and startd must communicate
  directly, for each possible startd
• Condor-C schedd A only talks to schedd B, and
  delegates running of job

12
Delegation

• Condor delegates jobs to other components
• Delegator does not run job other component does
• Delegator still watches over job and gets
  information about jobs
• Delegator can un-delegate job

13
The Route to Condor-C Condor-G
At each step, We delegate Job 1 To the next
component
J1
J1
J1
J1
gahp isolates interaction with grid system
14
Condor-C
Again, we delegate Job1
J1
J1
J1
J1
15
Condor-C to non-Condor
J1
J1
J1
J1
J1
16
Gliding in Condor-C(Used by gLite)
J1

• Glide-in J1
• (Job is Condor!)

J2
J1
2. Submit job J2
J2
J1
J2
J1
J2
J2
17
Matchmaking with Condor-C
18
Schedd on the side

• (Caveat experimental, not in a release)
• You have a vanilla job and dont care where it
  runs
• Just submit the job
• If it doesnt get access to the local Condor
  pool, the schedd on the side claims it
• Its converted to a Condor-G job
• It runs on the grid

19
Glide-In of a startd

• You think
• I love Condor!
• I wish the whole world was one big Condor pool!
• You do
• Make Condor pool (any size)
• Submit startd as grid job
• Startd joins your Condor pool
• Your Condor pool is pleasingly larger!
• Your jobs can use any Condor feature

20
Glide-In startd
Globus
S
J1
J2
Condor Central Manager
21
Glide-in difficulty

• Your schedd has to be able to open a network
  connection with the startd
• Firewalls are a hassle
• You can open ports in your firewall
• You can use tricky software to avoid the problem.
  (Condor GCB)
• This problem is worthy of a talk in itself

22
Questions?