CICC Project Meeting

1
CICC Project Meeting

• VOTable
• Developed VotableToSpreadsheet Service which
  accepts VOTable file location as an input,
  converts to Excel spreadsheet using jakartas
  HSSF(POI Project's pure Java implementation of
  the Excel '97(-2002 ) http//jakarta.apache.org/po
  i/hssf/index.html and returns excel file URL as
  an output.

2
condor

• Condor is a workload management system
• Users submit jobs to Condor, Condor places them
  into a queue, chooses when and where to run the
  jobs based upon a policy, carefully monitors
  their progress, and ultimately informs the user
  upon completion

3

• We have installed and configured Condor 6.8 on
  156.56.104.135 Linux machine.
• We are able to submit and execute simple jobs
  using vanilla universe like,
• universe vanilla
• executable /home/condor/test.sh
• output test.out
• error test.error
• log test.log
• Where test.sh can have simple Linux command
• !/bin/sh
• echo HOSTNAME

4

• We have also configured condor-g (window to the
  Grid)
• Condor-g is nothing but a condor uses Globus to
  provide underlying software needed to utilize
  grid resources such as authentication, remote
  program execution and data transfer
• Condor-G is a program that manages both a queue
  of jobs and the resources from one or more sites
  where those jobs can execute. It communicates
  with these resources and transfers files to and
  from these resources using Globus mechanisms. (In
  particular, Condor-G uses the GRAM protocol for
  job submission, and it runs a local GASS server
  for file transfers).

5

• We are now able to submit globus jobs to gf1,
  NCSA and SDSC teragrid machines
• Example
• executable test.shoutput test.outerror
  test.errorlog test.loguniverse
  gridgrid_type gt2globusscheduler
  gf1.ucs.indiana.edu/job-managerleave_in_queue
  jobstatus 4queue

6

• We are also able to submit globus jobs to gf1,
  NCSA and SDSC teragrid by advertising classad of
  machines.
• Example of classad for gf1.ucs.indiana.edu
• MyType "Machine"TargetType "Job"Name
  "condorTest02"Machine "condorTest02"gatekeeper
  _url "gf1.ucs.indiana.edu/jobmanager"UpdatesSeq
  uenced 9CurMatches 0Requirements
  TARGET.JobUniverse 9Rank 0.000000CurrentRan
  k 0.000000OpSys "LINUX"Arch "INTEL"State
  "Unclaimed"Activity "Idle"LoadAvg
  0.000000Memory 2048WantAdRevaluate
  TrueStartdIpAddr "156.56.104.135"

7

• And submit description file for classad mechanism
• universe gridgrid_type gt2notification
  neverglobusscheduler (gatekeeper_url)executa
  ble test.shtransfer_executable trueoutput
  hg-host.(Cluster).outerror hg-host.(Cluster).
  errorlog hg-host.(Cluster).logrequirements
  TARGET.gatekeeper_url ! UNDEFINEDqueue

8

• We are also able to configured condor birdbath to
  submit jobs through condor SOAP API
• Right now we are working on modifying OGCE condor
  job submission portal code to work with condor
  6.8 and globus jobs.
• All information about condor installation, setup,
  job submission and SOAP API is available on
  http//communitygrids.blogspot.com