How to submit jobs to WNoDeS-IGI Cloud Testbed

Prerequisite

• A X509 personal certificate
• Register you personal certificate in a VO
• Login on a EGI User Interface
• voms-proxy-init --voms name_of_vo
  • at the moment we only support these VOs:
    • dteam, enmr.org

Direct CREAM Submission

• Create a shell script to perform you jobs, as for example "run_job.sh":

#!/bin/bash
hostname 
date 
sleep 20
printenv 

• Create a jdl file, as for example "run_job.jdl":

Executable="run_job.sh";
Arguments="Argv1 Argv2";
StdOutput="report_out.txt";
StdError="report_err.txt";
InputSandbox={"run_job.sh"};
OutputSandbox={"report_out.txt","report_err.txt"};
OutputSandboxBaseDestURI = "gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/";

• The OutputSandboxBaseDestURI should be a gridftp url where you have write privileges
• You can submit the jdl file as follows:

-bash-3.2$ glite-ce-job-submit -a -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl

https://cremino.cnaf.infn.it:8443/CREAM910176854

• You can now check the status of the jobs as follows:

-bash-3.2$ glite-ce-job-status https://cremino.cnaf.infn.it:8443/CREAM910176854

******  JobID=[https://cremino.cnaf.infn.it:8443/CREAM491764199]
   Status        = [RUNNING]

• As soon the job is in status DONE:

 
******  JobID=[https://cremino.cnaf.infn.it:8443/CREAM910176854]
   Status        = [DONE-OK]
   ExitCode      = [0]

• You can look at your output files:

 
edg-gridftp-ls --verbose gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/

WMS Grid Job Submission

• Create a shell script to perform you jobs, as for example "run_job.sh":

#!/bin/bash
hostname 
date 
sleep 20
printenv 

• Create a jdl file, as for example "run_job.jdl":

Executable="run_job.sh";
StdOutput="report_out.txt";
StdError="report_err.txt";

InputSandbox={"run_job.sh"};
OutputSandbox={"report_out.txt","report_err.txt"};

Requirements = other.GlueCEPolicyMaxWallClockTime > 100 && RegExp(".*cloudtf",other.GlueCEUniqueID);
Rank= ( other.GlueCEStateWaitingJobs == 0 ? other.GlueCEStateFreeCPUs : -other.GlueCEStateWaitingJobs) ;

• and than submit it by using:

 
 glite-wms-job-submit -a -e https://wms004.cnaf.infn.it:7443/glite_wms_wmproxy_server -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl

• now you can always check the status using the jobid received, when the job is submitted:

 
glite-wms-job-status -a https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA

• as soon as it is shown as "Done" you can retrieve the output using:

 
glite-wms-job-get-out --dir . https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA

-- GiacintoDonvito - 2011-11-23