How to submit jobs to WNoDeS-IGI Cloud Testbed
Prerequisite
- A X509 personal certificate
- Register you personal certificate in a VO
- Login on a EGI User Interface
- voms-proxy-init --voms name_of_vo
- at the moment we only support these VOs:
Direct CREAM Submission
- Create a shell script to perform you jobs, as for example "run_job.sh":
#!/bin/bash
hostname
date
sleep 20
printenv
- Create a jdl file, as for example "run_job.jdl":
Executable="run_job.sh";
Arguments="Argv1 Argv2";
StdOutput="report_out.txt";
StdError="report_err.txt";
InputSandbox={"run_job.sh"};
OutputSandbox={"report_out.txt","report_err.txt"};
OutputSandboxBaseDestURI = "gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/";
- The OutputSandboxBaseDestURI should be a gridftp url where you have write privileges
- You can submit the jdl file as follows:
-bash-3.2$ glite-ce-job-submit -a -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl
https://cremino.cnaf.infn.it:8443/CREAM910176854
- You can now check the status of the jobs as follows:
-bash-3.2$ glite-ce-job-status https://cremino.cnaf.infn.it:8443/CREAM910176854
****** JobID=[https://cremino.cnaf.infn.it:8443/CREAM491764199]
Status = [RUNNING]
- As soon the job is in status DONE:
****** JobID=[https://cremino.cnaf.infn.it:8443/CREAM910176854]
Status = [DONE-OK]
ExitCode = [0]
- You can look at your output files:
edg-gridftp-ls --verbose gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/
WMS Grid Job Submission
- Create a shell script to perform you jobs, as for example "run_job.sh":
#!/bin/bash
hostname
date
sleep 20
printenv
- Create a jdl file, as for example "run_job.jdl":
Executable="run_job.sh";
StdOutput="report_out.txt";
StdError="report_err.txt";
InputSandbox={"run_job.sh"};
OutputSandbox={"report_out.txt","report_err.txt"};
Requirements = other.GlueCEPolicyMaxWallClockTime > 100 && RegExp(".*cloudtf",other.GlueCEUniqueID);
Rank= ( other.GlueCEStateWaitingJobs == 0 ? other.GlueCEStateFreeCPUs : -other.GlueCEStateWaitingJobs) ;
- and than submit it by using:
glite-wms-job-submit -a -e https://wms004.cnaf.infn.it:7443/glite_wms_wmproxy_server -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl
- now you can always check the status using the jobid received, when the job is submitted:
glite-wms-job-status -a https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA
- as soon as it is shown as "Done" you can retrieve the output using:
glite-wms-job-get-out --dir . https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA
--
GiacintoDonvito - 2011-11-23