You are here: TWiki> Cloud Web>WNoDeSUserGuide (2011-12-05, GiacintoDonvito)

How to submit jobs to WNoDeS-IGI Cloud Testbed

Prerequisite

  • A X509 personal certificate
  • Register you personal certificate in a VO
  • Login on a EGI User Interface
  • voms-proxy-init --voms name_of_vo
    • at the moment we only support these VOs:
      • dteam, enmr.org

Direct CREAM Submission

  • Create a shell script to perform you jobs, as for example "run_job.sh":
#!/bin/bash
hostname 
date 
sleep 20
printenv 

  • Create a jdl file, as for example "run_job.jdl":

Executable="run_job.sh";
Arguments="Argv1 Argv2";
StdOutput="report_out.txt";
StdError="report_err.txt";
InputSandbox={"run_job.sh"};
OutputSandbox={"report_out.txt","report_err.txt"};
OutputSandboxBaseDestURI = "gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/";

  • The OutputSandboxBaseDestURI should be a gridftp url where you have write privileges
  • You can submit the jdl file as follows:

-bash-3.2$ glite-ce-job-submit -a -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl

https://cremino.cnaf.infn.it:8443/CREAM910176854

  • You can now check the status of the jobs as follows:

-bash-3.2$ glite-ce-job-status https://cremino.cnaf.infn.it:8443/CREAM910176854

******  JobID=[https://cremino.cnaf.infn.it:8443/CREAM491764199]
   Status        = [RUNNING]

  • As soon the job is in status DONE:
 
******  JobID=[https://cremino.cnaf.infn.it:8443/CREAM910176854]
   Status        = [DONE-OK]
   ExitCode      = [0]

  • You can look at your output files:
 
edg-gridftp-ls --verbose gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/

WMS Grid Job Submission

  • Create a shell script to perform you jobs, as for example "run_job.sh":
#!/bin/bash
hostname 
date 
sleep 20
printenv 

  • Create a jdl file, as for example "run_job.jdl":
Executable="run_job.sh";
StdOutput="report_out.txt";
StdError="report_err.txt";

InputSandbox={"run_job.sh"};
OutputSandbox={"report_out.txt","report_err.txt"};

Requirements = other.GlueCEPolicyMaxWallClockTime > 100 && RegExp(".*cloudtf",other.GlueCEUniqueID);
Rank= ( other.GlueCEStateWaitingJobs == 0 ? other.GlueCEStateFreeCPUs : -other.GlueCEStateWaitingJobs) ;

  • and than submit it by using:

 
 glite-wms-job-submit -a -e https://wms004.cnaf.infn.it:7443/glite_wms_wmproxy_server -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl

  • now you can always check the status using the jobid received, when the job is submitted:

 
glite-wms-job-status -a https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA

  • as soon as it is shown as "Done" you can retrieve the output using:

 
glite-wms-job-get-out --dir . https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA

-- GiacintoDonvito - 2011-11-23

Topic revision: r3 - 2011-12-05 - GiacintoDonvito
 
TWIKI.NET
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback