---++ How to submit jobs to WNoDeS-IGI Cloud Testbed ---+++ Prerequisite * A X509 personal certificate * Register you personal certificate in a VO * Login on a EGI User Interface * voms-proxy-init --voms _name_of_vo_ * at the moment we only support these VOs: * dteam, enmr.org ---+++!! Direct CREAM Submission * Create a shell script to perform you jobs, as for example "run_job.sh": <verbatim> #!/bin/bash hostname date sleep 20 printenv </verbatim> * Create a jdl file, as for example "run_job.jdl": <verbatim> Executable="run_job.sh"; Arguments="Argv1 Argv2"; StdOutput="report_out.txt"; StdError="report_err.txt"; InputSandbox={"run_job.sh"}; OutputSandbox={"report_out.txt","report_err.txt"}; OutputSandboxBaseDestURI = "gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/"; </verbatim> * The _OutputSandboxBaseDestURI_ should be a gridftp url where you have write privileges * You can submit the jdl file as follows: <verbatim> -bash-3.2$ glite-ce-job-submit -a -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl https://cremino.cnaf.infn.it:8443/CREAM910176854 </verbatim> * You can now check the status of the jobs as follows: <verbatim> -bash-3.2$ glite-ce-job-status https://cremino.cnaf.infn.it:8443/CREAM910176854 ****** JobID=[https://cremino.cnaf.infn.it:8443/CREAM491764199] Status = [RUNNING] </verbatim> * As soon the job is in status _DONE_: <verbatim> ****** JobID=[https://cremino.cnaf.infn.it:8443/CREAM910176854] Status = [DONE-OK] ExitCode = [0] </verbatim> * You can look at your output files: <verbatim> edg-gridftp-ls --verbose gsiftp://gftp2.ba.infn.it/lustre/cms/test_grid/ </verbatim> ---+++!! WMS Grid Job Submission * Create a shell script to perform you jobs, as for example "run_job.sh": <verbatim> #!/bin/bash hostname date sleep 20 printenv </verbatim> * Create a jdl file, as for example "run_job.jdl": <verbatim> Executable="run_job.sh"; StdOutput="report_out.txt"; StdError="report_err.txt"; InputSandbox={"run_job.sh"}; OutputSandbox={"report_out.txt","report_err.txt"}; Requirements = other.GlueCEPolicyMaxWallClockTime > 100 && RegExp(".*cloudtf",other.GlueCEUniqueID); Rank= ( other.GlueCEStateWaitingJobs == 0 ? other.GlueCEStateFreeCPUs : -other.GlueCEStateWaitingJobs) ; </verbatim> * and than submit it by using: <verbatim> glite-wms-job-submit -a -e https://wms004.cnaf.infn.it:7443/glite_wms_wmproxy_server -r cremino.cnaf.infn.it:8443/cream-pbs-cloudtf run_job.jdl </verbatim> * now you can always check the status using the jobid received, when the job is submitted: <verbatim> glite-wms-job-status -a https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA </verbatim> * as soon as it is shown as "Done" you can retrieve the output using: <verbatim> glite-wms-job-get-out --dir . https://wms004.cnaf.infn.it:9000/Q4UJzlRyQnB_g6fJ2YUVpA </verbatim> -- Main.GiacintoDonvito - 2011-11-23
This topic: Cloud
>
WNoDeSUserGuide
Topic revision: r3 - 2011-12-05 - GiacintoDonvito
Copyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki?
Send feedback