Tags:
, view all tags

WMS-UI 3.5.2 EMI3 Update7 pre-certification report

Basic functionality testing

Testing instance at cream-08.pd.infn.it (SL6 x86_64). Deployed on 8th Jul. 2013

dorigoa@cream-08 9:56:27 ~>cat /etc/issue
Scientific Linux release 6.4 (Carbon)
Kernel \r on an \m

dorigoa@cream-08 10:53:24 ~>rpm -qa | grep wms
glite-wms-utils-classad-3.4.2-2.el6.x86_64
glite-wms-ui-commands-3.5.0-4.sl6.x86_64
glite-wms-brokerinfo-access-lib-3.5.0-3.sl6.x86_64
glite-wms-ui-api-python-3.5.0-3.sl6.x86_64
glite-wms-wmproxy-api-cpp-3.5.0-3.sl6.x86_64
glite-wms-utils-exception-3.4.2-2.el6.x86_64
glite-wms-brokerinfo-access-3.5.0-3.sl6.x86_64

Job submission

Single job with Input Sandbox

dorigoa@cream-08 10:55:46 ~>cat wms_ISB.jdl 
[
Executable = "/bin/sleep" ;
Arguments = "1";
InputSandbox = {"/home/dorigoa/sandboxes/mysandbox_01", "/home/dorigoa/sandboxes/mysandbox_02", "/home/dorigoa/sandboxes/mysandbox_03"};
AllowZippedISB = false;
requirements = RegExp("cream.*", other.GlueCEUniqueID);
RetryCount = 0;
ShallowRetryCount = 1;
MyProxyServer="";
rank  = - other.GlueCEStateEstimatedResponseTime;
]

dorigoa@cream-08 10:55:52 ~>glite-wms-job-submit -a -e https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server -r cream-27.pd.infn.it:8443/cream-lsf-creamtest1 wms_ISB.jdl

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://prod-wms-01.pd.infn.it:9000/WiaYqoYJXZgCmjIkyrfc7A

==========================================================================


dorigoa@cream-08 10:56:37 ~>glite-wms-job-status https://prod-wms-01.pd.infn.it:9000/WiaYqoYJXZgCmjIkyrfc7A


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://prod-wms-01.pd.infn.it:9000/WiaYqoYJXZgCmjIkyrfc7A
Current Status:     Scheduled
Status Reason:      unavailable
Destination:        cream-27.pd.infn.it:8443/cream-lsf-creamtest1
Submitted:          Mon Jul  8 10:56:36 2013 CEST
==========================================================================

dorigoa@cream-08 10:56:59 ~>glite-wms-job-status https://prod-wms-01.pd.infn.it:9000/WiaYqoYJXZgCmjIkyrfc7A


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://prod-wms-01.pd.infn.it:9000/WiaYqoYJXZgCmjIkyrfc7A
Current Status:     Done(Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-27.pd.infn.it:8443/cream-lsf-creamtest1
Submitted:          Mon Jul  8 10:56:36 2013 CEST
==========================================================================

Single job with Input and Output Sandbox

dorigoa@cream-08 10:59:40 ~>cat wms_ISB_OSB.jdl 
[
Executable = "/bin/env";
Arguments = "";
stdoutput="stdout";
stderror="stderr";
OutputSandbox = {"stdout","stderr"};
InputSandbox = {"/home/dorigoa/sandboxes/mysandbox_01", "/home/dorigoa/sandboxes/mysandbox_02", "/home/dorigoa/sandboxes/mysandbox_03"};
AllowZippedISB = false;
requirements = RegExp("cream.*", other.GlueCEUniqueID);
RetryCount = 0;
ShallowRetryCount = 1;
MyProxyServer="";
rank  = - other.GlueCEStateEstimatedResponseTime;
]

dorigoa@cream-08 10:59:47 ~>glite-wms-job-submit -a -e https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server -r cream-27.pd.infn.it:8443/cream-lsf-creamtest1 wms_ISB_OSB.jdl 

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://prod-wms-01.pd.infn.it:9000/K0BqaEzMlh9s0_8pymLiWA

==========================================================================

dorigoa@cream-08 10:59:55 ~>glite-wms-job-status https://prod-wms-01.pd.infn.it:9000/K0BqaEzMlh9s0_8pymLiWA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://prod-wms-01.pd.infn.it:9000/K0BqaEzMlh9s0_8pymLiWA
Current Status:     Done(Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-27.pd.infn.it:8443/cream-lsf-creamtest1
Submitted:          Mon Jul  8 10:59:54 2013 CEST
==========================================================================

dorigoa@cream-08 11:01:55 ~>glite-wms-job-output --dir OSB https://prod-wms-01.pd.infn.it:9000/K0BqaEzMlh9s0_8pymLiWA

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server


================================================================================

                        JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://prod-wms-01.pd.infn.it:9000/K0BqaEzMlh9s0_8pymLiWA
have been successfully retrieved and stored in the directory:
/home/dorigoa/OSB/dorigoa_K0BqaEzMlh9s0_8pymLiWA

================================================================================


dorigoa@cream-08 11:02:10 ~>ll OSB/
total 4
drwxr-xr-x 2 dorigoa dorigoa 4096 Jul  8 11:02 dorigoa_K0BqaEzMlh9s0_8pymLiWA
dorigoa@cream-08 11:02:21 ~>ll OSB/dorigoa_K0BqaEzMlh9s0_8pymLiWA/
total 4
-rw-rw-r-- 1 dorigoa dorigoa    0 Jul  8 11:02 stderr
-rw-rw-r-- 1 dorigoa dorigoa 3935 Jul  8 11:02 stdout

LIST OF BUGS

glite-wms-job-output creates files without checking VO membership first, also changing status (https://savannah.cern.ch/bugs/?98281, https://ggus.eu/ws/ticket_info.php?ticket=86094) Yes / Done
WMS to limit ISB size as a whole, not only per file (https://savannah.cern.ch/bugs/index.php?98280, https://ggus.eu/ws/ticket_info.php?ticket=87429) Yes / Done

BUG VERIFICATION

BUG: glite-wms-job-output creates files without checking VO membership first, also changing status (08/07/2013)
The procedure is
  • Create a voms proxy with a certain VO (infngrid)
  • Submit a JDL with OSB to a WMS
  • Wait until the job is finished, then create a new proxy with different VO (dteam)
  • Retrieve the OSB and check for the warning question and the error during OSB transfer
  • Check that the job hasn't been purged out

dorigoa@cream-08 11:14:38 ~>voms-proxy-init -voms infngrid
Contacting voms.cnaf.infn.it:15000 [/C=IT/O=INFN/OU=Host/L=CNAF/CN=voms.cnaf.infn.it] "infngrid"...
Remote VOMS server contacted succesfully.


Created proxy in /tmp/x509up_u500.

Your proxy is valid until Mon Jul 08 23:14:44 CEST 2013

dorigoa@cream-08 11:14:45 ~>glite-wms-job-submit -a -e https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server -r cream-27.pd.infn.it:8443/cream-lsf-creamtest1 wms_OSB.jdl 

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA

==========================================================================


dorigoa@cream-08 11:14:56 ~>glite-wms-job-status https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA
Current Status:     Done(Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-27.pd.infn.it:8443/cream-lsf-creamtest1
Submitted:          Mon Jul  8 11:14:56 2013 CEST
==========================================================================


dorigoa@cream-08 11:16:07 ~>voms-proxy-init -voms dteam
Contacting voms2.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms2.hellasgrid.gr] "dteam"...
Error contacting voms2.hellasgrid.gr:15004 for VO dteam: connect timed out
Error contacting voms2.hellasgrid.gr:15004 for VO dteam: connect timed out
Error contacting voms2.hellasgrid.gr:15004 for VO dteam: REST and legacy VOMS endpoints failed.
Contacting voms.hellasgrid.gr:15004 [/C=GR/O=HellasGrid/OU=hellasgrid.gr/CN=voms.hellasgrid.gr] "dteam"...
Error contacting voms.hellasgrid.gr:15004 for VO dteam: Connection reset
Remote VOMS server contacted succesfully.


Created proxy in /tmp/x509up_u500.

Your proxy is valid until Mon Jul 08 23:16:22 CEST 2013



dorigoa@cream-08 11:16:23 ~>glite-wms-job-output --dir OSB https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server

Job's VirtualOrganisation is different from that one contained in your proxy file. GridFTP could be unable to retrieve the output file. Do you want to continue (JobPurge will be disabled) ? [y/n]n : n
bye
dorigoa@cream-08 11:17:00 ~>glite-wms-job-output --dir OSB https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server

Job's VirtualOrganisation is different from that one contained in your proxy file. GridFTP could be unable to retrieve the output file. Do you want to continue (JobPurge will be disabled) ? [y/n]n : y

error: globus_ftp_client: the server responded with an error
500 500-Command failed. : globus_l_gfs_file_open failed.
500-globus_xio: Unable to open file /var/SandboxDir/UL/https_3a_2f_2fprod-wms-01.pd.infn.it_3a9000_2fULLrQGtb0nXgqrQRDqageA/output/stderr
500-globus_xio: System error in open: Permission denied
500-globus_xio: A system call failed: Permission denied
500 End.


Error - Method doExecv: 
Operation not permitted


error: globus_ftp_client: the server responded with an error
500 500-Command failed. : globus_l_gfs_file_open failed.
500-globus_xio: Unable to open file /var/SandboxDir/UL/https_3a_2f_2fprod-wms-01.pd.infn.it_3a9000_2fULLrQGtb0nXgqrQRDqageA/output/stdout
500-globus_xio: System error in open: Permission denied
500-globus_xio: A system call failed: Permission denied
500 End.


Error - Method doExecv: 
Operation not permitted


Warning - https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA: Error while downloading the following file(s):
 - gsiftp://cream-01.pd.infn.it:2811/var/SandboxDir/UL/https_3a_2f_2fprod-wms-01.pd.infn.it_3a9000_2fULLrQGtb0nXgqrQRDqageA/output/stderr to /home/dorigoa/OSB/dorigoa_ULLrQGtb0nXgqrQRDqageA/stderr - ErrorCode: 1
   Operation not permitted
 - gsiftp://cream-01.pd.infn.it:2811/var/SandboxDir/UL/https_3a_2f_2fprod-wms-01.pd.infn.it_3a9000_2fULLrQGtb0nXgqrQRDqageA/output/stdout to /home/dorigoa/OSB/dorigoa_ULLrQGtb0nXgqrQRDqageA/stdout - ErrorCode: 1
   Operation not permitted


================================================================================

                        JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA
have been successfully retrieved and stored in the directory:
/home/dorigoa/OSB/dorigoa_ULLrQGtb0nXgqrQRDqageA

================================================================================



dorigoa@cream-08 11:17:06 ~>glite-wms-job-status https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://prod-wms-01.pd.infn.it:9000/ULLrQGtb0nXgqrQRDqageA
Current Status:     Done(Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        cream-27.pd.infn.it:8443/cream-lsf-creamtest1
Submitted:          Mon Jul  8 11:14:56 2013 CEST
==========================================================================

BUG: WMS to limit ISB size as a whole, not only per file (08/07/2013)

Used the cream-01.pd.infn.it node as WMS (EMI3, SL5). I've lowered the MaxInputSandboxSize param's value in the glite_wms.conf file:

[root@cream-01 input]#  grep MaxInput /etc/glite-wms/glite_wms.conf
    MaxInputSandboxSize  =  4600000;
    MaxInputSandboxSize  =  4600000;

and I've restarted the gLite service. Then, on the UI:

dorigoa@cream-08 11:41:23 ~>ll sandboxes
total 8844
-rw-rw-r-- 1 dorigoa dorigoa   15929 Jun 21 10:25 mysandbox_01
-rwxr-xr-x 1 dorigoa dorigoa   19080 Jun 21 10:25 mysandbox_02
-rwxr-xr-x 1 dorigoa dorigoa 4494144 Jun 21 10:26 mysandbox_03
-rwxr-xr-x 1 dorigoa dorigoa 4494144 Jun 21 14:37 mysandbox_04


dorigoa@cream-08 11:41:27 ~>du -sh sandboxes
8.7M    sandboxes

dorigoa@cream-08 11:41:39 ~>cat wms_ISB.jdl 
[
Executable = "/bin/sleep" ;
Arguments = "1";
InputSandbox = {"/home/dorigoa/sandboxes/mysandbox_01", "/home/dorigoa/sandboxes/mysandbox_02", "/home/dorigoa/sandboxes/mysandbox_03", "/home/dorigoa/sandboxes/mysandbox_04"};
AllowZippedISB = false;
requirements = RegExp("cream.*", other.GlueCEUniqueID);
RetryCount = 0;
ShallowRetryCount = 1;
MyProxyServer="";
rank  = - other.GlueCEStateEstimatedResponseTime;
]

dorigoa@cream-08 11:41:41 ~>glite-wms-job-submit -a -e https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server -r cream-27.pd.infn.it:8443/cream-lsf-creamtest1 wms_ISB.jdl

Connecting to the service https://cream-01.pd.infn.it:7443/glite_wms_wmproxy_server


Warning - The max job size of the InputSandbox (4494144 bytes) or of the total InputStandbox (9023297 bytes) exceeds the MAX InputSandbox size limit on the server (4600000 bytes)

Error - Operation failed
Unable to find any endpoint where to perform service request

-- AlviseDorigo - 2013-07-08

Edit | Attach | PDF | History: r6 | r4 < r3 < r2 < r1 | Backlinks | Raw View | More topic actions...
Topic revision: r2 - 2013-07-15 - AlviseDorigo
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback