Difference: UITestsP2625 (1 vs. 6)

• • WMS-cli-status-all.sh: === test NOT passed === due to error 8 (see below)

• • WMS-cli-job-info.sh: === test NOT passed === due to error 9 (see below)

1. Mandatory attribute not recognize:

   [ale@egee-rb-03 WMS-cli]$  glite-wms-job-status  --config wms.conf --all
   
   **** Warning: UI_CONFIG_ATTRIBUTE ****  
   Mandatory Attribute default error in configuration file: "LBAddresses"

   but

   [ale@egee-rb-03 WMS-cli]$ cat wms.conf 
   [
       WmsClient = [
        WMProxyEndPoints = {"https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server"};
        ErrorStorage="/var/tmp";
        LBAddresses = {"http://devel17.cnaf.infn.it:9000"};
        OutputStorage=  "/tmp";
        ListenerStorage="/tmp";
        DefaultStatusLevel  = 1 ;
        DefaultLoggingLevel = 1 ;
        jdlDefaultAttributes=[
           VirtualOrganisation="dteam";
           DefaultNodeRetryCount = 5;
           SignificantAttributes = { "Requirements","Rank" };
           MyProxyServer = "myproxy.cern.ch";
           requirements = other.GlueCEStateStatus == "Production" || other.GlueCEStateStatus == "CREAMPreCertTests" || other.GlueCEStateStatus == "testbedb";
           RetryCount = 3;
           rank =-other.GlueCEStateEstimatedResponseTime ;
        ]
     ];
   ]

2. A dag or not a dag....

   [ale@egee-rb-03 WMS-cli]$  glite-wms-job-info --jdl-original https://devel17.cnaf.infn.it:9000/1Xv1M6H9W8mVFQK0FTQnyQ
   
   Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
   
   Error - WMProxy Server Error
   The operation getJDL is not supported for DAG/Collection nodes, please check the jobid: 
   https://devel17.cnaf.infn.it:9000/1Xv1M6H9W8mVFQK0FTQnyQ

   but it is a simple job

   [ale@cream-15 UI]$ glite-wms-job-status -v 2 https://devel17.cnaf.infn.it:9000/1Xv1M6H9W8mVFQK0FTQnyQ
   
   *************************************************************
   BOOKKEEPING INFORMATION:
   
   Status info for the Job : https://devel17.cnaf.infn.it:9000/1Xv1M6H9W8mVFQK0FTQnyQ
   Current Status:     Scheduled 
   Status Reason:      Job successfully submitted to Globus
   Destination:        ce125.cern.ch:2119/jobmanager-lcglsf-grid_2nh_dteam
   Submitted:          Wed Apr 22 16:48:27 2009 CEST
   ---
   - Cancelling                 =    0
   - Children num               =    0

• • WMS-cli-basic-cycle.sh: === test NOT passed === due to error 3 (see below)
  • WMS-cli-basic-cycle-logfile.sh: === test NOT passed === due to error 3 (see below)
  • WMS-cli-basic-cycle-config.sh: === test PASSED === add a temporary fix for error 2 (see below)
  • WMS-cli-basic-cycle-default-jdl.sh: === test NOT passed === due to error 3 (see below) and add a temporary fix for error 2 (see below)
  • WMS-cli-basic-cycle-input.sh: === test PASSED === add a temporary fix for error 2 (see below)
  • WMS-cli-basic-cycle-resource.sh: === test PASSED === add a temporary fix for error 2 (see below)
  • WMS-cli-detailed-cycle.sh: === test NOT passed === due to error 3 (see below) and add a temporary fix for error 2 (see below)
  • WMS-cli-submit-option-to.sh: === test NOT passed === due to error 6 (see below)
  • WMS-cli-submit-option-valid.sh: === test NOT passed === due to error 7 (see below)

ERRORS:

1. Missing attribute!

   [ale@egee-rb-03 WMS-cli]$  glite-wms-job-status --config ./wms.conf https://devel17.cnaf.infn.it:9000/Xt__sHcsxTR2KhoaQYSIVQ
   
   **** Error: UI_JDL_ADD_ERROR ****  
   Missing VirtualOrganisation attribute inside JDL Default Attributes section "JdlDefaultAttributes" of configuration file ./wms.conf

   but

   [ale@egee-rb-03 WMS-cli]$ cat /home/ale/CVS/org.glite.testsuites.ctb/WMS/WMS-cli/wms.conf
   [
       WmsClient = [
        WMProxyEndPoints = {"https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server"};
        ErrorStorage="/var/tmp";
        OutputStorage=  "/tmp";
        ListenerStorage="/tmp";
        DefaultStatusLevel  = 1 ;
        DefaultLoggingLevel = 1 ;
        jdlDefaultAttributes=[
           VirtualOrganisation="dteam";
           DefaultNodeRetryCount = 5;
           SignificantAttributes = { "Requirements","Rank" };
           MyProxyServer = "myproxy.cern.ch";
           requirements = other.GlueCEStateStatus == "Production" || other.GlueCEStateStatus == "CREAMPreCertTests" || other.GlueCEStateStatus == "testbedb";
           RetryCount = 3;
           rank =-other.GlueCEStateEstimatedResponseTime ;
        ]
     ];
   ]

2. Directory "test" must exist!

   [ale@egee-rb-03 UI]$ glite-wms-job-output --dir test https://devel17.cnaf.infn.it:9000/0NbCpMtGmqwwDB2KZLw1_Q
   
   Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
   
   Error - Unable create dir
   /home/ale/UI/test/ale_0NbCpMtGmqwwDB2KZLw1_Q

3. Error or not error?

   [ale@egee-rb-03 UI]$ glite-wms-job-output https://devel17.cnaf.infn.it:9000/0NbCpMtGmqwwDB2KZLw1_Q
   
   Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
   
   Error - Operation Failed
   Unable to retrieve the output

   but

   [ale@egee-rb-03 UI]$ ls /tmp/ale_0NbCpMtGmqwwDB2KZLw1_Q/
   ls.out

4. Option "--list-only" doesn't work!

   [ale@egee-rb-03 UI]$ glite-wms-job-output --list-only https://devel17.cnaf.infn.it:9000/wCOcPfjzuByX7Werx7IZXA
   
   Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
   
   Error - Operation Failed
   Unable to retrieve the output

5. Man page error, some attributes are repeated and have different description:

   GLITE-WMS-JOB-STATUS(1)                                GLITE-WMS-JOB-STATUS(1)
   
   NAME:
          glite-wms-job-status
   
   SYNOPSIS
          glite-wms-job-status [options] <jobId>
          --version
          --help
          --config, -c <configfile>
          --vo <voname>
          --debug
          --logfile <filepath>
          --noint
          --version
          --help

6. Option "--to" doesn't work:

   [ale@egee-rb-03 WMS-cli]$ glite-wms-job-submit -a --config ./wms.conf --output /tmp/wms-cli-test-ale-22321/job.id --to 13:16 ./hostname.jdl 
   
   Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
   
   Error - 
   ExpiryTime: wrong type caught for attribute

7. Option "--valid" doesn't work:

   [ale@egee-rb-03 WMS-cli]$ glite-wms-job-submit -a --config ./wms.conf --output /tmp/wms-cli-test-ale-22400/job.id --valid 00:01 hostname.jdl 
   
   Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
   
   Error - 
   ExpiryTime: wrong type caught for attribute

• Run the following tests from the testsuite of Dmitry Zaborov (WMS CLI)
  • WMS-cli-basic-cycle.sh: === test PASSED ===
  • WMS-cli-basic-cycle-logfile.sh: === test PASSED ===
  • WMS-cli-basic-cycle-config.sh: === test PASSED ===
  • WMS-cli-basic-cycle-default-jdl.sh: === test PASSED ===
  • WMS-cli-basic-cycle-input.sh: === test PASSED ===
  • WMS-cli-basic-cycle-resource.sh: === test PASSED ===
  • WMS-cli-detailed-cycle.sh: === test PASSED ===
  • WMS-cli-submit-option-to.sh: === test PASSED ===
  • WMS-cli-submit-option-valid.sh: === test PASSED ===
  • WMS-cli-list-match.sh: === test PASSED ===
  • WMS-cli-delegate-proxy.sh: === test PASSED ===
  • WMS-cli-cancel.sh: === test PASSED ===
  • WMS-cli-status-all.sh: === Connection timed out ===
  • WMS-cli-logging-info.sh: === test PASSED ===
  • WMS-cli-job-info.sh: === test PASSED ===
  • WMS-cli-file-perusal.sh: === test PASSED ===

TESTs:

Check bugs:

• BUG #17534: unexpected behavior of glite-wms-job-output PARTIALLY FIXED
  • Retrieve the output of a single job without the "--nosubdir" option:

    [ale@egee-rb-03 UI]$ glite-wms-job-output --dir test https://devel17.cnaf.infn.it:9000/tpzN_qsPhV41QLxx4hN9iQ
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    Error - Operation Failed
    Unable to retrieve the output

    but the output is correctly stored under directory test/ale_tpzN_qsPhV41QLxx4hN9iQ
  • Retrieve the output of two or more jobs without the "--nosubdir" option:

    [ale@egee-rb-03 UI]$ glite-wms-job-output --dir test https://devel17.cnaf.infn.it:9000/ERnZhyvT49pbPo9gmGQR8g https://devel17.cnaf.infn.it:9000/-DRDiqYsWOMVer-iqY2z9w
    ------------------------------------------------------------------
    1 : https://devel17.cnaf.infn.it:9000/ERnZhyvT49pbPo9gmGQR8g
    2 : https://devel17.cnaf.infn.it:9000/-DRDiqYsWOMVer-iqY2z9w
    a : all
    q : quit
    ------------------------------------------------------------------
    
    Choose one or more jobId(s) in the list - [1-2]all (use , as separator or - for a range): a
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    Error - Operation Failed
    Unable to retrieve the output for any job

    but the output are correctly stored:

     
    [ale@egee-rb-03 UI]$ ls -l  test/*
    test/ale_-DRDiqYsWOMVer-iqY2z9w:
    total 136
    -rw-rw-r-- 1 ale ale 131125 Apr 21 12:53 ls.out
    
    test/ale_ERnZhyvT49pbPo9gmGQR8g:
    total 108
    -rw-rw-r-- 1 ale ale 105990 Apr 21 12:53 ls.out

  • Retrieve the output of one or more jobs with the "--nosubdir" option:

    [ale@egee-rb-03 UI]$ glite-wms-job-output --noint --dir test --nosubdir https://devel17.cnaf.infn.it:9000/lbqwcfFH36b793VB9zA10g https://devel17.cnaf.infn.it:9000/A-oJg5mUXBEbnISTjVErMw
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    Warning - option --nosubdir specified: 
    output files with same name will be overridden
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    Warning - option --nosubdir specified: 
    output files with same name will be overridden
    
    Warning - Directory already exists: 
    /home/ale/UI/test
    
    Do you wish to overwrite it ? [y/n]n : y
    
    Error - Operation Failed
    Unable to retrieve the output for any job

    but the output is correctly stored under directory test

• BUG #29635: bad error message for glite_wms.conf syntax error FIXED
  • Modified the configuration file breaking the syntax, then submit..

    [ale@egee-rb-03 UI]$  glite-wms-job-submit  -a -c ~/UI/etc/wmp_wms009.conf -o uitest jdl/ls.jdl 
    Syntax error occurred: 
    Error occured at: Row: 12, Col: 86
    " };
         //LBAddresse ... "

• BUG #34949: Ctl-C'ed submission gives funny state FIXED
  • Submit a job with big input data, wait a while and then type Ctrl-C

    [ale@egee-rb-03 UI]$  glite-wms-job-submit  -a -c ~/UI/etc/wmp_wms009.conf -o uitest jdl/ls.jdl 
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    
    Cancelling copy...
    
    Error - The job has been successfully registered (the JobId is: https://devel17.cnaf.infn.it:9000/gmIXAmuyS5inwyPnQOKBOQ), but an error occurred while transferring files:
    User killed the command execution
    To complete the operation start the job by issuing a submission with the option:
     --start https://devel17.cnaf.infn.it:9000/gmIXAmuyS5inwyPnQOKBOQ

    The status of the job should be:

    *************************************************************
    BOOKKEEPING INFORMATION:
    
    Status info for the Job : https://devel17.cnaf.infn.it:9000/gmIXAmuyS5inwyPnQOKBOQ
    Current Status:     Submitted 
    Submitted:          Tue Apr 21 13:01:55 2009 CEST
    *************************************************************

    NOTE I try to issue a "--start" as suggest, the job is submitted but no one said me that not all the input files have been completely transferred.

    [root@wms009 ~]# ls -lh /var/glite/SandboxDir/gm/https_3a_2f_2fdevel17.cnaf.infn.it_3a9000_2fgmIXAmuyS5inwyPnQOKBOQ/input/bigfile 
    -rw-r--r--  1 dteam043 dteam 28M Apr 21 13:01 /var/glite/SandboxDir/gm/https_3a_2f_2fdevel17.cnaf.infn.it_3a9000_2fgmIXAmuyS5inwyPnQOKBOQ/input/bigfile

    but

    [ale@egee-rb-03 UI]$ ls -lh data/bigfile 
    -rw-r--r-- 1 ale ale 50M Aug 24  2006 data/bigfile

• BUG #43601: glite-wms-job-submit silently adds VO defaults to user configuration FIXED
  • Submit a job using option "--debug"

    [ale@egee-rb-03 UI]$  glite-wms-job-submit --debug  -a -c ~/UI/etc/wmp_wms009.conf -o uitest jdl/ls.jdl 
    -----------------------------------------
    21 Apr 2009, 13:18:10 -I- PID: 9283 (Debug) - Vo read from proxy certificate extension
    -----------------------------------------
    -----------------------------------------
    21 Apr 2009, 13:18:10 -I- PID: 9283 (Debug) - VirtualOrganisation value : dteam
    -----------------------------------------
    -----------------------------------------
    21 Apr 2009, 13:18:10 -I- PID: 9283 (Debug) - Configuration file: /home/ale/UI/etc/wmp_wms009.conf - VirtualOrganisation, RetryCount, rank attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
    -----------------------------------------
    -----------------------------------------
    21 Apr 2009, 13:18:10 -I- PID: 9283 (Debug) - Loaded user configuration file:
     /home/ale/UI/etc/wmp_wms009.conf
    -----------------------------------------
    -----------------------------------------
    21 Apr 2009, 13:18:10 -I- PID: 9283 (Debug) - Configuration file: /opt/glite/etc/dteam/glite_wmsui.conf - VirtualOrganisation, MyProxyServer attribute(s) no more supported outside JDL Default Attributes section "JdlDefaultAttributes"
    -----------------------------------------
    -----------------------------------------
    21 Apr 2009, 13:18:10 -I- PID: 9283 (Debug) - Loaded Vo specific configuration file:
     /opt/glite/etc/dteam/glite_wmsui.conf

    As you can see the user configuration is read before the loaded Vo specific configuration file

• BUG #47134: WMS UI: glite-wms-job-{delegate-proxy,submit} fail if HOME is not set FIXED
  • Unset the variable HOME and then try to use glite-wms-job-* commands

    [ale@egee-rb-03 UI]$ unset HOME; glite-wms-job-submit -a -c ~/UI/etc/wmp_wms009.conf -o uitest jdl/ls.jdl
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    ====================== glite-wms-job-submit Success ======================
    
    The job has been successfully submitted to the WMProxy

• BUG #47677: WMS job submission aborts on non-existent endpoint FIXED
  • Change the configuration file putting a non-existent wmproxy address

    [
        WmsClient = [
         ErrorStorage="/var/tmp";
         OutputStorage=  "/tmp";
         ListenerStorage="/tmp";
         DefaultStatusLevel  = 1 ;
         DefaultLoggingLevel = 0 ;
         WMProxyEndPoints = {"https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server", "https://non-existent.cern.ch:7443/glite_wms_wmproxy_server" };
        JdlDefaultAttributes =  [
            requirements = other.GlueCEStateStatus == "Production" && !RegExp("in2p3",other.GlueCEUniqueID);
            rank =-other.GlueCEStateEstimatedResponseTime ;
            ];
        ];
    ]

    Then submit a job:

    [ale@egee-rb-03 UI]$ unset HOME; glite-wms-job-submit -a -c ~/UI/etc/wmp_wms009.conf -o uitest jdl/ls.jdl
    
    Warning - getWmps
    Unable to resolve endpoint passed through configuration file: https://non-existent.cern.ch:7443/glite_wms_wmproxy_server
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    
    ====================== glite-wms-job-submit Success ======================
    
    The job has been successfully submitted to the WMProxy

• BUG #48702: job-list-match fails when first WMS tried is draining FIXED
  • Use the same configuration file as in the previous bug, then issue a glite-wms-job-list-match

    [ale@egee-rb-03 UI]$  glite-wms-job-list-match --rank -a -c ~/UI/etc/wmp_wms009.conf jdl/ls.jdl 
    
    Warning - getWmps
    Unable to resolve endpoint passed through configuration file: https://non-existent.cern.ch:7443/glite_wms_wmproxy_server
    
    Connecting to the service https://wms009.cnaf.infn.it:7443/glite_wms_wmproxy_server
    ==========================================================================
    
                         COMPUTING ELEMENT IDs LIST 
     The following CE(s) matching your job requirements have been found:

• BUG #48806: [glite-wms-job-status] glite-wms-job-status gives an error on SLC5 FIXED
  • Simply use the glite-wms-job-status command

-- AlessioGianelle - 21 Apr 2009