Difference: EMI2CREAMTaskIGIRTC157SL5 (2 vs. 3)

Revision 32013-07-29 - SergioTraldi

Line: 1 to 1
 
META TOPICPARENT name="EMI2CREAMTaskJiraIGIRTC-157"

CREAM v. 1.14.5 - Testing report SL5: IGIRTC-157

Line: 48 to 48
 

Functionality tests

Changed:
<
<

CREAM PBS

>
>

CREAM LSF

 
Changed:
<
<
>
>
[traldi@cert-16 ~]$ pybot -e glue /opt/cream_test/testsuite/cream_test_suite.html INFO: The files of this testsuite will be stored under: /tmp/tmpPihwxD.cream_testing/ ========================================================================== Cream Test Suite :: This is the main testing module,needed for testing the ... ========================================================================== Set Log Level :: Set the log level used for the test suite. This c... | PASS |
Check Executables :: Check whether the needed executables for the ... | PASS |
Simple Submit :: Execute /bin/uname -a.Submit the jdl and wait for... | PASS |
ISB Base URI :: Execute a bash shell script.The script is stored i... | PASS |
ISB Client to CE :: Execute a bash shell script.The script is stor... | PASS |
ISB gsiftp to CE :: Execute a bash shell script.The script is stor... | PASS |
OSB localhost :: Execute /bin/uname -a.Store std out and error str... | PASS |
OSB gsiftp BaseDestURI :: Execute /bin/uname -a.Store std out and ... | PASS |
OSB gsiftp DestURI :: Execute /bin/uname -a.Store std out and erro... | PASS |
Environment :: Execute a bash shell script.The script is stored lo... | PASS |
Epilogue :: Execute two bash shell scripts,one for the job and the... | PASS |
Prologue :: Execute two bash shell scripts,one for the job and the... | PASS |
Explicit Delegation :: Test job submission with explicit delegatio... | PASS |
Job Cancel :: Test job cancellation.Two cases are tested: | PASS |
Job List :: Test the job listing cli utility.Store the list of the... | PASS |
Job Suspend - Resume :: Submit a job and suspend it.Wait until it'... | PASS |
Manually Cancel Job :: Submit a job and then manually cancel it on... | PASS |
Verify CE service info :: This test case verifies the output of th... | PASS |
Enable - Disable Submission :: This test case tests the proper fun... | PASS |
Job Purge :: This test case verifies the proper functionality of t... | PASS |
Admin Manage Job :: This test case checks whether a user can manag... | PASS |
Limiter :: NOTE: This test case is about 25 minutes long! | PASS |
Ban User :: This test case tests if the banning of user works. The... | PASS |
Sandbox Staging :: This test case tests the two different Sandbox ... | PASS |
Automatic Proxy Purging :: This test case checks the automatic pro... | PASS |
Verify Job Status Output :: This test is checking the output of th... | PASS |
OutputData :: This test case tests the OutputData jdl attribute. T... | PASS |
Automatic Job Purge :: This test case is testing the functionality... | PASS |
Proxy Renewal :: Submit a job lasting 20 minutes using a proxy val... | PASS |
CPU Allocation 1 :: Validate the contents of the batch job submiss... | PASS |
CPU Allocation 2 :: Validate the contents of the batch job submiss... | PASS |
CPU Allocation 3 :: Validate the contents of the batch job submiss... | PASS |
CPU Allocation 4 :: Validate the contents of the batch job submiss... | PASS |
CPU Allocation 5 :: Validate the contents of the batch job submiss... | PASS |
CPU Allocation 6 :: Validate the contents of the batch job submiss... | PASS |
Resource BDII :: Check if the resource bdii publishes all the rele... | PASS |
Logging and Bookkeeping :: Check if the logging and bookkeeping se... | PASS |
Old BLParser Restart :: Configure a CREAM CE using the old blah bl... | PASS |
Cream Test Suite :: This is the main testing module,needed for tes... | PASS | 38 critical tests, 38 passed, 0 failed 38 tests total, 38 passed, 0 failed ========================================================================== Output: /home/traldi/output.xml Log: /home/traldi/log.html Report: /home/traldi/report.html
 
Changed:
<
<
  • Functionality testsuite log
>
>
  • Functionality testsuite log
 
Changed:
<
<

CREAM LSF

>
>

Regression tests

Bug #CREAM-111 Wrong tokenization for epilogue argument list FIXED

From UI:

 
Added:
>
>
[traldi@cert-16 ~]$ globus-url-copy -vb file:///home/traldi/epilogue.sh gsiftp://cert-34.pd.infn.it:2811/tmp/epilogue.sh Source: file:///home/traldi/ Dest: gsiftp://cert-34.pd.infn.it:2811/tmp/ epilogue.sh 77 bytes 0.00 MB/sec avg 0.00 MB/sec inst
 
Deleted:
<
<
 
Changed:
<
<
  • Functionality testsuite log
>
>
[traldi@cert-16 ~]$ cat epilogueCream.jdl [ executable="/bin/sleep"; arguments="15"; inputsandbox={"gsiftp://cert-34.pd.infn.it/tmp/epilogue.sh"}; outputsandbox={"*.txt" }; outputsandboxbasedesturi="gsiftp://cert-34.pd.infn.it/tmp"; epilogue="epilogue.sh"; epiloguearguments="A B"; ]
 
Deleted:
<
<

Regression tests

 
Added:
>
>
[traldi@cert-16 ~]$ glite-ce-job-submit -r cert-34.pd.infn.it:8443/cream-pbs-cert -a epilogueCream.jdl https://cert-34.pd.infn.it:8443/CREAM684285300

[traldi@cert-16 ~]$ glite-ce-job-status https://cert-34.pd.infn.it:8443/CREAM684285300

**** JobID=[https://cert-34.pd.infn.it:8443/CREAM684285300] Status = [DONE-OK] ExitCode = [0]

 
Changed:
<
<
Bug #CREAM-111 Wrong tokenization for epilogue argument list FIXED
>
>
[traldi@cert-16 ~]$ globus-url-copy gsiftp://cert-34.pd.infn.it:2811/tmp/epilogue.txt file:///home/traldi/epilogue.txt

[traldi@cert-16 ~]$ cat epilogue.txt arg1 = A arg2 = B

 
Bug #CREAM-101 Wrong time format for MaxWallClockTime FIXED
Line: 108 to 228
 
Bug #CREAM-99 Python error on ERT calculation: local variable 'est' referenced before assignment FIXED
Added:
>
>
From UI:
[traldi@cert-16 ~]$ for i in `seq 1 15`; do echo $i; glite-ce-job-submit -r cert-34.pd.infn.it:8443/cream-pbs-cert -a sleepCream.jdl; done
1
https://cert-34.pd.infn.it:8443/CREAM744924545
2
https://cert-34.pd.infn.it:8443/CREAM749540384
3
https://cert-34.pd.infn.it:8443/CREAM196536007
4
https://cert-34.pd.infn.it:8443/CREAM746463684
5
https://cert-34.pd.infn.it:8443/CREAM984066950
6
https://cert-34.pd.infn.it:8443/CREAM577358140
7
https://cert-34.pd.infn.it:8443/CREAM644276848
8
https://cert-34.pd.infn.it:8443/CREAM373931233
9
https://cert-34.pd.infn.it:8443/CREAM599102369
10
https://cert-34.pd.infn.it:8443/CREAM100225893
11
https://cert-34.pd.infn.it:8443/CREAM413125528
12
https://cert-34.pd.infn.it:8443/CREAM028758552
13
https://cert-34.pd.infn.it:8443/CREAM620119896
14
https://cert-34.pd.infn.it:8443/CREAM763809799
15
https://cert-34.pd.infn.it:8443/CREAM096151125

From CE:

[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     0   yes   yes     0     0     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     0   yes   yes     0     0     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     0   yes   yes     0     0     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     1   yes   yes     1     0     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     1   yes   yes     0     1     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     2   yes   yes     0     2     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     3   yes   yes     1     2     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     3   yes   yes     0     3     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     4   yes   yes     1     3     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     4   yes   yes     0     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     5   yes   yes     1     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     6   yes   yes     2     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     6   yes   yes     2     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     7   yes   yes     3     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     8   yes   yes     4     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0     9   yes   yes     5     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    10   yes   yes     6     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    10   yes   yes     6     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    13   yes   yes     9     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    13   yes   yes     9     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    14   yes   yes    10     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    14   yes   yes    10     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    15   yes   yes    11     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E         
[root@cert-34 ~]# qstat -Q
Queue              Max   Tot   Ena   Str   Que   Run   Hld   Wat   Trn   Ext T         
----------------   ---   ---   ---   ---   ---   ---   ---   ---   ---   --- -         
cms                  0     0   yes   yes     0     0     0     0     0     0 E         
cert                 0    15   yes   yes    11     4     0     0     0     0 E         
grid                 0     0   yes   yes     0     0     0     0     0     0 E 

During the submission from CE:

[root@cert-34 ~]#  tail -f /var/log/bdii/bdii-update.log

 
Bug #CREAM-84 The DelegationPurger may cause a java.lang.OutOfMemoryError exception FIXED

Bug #CREAM-83 CREAM should be able to immediately kill also queued jobs, when the proxy is expiring FIXED
Added:
>
>
From CE:
[root@cream-22 ~]# grep DELEGATION_PURGE_RATE /etc/glite-ce-cream/cream-config.xml
<parameter name="DELEGATION_PURGE_RATE" value="3" />

From UI:

[traldi@cert-16 ~]$ glite-ce-delegate-proxy -e cream-22.pd.infn.it:8443 myproxy1
Proxy with delegation id [myproxy1] succesfully delegated to endpoint [cream-22.pd.infn.it:8443]

[traldi@cert-16 ~]$ glite-ce-job-submit -r cream-22.pd.infn.it:8443/cream-lsf-cert -D myproxy1 sleepCream.jdl;
https://cream-22.pd.infn.it:8443/CREAM424957199

[traldi@cert-16 ~]$ glite-ce-job-status https://cream-22.pd.infn.it:8443/CREAM424957199

******  JobID=[https://cream-22.pd.infn.it:8443/CREAM424957199]
        Status        = [REALLY-RUNNING]

From CE:

[root@cream-22 ~]# mysql -u root -p
Enter password: 

mysql> use delegationcreamdb;
Database changed

mysql> update delegation set expirationTime=now() where id="myproxy1";
Query OK, 1 row affected (0.01 sec)
Rows matched: 1  Changed: 1  Warnings: 0

From UI:

[traldi@cert-16 ~]$ glite-ce-job-status -L 1 https://cream-22.pd.infn.it:8443/CREAM424957199

******  JobID=[https://cream-22.pd.infn.it:8443/CREAM424957199]
        Current Status = [CANCELLED]
        ExitCode       = []
        Description    = [job cancelled because the related delegation has expired]
        Grid JobID     = [N/A]

        Job status changes:
        -------------------
        Status         = [REGISTERED] - [Mon 29 Jul 2013 15:02:13] (1375102933)
        Status         = [PENDING] - [Mon 29 Jul 2013 15:02:13] (1375102933)
        Status         = [IDLE] - [Mon 29 Jul 2013 15:02:13] (1375102933)
        Status         = [RUNNING] - [Mon 29 Jul 2013 15:02:19] (1375102939)
        Status         = [REALLY-RUNNING] - [Mon 29 Jul 2013 15:02:19] (1375102939)
        Status         = [CANCELLED] - [Mon 29 Jul 2013 15:05:43] (1375103143)

        Issued Commands:
        -------------------

        *** Command Name              = [JOB_REGISTER]
            Command Category          = [JOB_MANAGEMENT]
            Command Status            = [SUCCESSFULL]


        *** Command Name              = [JOB_START]
            Command Category          = [JOB_MANAGEMENT]
            Command Status            = [CREATED]


        *** Command Name              = [JOB_CANCEL]
            Command Category          = [JOB_MANAGEMENT]
            Command Status            = [SUCCESSFULL]
 
Bug #CREAM-82 Check permission for /var/cream_sandbox FIXED
Added:
>
>
From CE:
[root@cream-22 ~]# ll /var/ | grep cream_sandbox
drwxrwxr-x  2 tomcat tomcat 4096 Jul 26 12:32 cream_sandbox
[root@cream-22 ~]# ll /var/glite/ | grep cream_sandbox
drwxrwxr-x 13 tomcat tomcat 4096 Jul 26 12:35 cream_sandbox_new
 
Bug #CREAM-78 Check for /etc/lrms in config_cream_gip_scheduler_plugin FIXED
Bug #CREAM-77 List index error from persistent estimator FIXED
Bug #CREAM-75 CREAM should avoid to log the error messages by including even the full stack trace (i.e printStackTrace()) FIXED
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback