Difference: WMSTask27731 (25 vs. 26)

Revision 262012-09-04 - FabioCapannini

Line: 1 to 1

WMS v. 3.3.8 (ex.3.3.6) test report - IGIRTC-81

WMS v. 3.3.8 (ex.3.3.6) test report - IGIRTC-81

Summary

Line: 1962 to 1962

cancel.tgz: cancel.tgz

Changed:

<
<

Proxy renewal

It is necessary to clean the proxies from ice and proxyreneal:

>
>

Limiter mechanism

Changed:

<
< [root@emi-demo12 siteinfo]# /etc/init.d/glite-wms-ice stop stopping ICE... ok [root@emi-demo12 siteinfo]# rm -rf /var/ice/persist_dir/* [root@emi-demo12 siteinfo]# /etc/init.d/glite-wms-ice start [root@emi-demo12 siteinfo]# rm -f /var/glite/spool/glite-renewd/* then

>
>

[capannini@cert-17 WMS-service]$ python WMS-limiter-mechanism.py -c wms-command.conf -V dteam -d 3 -l -t 1,4,6-10 ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++ ===> + TestSuite of the WMS Service ===> + Description: WMS Limiter Mechanism ===> +++++++++++++++++++++++++++++++++++++++++++++++++++++

Test 1: Test option --load1 threshold for load average (1 min)

Changed:

<
< Setting MYPROXYSERVER=emitb2.ics.muni.cz in wms-command.conf

>
> Test 4: Test option --memusage threshold for memory usage (%)

Added:

>
>

Test 6: Test option --ftpconn threshold for number of FTP connections

Test 7: Test option --diskusage threshold for disk usage (%)

===> ===> Test: WMS-limiter-mechanism.py ===> WMS: emi-demo12.cnaf.infn.it ===> Started: 10:26:56 ===> Ended : 10:27:09 ===> => test PASSED == ===> ===> Test log file is WMSService-TS_20120904102656.log

WMSService-TS_20120904102656.log: WMSService-TS_20120904102656.log

SandboxDir cron purger

Changed:

<
< [capannini@cert-17 ~]$ myproxy-init -s emitb2.ics.muni.cz -d -n Enter GRID pass phrase for this identity: Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini Creating proxy ................................................................................................................................................... Done Proxy Verify OK Your proxy is valid until: Mon Sep 10 12:40:44 2012 A proxy valid for 168 hours (7.0 days) for user /C=IT/O=INFN/OU=Personal Certificate/L=CNAF/CN=Fabio Capannini now exists on emitb2.ics.muni.cz.

>
>

The purge of the SandBox dir is done by a cron job

- Submit a job and force its purge before it finishes:

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo12.conf ls.jdl

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/QSigtrL4194pLBHNMqhP4A

======================================================================

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/QSigtrL4194pLBHNMqhP4A

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/QSigtrL4194pLBHNMqhP4A Current Status: Scheduled Status Reason: unavailable Destination: cream-23.pd.infn.it:8443/cream-lsf-creamcert2 Submitted: Tue Sep 4 10:59:34 2012 CEST ======================================================================

[root@emi-demo12 ~]# su - glite -bash-3.2$ -bash-3.2$ -bash-3.2$ -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/QS/ -s 04 Sep, 11:00:50 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo12.cnaf.infn.it:9000/QSigtrL4194pLBHNMqhP4A: removed DONE job

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/QSigtrL4194pLBHNMqhP4A

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/QSigtrL4194pLBHNMqhP4A Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-23.pd.infn.it:8443/cream-lsf-creamcert2 Submitted: Tue Sep 4 10:59:34 2012 CEST ======================================================================

===> Test PASSED

- Purge a done job:

[capannini@cert-17 ~]$ glite-wms-job-submit -a -c wms_emi-demo12.conf ls.jdl

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/WM0yTCgT1sL3ps_onr385Q

======================================================================

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/WM0yTCgT1sL3ps_onr385Q

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/WM0yTCgT1sL3ps_onr385Q Current Status: Done (Success) Logged Reason(s): - job completed - Job Terminated Successfully Exit code: 0 Status Reason: Job Terminated Successfully Destination: cream-23.pd.infn.it:8443/cream-lsf-creamcert1 Submitted: Tue Sep 4 11:07:10 2012 CEST ======================================================================

-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/WM/ -s 04 Sep, 11:09:29 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo12.cnaf.infn.it:9000/WM0yTCgT1sL3ps_onr385Q: removed DONE job

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/WM0yTCgT1sL3ps_onr385Q

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/WM0yTCgT1sL3ps_onr385Q Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-23.pd.infn.it:8443/cream-lsf-creamcert1 Submitted: Tue Sep 4 11:07:10 2012 CEST ======================================================================

===> Test PASSED

- Purge only jobs older than 12 hours:

-bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720

/var/SandboxDir/jb/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fjbsoQ_5fF1VpagrswsS8JhHg /var/SandboxDir/vV/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fvVZ_5f48PHzcMXys5kowuVuQ

Try to purge:

-bash-3.2$ date Tue Sep 4 11:17:35 CEST 2012 -bash-3.2$ ls -l /var/SandboxDir/jb total 4 drwxrwx--- 5 dteam029 glite 4096 Sep 3 16:18 https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fjbsoQ_5fF1VpagrswsS8JhHg -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/jb/ -t 43200 04 Sep, 11:14:36 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo12.cnaf.infn.it:9000/jbsoQ_F1VpagrswsS8JhHg: removed DONE job -bash-3.2$ ls -l /var/SandboxDir/jb total 0 -bash-3.2$ ls -l /var/SandboxDir/vV total 4 drwxrwx--- 5 dteam029 glite 4096 Sep 3 15:26 https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fvVZ_5f48PHzcMXys5kowuVuQ -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/vV/ -t 43200 04 Sep, 11:15:00 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo12.cnaf.infn.it:9000/vVZ_48PHzcMXys5kowuVuQ: removed DONE job -bash-3.2$ ls -l /var/SandboxDir/vV total 0

Find some directories that should not be purged:

-bash-3.2$ find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240 /var/SandboxDir/Xj/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fXjgbCyZA6eTGY5f34UjiQA /var/SandboxDir/q4/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fq4v9zd1tYlknSt4t-OPrsg

Try to purge:

-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Xj -t 43200 -bash-3.2$ ls -l /var/SandboxDir/Xj total 4 drwxrwx--- 5 dteam029 glite 4096 Sep 4 11:20 https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fXjgbCyZA6eTGY5f34UjiQA -bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/q4 -t 43200 -bash-3.2$ -bash-3.2$ ls -l /var/SandboxDir/q4 total 4 drwxrwx--- 5 dteam029 glite 4096 Sep 4 11:21 https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fq4v9zd1tYlknSt4t-OPrsg

===> Test PASSED

- Purge a job whose proxy is already expired

-bash-3.2$ openssl x509 -in /var/SandboxDir/Tw/https_3a_2f_2femi-demo12.cnaf.infn.it_3a9000_2fTwgaZHG4ja2Y7MeXRpZ2zA/user.proxy -noout -dates notBefore=Aug 31 12:49:16 2012 GMT notAfter=Sep 1 10:21:16 2012 GMT

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/TwgaZHG4ja2Y7MeXRpZ2zA

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/TwgaZHG4ja2Y7MeXRpZ2zA Current Status: Done (Success) Logged Reason(s): - reason=127 - Job terminated successfully Exit code: 0 Status Reason: Job terminated successfully Destination: cream-26.pd.infn.it:2119/jobmanager-lcgpbs-creamtest1 Submitted: Fri Aug 31 14:54:16 2012 CEST ======================================================================

-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Tw 04 Sep, 11:56:41 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo12.cnaf.infn.it:9000/TwgaZHG4ja2Y7MeXRpZ2zA: removed DONE job

[capannini@cert-17 ~]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/TwgaZHG4ja2Y7MeXRpZ2zA

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/TwgaZHG4ja2Y7MeXRpZ2zA Current Status: Cleared Status Reason: timed out, resource purge forced Destination: cream-26.pd.infn.it:2119/jobmanager-lcgpbs-creamtest1 Submitted: Fri Aug 31 14:54:16 2012 CEST ======================================================================

===> Test PASSED

- Purge a dag job:

[capannini@cert-17 dag]$ glite-wms-job-submit -a -c ~/wms_emi-demo12.conf dag.jdl

Connecting to the service https://emi-demo12.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ

======================================================================

[capannini@cert-17 dag]$ [capannini@cert-17 dag]$ [capannini@cert-17 dag]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ Current Status: Running Status Reason: unavailable Destination: dagman Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

- Nodes information for: Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/Wl_LHlXeQ30cNKvlh54ZXQ Current Status: Submitted Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/g21NNTFn9kKtWS6n6t5FDA Current Status: Running Status Reason: Job successfully submitted to Globus Destination: argoce01.na.infn.it:2119/jobmanager-lcgpbs-cert Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/gOM58SscVwT-QkSkZUk16g Current Status: Submitted Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/ktipRb9idvrLxLcTXYri-w Current Status: Submitted Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/sjssA8utmafm14mBPg71tg Current Status: Submitted Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

-bash-3.2$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/gc -s 04 Sep, 12:11:55 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:354): https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ: 5/5 nodes removed 04 Sep, 12:11:55 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:366): https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ: removed RUNNING dag

[capannini@cert-17 dag]$ glite-wms-job-status https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/gcPAsY6VwXNYNiOP180HjQ Current Status: Cleared Status Reason: timed out, resource purge forced Destination: dagman Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

- Nodes information for: Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/Wl_LHlXeQ30cNKvlh54ZXQ Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/g21NNTFn9kKtWS6n6t5FDA Current Status: Cleared Status Reason: timed out, resource purge forced Destination: argoce01.na.infn.it:2119/jobmanager-lcgpbs-cert Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/gOM58SscVwT-QkSkZUk16g Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/ktipRb9idvrLxLcTXYri-w Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

Status info for the Job : https://emi-demo12.cnaf.infn.it:9000/sjssA8utmafm14mBPg71tg Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Tue Sep 4 12:02:54 2012 CEST ======================================================================

===> Test PASSED

Added:

>
>

Regression tests

Bugs attached to the task

bug #92657: some sensible information should be logged on syslog Fix certified

Line: 2119 to 2435

META FILEATTACHMENT	attachment="resub.tgz" attr="" comment="" date="1341307504" name="resub.tgz" path="resub.tgz" size="4708" user="FabioCapannini" version="1"
META FILEATTACHMENT	attachment="cancel.tgz" attr="" comment="" date="1341323684" name="cancel.tgz" path="cancel.tgz" size="8938" user="FabioCapannini" version="1"
META FILEATTACHMENT	attachment="WMSService-TS_20120703143422.log" attr="" comment="" date="1341324938" name="WMSService-TS_20120703143422.log" path="WMSService-TS_20120703143422.log" size="100634" user="FabioCapannini" version="1"

Added:

>
>

META FILEATTACHMENT	attachment="WMSService-TS_20120904102656.log" attr="" comment="" date="1346747730" name="WMSService-TS_20120904102656.log" path="WMSService-TS_20120904102656.log" size="17855" user="FabioCapannini" version="1"

View topic | History: r27 < r26 < r25 < r24 | More topic actions...