Difference: WMSCertificationExercise (26 vs. 27)

SandboxDir cron purger

The purge of the SandBox dir is done by a cron job

- Submit a job and force its purge before it finishes:

[capannini@devel15 WMS-service]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf ~/ls.jdl 

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ

==========================================================================


[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ
Current Status:     Scheduled 
Status Reason:      unavailable
Destination:        ce208.cern.ch:8443/cream-lsf-grid_dteam
Submitted:          Wed Jan 25 12:26:31 2012 CET
==========================================================================

[root@emi-demo11 ~]# su - glite
[glite@emi-demo11 ~]$ 
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/I- -s 
25 Jan, 12:27:33 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ: removed SCHEDULED job

[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/I-xR4xvAHsoHfhl7OplqLQ
Current Status:     Cleared 
Status Reason:      timed out, resource purge forced
Destination:        ce208.cern.ch:8443/cream-lsf-grid_dteam
Submitted:          Wed Jan 25 12:26:31 2012 CET
==========================================================================

===>     === test PASSED === 

- Purge a done job:

[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg
Current Status:     Done (Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        ce208.cern.ch:8443/cream-lsf-grid_dteam
Submitted:          Wed Jan 25 12:31:26 2012 CET
==========================================================================

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/T7 -s 
25 Jan, 14:09:45 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg: removed DONE job

[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/T7uROEeHs0MVTbeiMYDRJg
Current Status:     Cleared 
Status Reason:      timed out, resource purge forced
Destination:        ce208.cern.ch:8443/cream-lsf-grid_dteam
Submitted:          Wed Jan 25 12:31:26 2012 CET
==========================================================================

- Purge only jobs older than 12 hours:

Find some directories to be purged with the command:
# find /var/SandboxDir/ -maxdepth 2 -type d -cmin +720
/var/SandboxDir/W6/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fW65OfHAN_5fLrcvyoohMGzWQ
/var/SandboxDir/ez/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fezKOPmT5HcqCRjmO1ttSZA

Try to purge:

[glite@emi-demo11 ~]$ date
Wed Jan 25 14:15:03 CET 2012

[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/ez
total 4
drwxrwx--- 5 dteam045 glite 4096 Jan 24 10:38 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fezKOPmT5HcqCRjmO1ttSZA
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/ez -t 43200 
25 Jan, 14:20:43 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/ezKOPmT5HcqCRjmO1ttSZA: removed ABORTED job
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/ez
total 0
[glite@emi-demo11 ~]$ ls -lr /var/SandboxDir/W6
total 4
drwxrwx--- 5 dteam045 glite 4096 Jan 24 14:24 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fW65OfHAN_5fLrcvyoohMGzWQ
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/W6 -t 43200 
25 Jan, 14:21:02 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/W65OfHAN_LrcvyoohMGzWQ: removed DONE job
[glite@emi-demo11 ~]$ ls -lr /var/SandboxDir/W6
total 0


Find some directories that should not be purged:
# find /var/SandboxDir/ -maxdepth 2 -type d -cmin -240
/var/SandboxDir/St/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fStNSoiVR3S47qnaFFHEOzw
/var/SandboxDir/T5/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fT5gK96CZD8DbV8Oi1hSNcA

Try to purge:

[glite@emi-demo11 ~]$ date
Wed Jan 25 14:15:03 CET 2012

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/T5 -t 43200 
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/T5
total 4
drwxrwx--- 5 dteam045 glite 4096 Jan 25 10:29 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fT5gK96CZD8DbV8Oi1hSNcA
[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/St -t 43200 
[glite@emi-demo11 ~]$ ls -l /var/SandboxDir/St
total 4
drwxrwx--- 5 dteam045 glite 4096 Jan 25 12:59 https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fStNSoiVR3S47qnaFFHEOzw

===> Test PASSED

- Purge a job whose proxy is already expired

[glite@emi-demo11 ~]$ openssl x509 -in /var/SandboxDir/z6/https_3a_2f_2femi-demo11.cnaf.infn.it_3a9000_2fz6gxfYkbU1h8hZIyOXEOUg/user.proxy -noout -dates
notBefore=Jan 17 15:52:12 2012 GMT
notAfter=Jan 17 21:19:12 2012 GMT

[glite@emi-demo11 ~]$ date
Wed Jan 25 15:18:49 CET 2012

https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg Current Status: Submitted Submitted: Tue Jan 17 16:57:12 2012 CET Parent Job: https://emi-demo11.cnaf.infn.it:9000/79cGVuy9XVzQxwvn_Z2Hgw ======================================================================

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/z6 -s 25 Jan, 15:21:10 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:447): https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg: removed SUBMITTED job

[capannini@devel15 WMS-service]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/z6gxfYkbU1h8hZIyOXEOUg Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Tue Jan 17 16:57:12 2012 CET Parent Job: https://emi-demo11.cnaf.infn.it:9000/79cGVuy9XVzQxwvn_Z2Hgw ======================================================================

=>     test PASSED ==

- Purge a dag job

[capannini@devel15 dag]$ glite-wms-job-submit -a -c ~/wms_emi-demo11.conf dag.jdl

Connecting to the service https://emi-demo11.cnaf.infn.it:7443/glite_wms_wmproxy_server

================== glite-wms-job-submit Success ==================

The job has been successfully submitted to the WMProxy Your job identifier is:

https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw

======================================================================

[capannini@devel15 dag]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw Current Status: Running Status Reason: unavailable Destination: dagman Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

- Nodes information for: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HnZfPHnH3xgxmhl_NrRr-g Current Status: Submitted Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/X2-G_Tr9eyWgs88vjfnL2g Current Status: Submitted Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Yc4eO097SXSBrXIvhsIqyw Current Status: Submitted Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/b8bBqrceSFYU1mWEfpH-fQ Current Status: Submitted Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/hGHl6d1B1D8xPAmNXdLdsw Current Status: Submitted Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

[glite@emi-demo11 ~]$ /usr/sbin/glite-wms-purgeStorage.sh -p /var/SandboxDir/Ab -s25 Jan, 15:34:30 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:354): https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw: 5/5 nodes removed 25 Jan, 15:34:30 -I: [Info] operator()(/home/condor/execute/dir_26089/userdir/emi.wms.wms-purger/build/../src/purger.cpp:366): https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw: removed RUNNING dag

[capannini@devel15 dag]$ glite-wms-job-status https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw

=================== glite-wms-job-status Success ================= BOOKKEEPING INFORMATION:

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Ab_cMtMLDPkCNKsL-5CFaw Current Status: Cleared Status Reason: timed out, resource purge forced Destination: dagman Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

- Nodes information for: Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/HnZfPHnH3xgxmhl_NrRr-g Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/X2-G_Tr9eyWgs88vjfnL2g Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/Yc4eO097SXSBrXIvhsIqyw Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/b8bBqrceSFYU1mWEfpH-fQ Current Status: Cleared Status Reason: timed out, resource purge forced Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

Status info for the Job : https://emi-demo11.cnaf.infn.it:9000/hGHl6d1B1D8xPAmNXdLdsw Current Status: Cleared Status Reason: timed out, resource purge forced Destination: argoce01.na.infn.it:2119/jobmanager-lcgpbs-cert Submitted: Wed Jan 25 15:33:46 2012 CET ======================================================================

=>     test PASSED ==