PATCH 3179

Automatic tests

Test submission through a WMS (i.e. ICE)

• 2880 collections each of 25 jobs
• One collection every 60 seconds
• Four users
• We use these CEs located at Padua:
  • 6 CEs SL5/64b with cream version 1.12 (2 lsf + 4 torque)
  • 4 CEs SL4 with cream version 1.11 (2 lsf + 2 torque)
  • 11 CEs SL4 with cream version 1.12 (5 lsf + 6 torque)
• Use automatic-delegation
• The job is a "sleep random(7200)"
• Resubmission is enabled
• Use proxy renewal service (myproxy.cern.ch)
• Lease mechanism is not used

Results

• Collections correctly submitted: 2868 (71700 jobs)
  • DONE OK: 71663 (99.95%)
  • NOTDONE: 0 (0 %)
  • ABORTED: 0 (0 %)
  • CANCELLED: 37 (0.05 %) (Stucked in torque queues)
  • Resubmitted: 82 (0.11 %)

• The 82 jobs have been resubmit due to an error like this one:

  Cannot move OSB (${globus_transfer_cmd} file:///tmp/CREAM954728532/env.err gsiftp://devel18.cnaf.infn.it:2811/var/glite/SandboxDir
  /P4/https_3a_2f_2fdevel15.cnaf.infn.it_3a9000_2fP4KWHXbaYyEAymru3kNugA/output/env.err): proxy expired; /opt/glite/bin/glite-lb-logevent: 
  edg_wll_LogEvent*(): LB server (bkserver,lbproxy) store protocol error (edg_wll_LogEvent():  LB server (bkserver,lbproxy) store protocol error;; Logging library 
  ERROR:  LB server (bkserver,lbproxy) store protocol error;; edg_wll_DoLogEvent(): edg_wll_log_connect error GSSAPI Error;; edg_wll_gss_connect();; GSS 
  Error: GSS failure occured: GSS Major Status: General failure  (GSS Minor Status Error Chain: globus_gsi_gssapi: Error with gss context globus_gsi_gssapi: 
  Error with GSI credential globus_gsi_gssapi: Error with gss credential handle globus_credential: Error with credential: The proxy credential: /home/dteam002
  /home_cre34_954728532/cre34_954728532.proxy       with subject: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Luigi Zangrando/CN=proxy
  /CN=proxy/CN=proxy/CN=limited proxy       expired 42 minutes ago.  )) Cannot move OSB (${globus_transfer_cmd} file:///tmp/CREAM954728532/env.err 
  gsiftp://devel18.cnaf.infn.it:2811/var/glite/SandboxDir/P4/https_3a_2f_2fdevel15.cnaf.infn.it_3a9000_2fP4KWHXbaYyEAymru3kNugA/output/env.err): proxy 
  expired

  All the errors occur in the old CEs (i.e. version 1.11).

Checked bugs