Tags:
, view all tags

TESTs on ICE

4) Test starts on Wed Sep 16 at 14:08:40 CEST 2009 (WMS: devel20)

Description:
  • 7200 collections each of 40 jobs
  • One collection every 60 seconds
  • Four users
  • max_ice_threads = 10
  • Use all the CEs of testbedB
  • Use automatic-delegation
  • Use 2 proxy renewal servers ("myproxy.cern.ch" and "myproxy.cnaf.infn.it")
  • The job is a "sleep 4242"
  • Resubmission has been enabled after 2 days of test
  • Lease mechanism is not used

  • Interventions in the testbed:
    • PBS CEs
      • qmgr -c "set server node_pack = False"
      • restart of pbs and maui services
    • PBS WNs
      • Set in /var/spool/pbs/mom_priv/config files:
          $ideal_load 3.5
          $max_load 4.2
      • Cleaning of the directories: /var/spool/pbs/mom_priv/jobs/
      • Restart of pbs_mom services

Partial results taken on Mon Sep 21 at 10:41:18 CEST 2009

  • Collections correctly submitted: 6659 (266360 jobs)
    • DONE OK: 134373 (-%)
    • NOT TERMINATED: 130479 (-%)
    • ABORTED+CANCELLED: 1499+9 (-%)
    • Resubmitted: 514 (-%)

  • Errors found (1518)
    • Transfer to CREAM failed due to exception:
    • Cannot move ISB (770 times)

Note:

* The blparser on cream-23 was not running. It was restarted on Fri Sep 18 at 11:22:06.

ice3_04.png

3) Test starts on Fri Sep 11 at 16:28:30 CEST 2009 (WMS: devel20)

Description:
  • 3600 collections each of 40 jobs
  • One collection every 60 seconds
  • Four users
  • max_ice_threads = 10
  • Use all the CEs of testbedB
  • Use automatic-delegation
  • Use 2 proxy renewal servers ("myproxy.cern.ch" and "myproxy.cnaf.infn.it")
  • The job is a "sleep 4242"
  • Resubmission is NOT enabled
  • Lease mechanism is not used

Submissions finish on Mon Sep at 14 04:22:55 CEST 2009

  • 3600 collections submitted in 25710 seconds: 3/7.14/54 (min/avg/max)

Final results taken on Wed Sep 16 at 09:11:18 CEST 2009

  • Collections correctly submitted: 3600 (144000 jobs)
    • DONE OK: 143485 (99.64%)
    • NOT TERMINATED: 0 (0%)
    • ABORTED+CANCELLED: 2+515 (0.36%)
    • Resubmitted: - (-%)

  • Errors found (2)
    • Transfer to CREAM failed due to exception: (2 times)
      • CREAM Register raised std::exception Received NULL fault; the error is due to another cause: FaultString=[] - FaultCode=[SOAP-ENV:Server.generalException] - FaultSubCode=[SOAP-ENV:Server.generalException] - FaultDetail=[invoke2009-09-14T01:18:56.638Z0cannot write the authN proxy to file: nullcannot write the authN proxy to file: nullorg.glite.ce.faults.AuthenticationFaultcream-29.pd.infn.it]
      • CREAM Start raised exception Received NULL fault; the error is due to another cause: FaultString=[] - FaultCode=[SOAP-ENV:Server.generalException] - FaultSubCode=[SOAP-ENV:Server.generalException] - FaultDetail=[invoke2009-09-13T19:31:01.591Z0USER_VO_LABEL not defined in msgContextUSER_VO_LABEL not defined in msgContextorg.glite.ce.faults.AuthenticationFaultcream-34.pd.infn.it]

ice3_03.png

2) Test starts on Thu Sep 10 at 16:00:00 CEST 2009 (WMS: devel20)

Description:
  • 720 collections each of 40 jobs
  • One collection every 60 seconds
  • Four users
  • max_ice_threads = 10
  • Used all the CEs of testbedB
  • Used automatic-delegation
  • Use two proxy renewal servers ("myproxy.cern.ch" and "myproxy.cnaf.infn.it") and also submit 33% of jobs without setting MyproxyServer
  • The job is a "sleep 2424"
  • Resubmission is NOT enabled
  • Lease mechanism is not used

  • Changes in the software wrt previous test:
    • CREAM
      • Use old blparser for all the CEs

Submissions finish on Fri Sep 11 at 03:51:54 CEST 2009

  • 718 collections submitted in 4540 seconds: 3/6.3/37 (min/avg/max)
    • 2 submissions fail

Final results taken on Fri Sep 11 at 15:20:33 CEST 2009

  • Collections correctly submitted: 718 (28720 jobs)
    • DONE OK: 28319 (98.6%)
    • NOT TERMINATED: 0 (0%)
    • ABORTED+CANCELLED: 5+396 (1.4%)
    • Resubmitted: - (-%)

  • Errors found (5)
    • Cannot move ISB [...] : (5 times)

Note:

  • Some failures are due to bug #54949

ice3_02.png

1) Test starts on Wed Sep 9 at 16:08:00 CEST 2009 (WMS: devel20)

Description:
  • 800 collections each of 30 jobs
  • One collection every 60 seconds
  • Four users
  • max_ice_threads = 10
  • Used all the CEs of testbedB
  • Used automatic-delegation and 2 proxy renewal servers ("myproxy.cern.ch" and "myproxy.cnaf.infn.it")
  • The job is a "sleep 4242"
  • Resubmission is NOT enabled
  • Lease mechanism is not used

  • Changes in the software wrt previous test:
    • Use a WMS updates with patches #3156 and #3183
    • ICE
      • Use new delegation renewal mechanism
    • CREAM
      • Use new blparser for pbs CEs

Submissions finish on Thu Sep 10 at 05:20:33 CEST 2009

  • 799 collections submitted in 4499 seconds: 3/5.6/48 (min/avg/max)
    • 1 submission fails

Final results taken on Fri Sep 11 at 09:20:33 CEST 2009

  • Collections correctly submitted: 799 (23970 jobs)
    • DONE OK: 23752 (99.09%)
    • NOT TERMINATED: 36 (0.15%)
    • ABORTED+CANCELLED: 95+87 (0.76%)
    • Resubmitted: - (-%)

  • Errors found (95)
    • Cannot move ISB [...] : (1 time)
    • reason=999: (1 time)
    • Proxy is expired; (93 times)

Note:

  • Some failures are due to the use of the new blparser

ice3_01.png

-- AlessioGianelle - 10 Sep 2009

Topic attachments
I Attachment Action Size Date Who Comment
PNGpng ice3_01.png manage 6.6 K 2009-09-11 - 09:05 AlessioGianelle Test_01
PNGpng ice3_02.png manage 7.0 K 2009-09-11 - 09:05 AlessioGianelle Test_02
PNGpng ice3_03.png manage 7.4 K 2009-09-16 - 08:29 AlessioGianelle Test_03
PNGpng ice3_04.png manage 7.2 K 2009-09-21 - 09:17 AlessioGianelle Test_04
Edit | Attach | PDF | History: r49 | r16 < r15 < r14 < r13 | Backlinks | Raw View | More topic actions...
Topic revision: r14 - 2009-09-21 - AlessioGianelle
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback