• Bug #64397 Crash in cemon consumer FIXED
  • run the glite-ce-monitor-consumer with SSL support
  • execute the command

    openssl s_client -cert usercert.pem -key userkey.pem -CApath /etc/grid-security/certificates -ssl3 -connect <consumer_host:consumer_port>
    

    , send a bunch of characters and verify that the consumer does not crash

• Upgrade steps:

  wget http://etics-repository.cern.ch/repository/pm/volatile/repomd/name/patch_3671/etics-volatile-build-by-name.repo -O /etc/yum.repos.d/glite-CREAMCLI.repo
  yum update
  

• view the log of YUM for the client upgrade

• Bug #58784 CREAM CLI: possible problem when there is a wildcard in InputSandbox FIXED
  • Submit this JDL:

    [ale@egee-rb-03 CREAM-cli]$ cat example.jdl 
    [
    JobType = "Normal";
    Executable = "/bin/sleep";
    InputSandBox = "CVS/*";
    Arguments = "30";
    StdOuput="out.txt";
    StdError="err.txt";
    ]
    [ale@egee-rb-03 CREAM-cli]$ ls CVS/
    Entries  Repository  Root  Template

  • Verify on the CE the InputSandBox dir of the job:

    [root@cream-20 CREAM505718957]# ls -l ISB/
    total 12
    -rw-r--r-- 1 dteam004 dteam 999 Apr  8 16:16 Entries
    -rw-r--r-- 1 dteam004 dteam  41 Apr  8 16:16 Repository
    -rw-r--r-- 1 dteam004 dteam  45 Apr  8 16:16 Root
    -rw-r--r-- 1 dteam004 dteam   0 Apr  8 16:16 Template

• Bug #59063 ICE can fail to start due to socket bind error FIXED
  • Start a first glite-ce-monitor-consumer:

    [ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
    Socket connection successful on port 56655 master socket 3
    Accepting connection ... 

  • And then a second one on the same port:

    [ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
    error message=Address already in use
    error code   =SOAP-ENV:Server
    Retrying in 5 seconds...
    error message=Address already in use
    error code   =SOAP-ENV:Server
    Retrying in 5 seconds...
    error message=Address already in use
    error code   =SOAP-ENV:Server
    Retrying in 5 seconds...
    error message=Address already in use
    error code   =SOAP-ENV:Server
    Retrying in 5 seconds...

• Bug #61437 bug in expiration proxy validation in cream-client-api-c Internal fix

• Bug #61894 Bad string name mapping for REALLY-RUNNING status in CREAM client API C++ Internal fix

• Run the following tests from the testsuite: output for lsf and pbs CE.
  • CREAM-cli-delegation.sh: OK
  • CREAM-cli-delegation-renew.sh: OK
  • CREAM-cli-job-submit: OK
  • CREAM-cli-job-status-simple.sh: OK
  • CREAM-cli-job-status-filtered.sh: OK
  • CREAM-cli-job-cancel.sh: OK
  • CREAM-cli-job-suspend.sh: OK Failed on pbs because suspend command is not supported
  • CREAM-cli-job-resume.sh: OK Failed on pbs because resume command is not supported
  • CREAM-cli-job-purge.sh: OK
  • CREAM-cli-job-list.sh: OK
  • CREAM-cli-submission-management.sh: OK
  • CREAM-cli-event-query.sh: OK
  • CREAM-cli-service-info.sh: OK

• Bug #50476 glite-ce-monitor-getinfo (CREAM CLI) gives wrong error message (missing certif path) FIXED

  [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
  subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
  issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  type      : proxy
  strength  : 1024 bits
  path      : /tmp/x509up_u500
  timeleft  : 23:54:22
  === VO dteam extension information ===
  VO        : dteam
  subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
  attribute : /dteam/Role=NULL/Capability=NULL
  timeleft  : 23:54:22
  uri       : voms.cern.ch:15004
  [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-getinfo cream-33.pd.infn.it
  Description=[cemonitor service]
  Version    =[1.0]
  HostDN     =[/C=IT/O=INFN/OU=Host/L=Padova/CN=cream-33.pd.infn.it]
  Action [SendExpiredNotification::]
  Action [DoNotSendNotification::]
  Action [SendNotification::]

• Bug #53165 Wrong reference to glite-ce-monitor-pause in glite-ce-monitor-resume help FIXED

  [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-resume 
  The CEMon's URL is mandatory... 
  The subscription ID is mandatory... 
  Usage: glite-ce-monitor-resume [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] --id <SUBSCRIPTION_ID_TO_RESUME> <CEMon_URL>

• Bug #53178 Wrong --capath option in glite-ce-monitor-gettopics' help FIXED

  [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-gettopics
  The CEMon's URL is mandatory... 
  Usage: glite-ce-monitor-gettopics [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] <CEMon_URL>

• Bug #53762 CREAM client produces version 4 certificates on delegation FIXED
  • Delegate a proxy on a CE

    [ale@egee-rb-03 CREAM-cli]$ glite-ce-delegate-proxy -e cream-19.pd.infn.it ale
    2010-04-08 10:58:23,721 WARN - No configuration file suitable for loading. Using built-in configuration
    2010-04-08 10:58:25,276 NOTICE - Proxy with delegation id [ale] succesfully delegated to endpoint [https://cream-19.pd.infn.it:8443//ce-cream/services/gridsite-delegation]

  • Check the delegated proxy on the CE

    [root@cream-19 proxy]# openssl x509 -in ale17556828779687 -noout -text
    Certificate:
        Data:
            Version: 3 (0x2)
            Serial Number: 1234 (0x4d2)
            Signature Algorithm: md5WithRSAEncryption
            Issuer: C=IT, O=INFN, OU=Personal Certificate, L=Padova, CN=Alessio Gianelle, CN=proxy, CN=proxy
            Validity
                Not Before: Apr  8 08:53:25 2010 GMT
                Not After : Apr  9 08:20:24 2010 GMT

• Bug #50476 glite-ce-monitor-getinfo (CREAM CLI) gives wrong error message (missing certif path) NOT TESTED

• Bug #53165 Wrong reference to glite-ce-monitor-pause in glite-ce-monitor-resume help NOT TESTED

• Bug #53178 Wrong --capath option in glite-ce-monitor-gettopics' help NOT TESTED

• Bug #53762 CREAM client produces version 4 certificates on delegation NOT TESTED

• Bug #58784 CREAM CLI: possible problem when there is a wildcard in InputSandbox NOT TESTED

• Bug #59063 ICE can fail to start due to socket bind error NOT TESTED

• Bug #61437 bug in expiration proxy validation in cream-client-api-c NOT TESTED

• Bug #61894 Bad string name mapping for REALLY-RUNNING status in CREAM client API C++ NOT TESTED

• • CREAM-cli-service-info.sh: === not tested ===

• Bug #61523 Problem in proxy expiration detection in cream-client-api-c FIXED

  [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
  WARNING: Unable to verify signature! Server certificate possibly not installed.
  Error: Cannot verify AC signature!
  subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
  issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  type      : proxy
  strength  : 1024 bits
  path      : /tmp/x509up_u500
  timeleft  : 23:48:49
  === VO dteam extension information ===
  VO        : dteam
  subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
  attribute : /dteam/Role=NULL/Capability=NULL
  timeleft  : 0:00:00
  uri       : voms.cern.ch:15004
  [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
  2010-03-18 11:02:16,225 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!

• Bug #62066 A better check of proxy file existance is needed in the CREAM Client C++ API FIXED

  [ale@egee-rb-03 CREAM-cli]$ rm /tmp/x509up_u500 
  [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
  
  Couldn't find a valid proxy.
  
  [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
  2010-03-18 11:35:19,243 FATAL - Certificate file /tmp/x509up_u500 is not there or is not accessible 

• Bug #63006 error in glite-ce-job-status help text FIXED

  [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-status -h
  CREAM User Interface version 1.2.0
  
  glite-ce-job-status displays information concerning jobs submitted to CREAM based CEs
  
  
  Usage: glite-ce-job-status [options] <JobID_1> <JobID_2> ... <JobID_N>
  [...]
  Finally the specification of --all with --endpoint and no JobIDs argument
  neither --input <file> returns status of all jobs of the current user on the specified
  endpoint.
  [...]

Upgrade from production

• Bug #50476 glite-ce-monitor-getinfo (CREAM CLI) gives wrong error message (missing certif path) NOT TESTED

• Bug #51457 REALLY-RUNNING missing in glite-ce-job-status --help (option -s) FIXED

  [ale@egee-rb-03 CREAM-cli]$  glite-ce-job-status --help
  [...]
  <STATUS> optional argument must have the format
  
     STATUS_1[:STATUS_2:...:STATUS_N]
  
  where ':' means OR; this option will filter out all jobs that are not in one
  of the states OR'ed. STATUS_X can be one of the following:
  
     DONE-OK
     DONE-FAILED
     REGISTERED
     PENDING
     IDLE
     RUNNING
     REALLY-RUNNING
     HELD
     CANCELLED
     ABORTED
     UNKNOWN
  [...]

• Bug #53165 Wrong reference to glite-ce-monitor-pause in glite-ce-monitor-resume help NOT TESTED

• Bug #53178 Wrong --capath option in glite-ce-monitor-gettopics' help NOT TESTED

• Bug #53762 CREAM client produces version 4 certificates on delegation NOT TESTED

• Bug #57879 Provide CREAM CLI command for GetServiceInfo FIXED

  [ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info cream-38.pd.infn.it:8443
  2010-03-17 14:54:21,951 WARN - No configuration file suitable for loading. Using built-in configuration
  Interface Version  = [2.1]
  Service Version    = [1.12]
  Description        = [CREAM 2]
  Started at         = [Tue Mar 16 10:51:33 2010]
  Submission enabled = [YES]
  Status             = [RUNNING]
  Service Property   = [cemon_url]->[https://cream-38.pd.infn.it:8443/ce-monitor/services/CEMonitor]

• Bug #58784 CREAM CLI: possible problem when there is a wildcard in InputSandbox NOT TESTED

• Bug #59063 ICE can fail to start due to socket bind error NOT TESTED

• Bug #60381 Problem in proxy time left calculation when VOMS extensions expire before proxy FIXED

  [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
  subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
  issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  type      : proxy
  strength  : 1024 bits
  path      : /tmp/x509up_u500
  timeleft  : 23:55:01
  === VO dteam extension information ===
  VO        : dteam
  subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
  issuer    : /DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch
  attribute : /dteam/Role=NULL/Capability=NULL
  timeleft  : 0:00:00
  uri       : lcg-voms.cern.ch:15004
  [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
  2010-03-17 15:14:04,622 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!

• Bug #61243 glite-ce-service-info needs another command line switch... FIXED

  [ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info -L 2 devel05.cnaf.infn.it:8443
  2010-03-17 15:18:00,461 WARN - No configuration file suitable for loading. Using built-in configuration
  Interface Version  = [2.1]
  Service Version    = [1.12]
  Description        = [CREAM 2]
  Started at         = [Tue Mar  9 12:23:34 2010]
  Submission enabled = [YES]
  Status             = [RUNNING]
  Service Property   = [cemon_url]->[NA]
  Service Property   = [SUBMISSION_THRESHOLD_MESSAGE]->[Threshold for Load Average(1 min): 40 => Detected value for Load Average(1 min):  0.00
  Threshold for Load Average(5 min): 40 => Detected value for Load Average(5 min):  0.00
  Threshold for Load Average(15 min): 20 => Detected value for Load Average(15 min):  0.00
  Threshold for Memory Usage: 95 => Detected value for Memory Usage: 59.04%
  Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
  Threshold for Free FD: 500 => Detected value for Free FD: 400404
  Threshold for tomcat FD: 800 => Detected value for Tomcat FD: 249
  Threshold for FTP Connection: 30 => Detected value for FTP Connection: 1
  Threshold for Number of active jobs: -1 => Detected value for Number of active jobs: 0
  Threshold for Number of pending commands: -1 => Detected value for Number of pending commands: 0
  Threshold for Disk Usage: 95% => Detected value for Partition / : 4%
  
  ]

• Bug #61437 bug in expiration proxy validation in cream-client-api-c NOT TESTED

• Bug #61523 Problem in proxy expiration detection in cream-client-api-c NOT TESTED

• Bug #61894 Bad string name mapping for REALLY-RUNNING status in CREAM client API C++ NOT TESTED

• Bug #62066 A better check of proxy file existance is needed in the CREAM Client C++ API NOT TESTED

• Bug #63006 error in glite-ce-job-status help text NOT TESTED

• • CREAM-cli-event-query.sh: === not tested ===

PATCH 3671

Automatic tests

• Run the following tests from the testsuite
  • WMS-cli-basic-cycle.sh: === not tested ===
  • CREAM-cli-delegation.sh: === not tested ===
  • CREAM-cli-delegation-renew.sh: === not tested ===
  • CREAM-cli-job-submit: === not tested ===
  • CREAM-cli-job-status-simple.sh: === not tested ===
  • CREAM-cli-job-status-filtered.sh: === not tested ===
  • CREAM-cli-job-cancel.sh: === not tested ===
  • CREAM-cli-job-suspend.sh: === not tested ===
  • CREAM-cli-job-resume.sh: === not tested ===
  • CREAM-cli-job-purge.sh: === not tested ===
  • CREAM-cli-job-list.sh: === not tested ===
  • CREAM-cli-submission-management.sh: === not tested ===
  • CREAM-cli-get-cemon-url.sh: === not tested ===

Checked bugs

Certification report patch 3671

-- AlessioGianelle - 2010-03-11