PATCH 3671

Upgrade from production

  • Upgrade steps:
    wget http://etics-repository.cern.ch/repository/pm/volatile/repomd/name/patch_3671/etics-volatile-build-by-name.repo -O /etc/yum.repos.d/glite-CREAMCLI.repo
    yum update
    

  • view the log of YUM for the client upgrade

Automatic tests

  • Run the following tests from the testsuite: output for lsf and pbs CE.
    • CREAM-cli-delegation.sh: OK
    • CREAM-cli-delegation-renew.sh: OK
    • CREAM-cli-job-submit: OK
    • CREAM-cli-job-status-simple.sh: OK
    • CREAM-cli-job-status-filtered.sh: OK
    • CREAM-cli-job-cancel.sh: OK
    • CREAM-cli-job-suspend.sh: OK Failed on pbs because suspend command is not supported
    • CREAM-cli-job-resume.sh: OK Failed on pbs because resume command is not supported
    • CREAM-cli-job-purge.sh: OK
    • CREAM-cli-job-list.sh: OK
    • CREAM-cli-submission-management.sh: OK
    • CREAM-cli-event-query.sh: OK
    • CREAM-cli-service-info.sh: OK

Checked bugs

  • Bug #50476 glite-ce-monitor-getinfo (CREAM CLI) gives wrong error message (missing certif path) FIXED
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
    subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
    issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    type      : proxy
    strength  : 1024 bits
    path      : /tmp/x509up_u500
    timeleft  : 23:54:22
    === VO dteam extension information ===
    VO        : dteam
    subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
    attribute : /dteam/Role=NULL/Capability=NULL
    timeleft  : 23:54:22
    uri       : voms.cern.ch:15004
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-getinfo cream-33.pd.infn.it
    Description=[cemonitor service]
    Version    =[1.0]
    HostDN     =[/C=IT/O=INFN/OU=Host/L=Padova/CN=cream-33.pd.infn.it]
    Action [SendExpiredNotification::]
    Action [DoNotSendNotification::]
    Action [SendNotification::]

  • Bug #51457 REALLY-RUNNING missing in glite-ce-job-status --help (option -s) FIXED
    [ale@egee-rb-03 CREAM-cli]$  glite-ce-job-status --help
    [...]
    <STATUS> optional argument must have the format
    
       STATUS_1[:STATUS_2:...:STATUS_N]
    
    where ':' means OR; this option will filter out all jobs that are not in one
    of the states OR'ed. STATUS_X can be one of the following:
    
       DONE-OK
       DONE-FAILED
       REGISTERED
       PENDING
       IDLE
       RUNNING
       REALLY-RUNNING
       HELD
       CANCELLED
       ABORTED
       UNKNOWN
    [...]

  • Bug #53165 Wrong reference to glite-ce-monitor-pause in glite-ce-monitor-resume help FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-resume 
    The CEMon's URL is mandatory... 
    The subscription ID is mandatory... 
    Usage: glite-ce-monitor-resume [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] --id <SUBSCRIPTION_ID_TO_RESUME> <CEMon_URL>

  • Bug #53178 Wrong --capath option in glite-ce-monitor-gettopics' help FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-gettopics
    The CEMon's URL is mandatory... 
    Usage: glite-ce-monitor-gettopics [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] <CEMon_URL>

  • Bug #53762 CREAM client produces version 4 certificates on delegation FIXED
    • Delegate a proxy on a CE
      [ale@egee-rb-03 CREAM-cli]$ glite-ce-delegate-proxy -e cream-19.pd.infn.it ale
      2010-04-08 10:58:23,721 WARN - No configuration file suitable for loading. Using built-in configuration
      2010-04-08 10:58:25,276 NOTICE - Proxy with delegation id [ale] succesfully delegated to endpoint [https://cream-19.pd.infn.it:8443//ce-cream/services/gridsite-delegation]
    • Check the delegated proxy on the CE
      [root@cream-19 proxy]# openssl x509 -in ale17556828779687 -noout -text
      Certificate:
          Data:
              Version: 3 (0x2)
              Serial Number: 1234 (0x4d2)
              Signature Algorithm: md5WithRSAEncryption
              Issuer: C=IT, O=INFN, OU=Personal Certificate, L=Padova, CN=Alessio Gianelle, CN=proxy, CN=proxy
              Validity
                  Not Before: Apr  8 08:53:25 2010 GMT
                  Not After : Apr  9 08:20:24 2010 GMT

  • Bug #57879 Provide CREAM CLI command for GetServiceInfo FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info cream-38.pd.infn.it:8443
    2010-03-17 14:54:21,951 WARN - No configuration file suitable for loading. Using built-in configuration
    Interface Version  = [2.1]
    Service Version    = [1.12]
    Description        = [CREAM 2]
    Started at         = [Tue Mar 16 10:51:33 2010]
    Submission enabled = [YES]
    Status             = [RUNNING]
    Service Property   = [cemon_url]->[https://cream-38.pd.infn.it:8443/ce-monitor/services/CEMonitor]

  • Bug #58784 CREAM CLI: possible problem when there is a wildcard in InputSandbox FIXED
    • Submit this JDL:
      [ale@egee-rb-03 CREAM-cli]$ cat example.jdl 
      [
      JobType = "Normal";
      Executable = "/bin/sleep";
      InputSandBox = "CVS/*";
      Arguments = "30";
      StdOuput="out.txt";
      StdError="err.txt";
      ]
      [ale@egee-rb-03 CREAM-cli]$ ls CVS/
      Entries  Repository  Root  Template
    • Verify on the CE the InputSandBox dir of the job:
      [root@cream-20 CREAM505718957]# ls -l ISB/
      total 12
      -rw-r--r-- 1 dteam004 dteam 999 Apr  8 16:16 Entries
      -rw-r--r-- 1 dteam004 dteam  41 Apr  8 16:16 Repository
      -rw-r--r-- 1 dteam004 dteam  45 Apr  8 16:16 Root
      -rw-r--r-- 1 dteam004 dteam   0 Apr  8 16:16 Template

  • Bug #59063 ICE can fail to start due to socket bind error FIXED
    • Start a first glite-ce-monitor-consumer:
      [ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
      Socket connection successful on port 56655 master socket 3
      Accepting connection ... 
    • And then a second one on the same port:
      [ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
      error message=Address already in use
      error code   =SOAP-ENV:Server
      Retrying in 5 seconds...
      error message=Address already in use
      error code   =SOAP-ENV:Server
      Retrying in 5 seconds...
      error message=Address already in use
      error code   =SOAP-ENV:Server
      Retrying in 5 seconds...
      error message=Address already in use
      error code   =SOAP-ENV:Server
      Retrying in 5 seconds...

  • Bug #60381 Problem in proxy time left calculation when VOMS extensions expire before proxy FIXED
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
    subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
    issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    type      : proxy
    strength  : 1024 bits
    path      : /tmp/x509up_u500
    timeleft  : 23:55:01
    === VO dteam extension information ===
    VO        : dteam
    subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    issuer    : /DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch
    attribute : /dteam/Role=NULL/Capability=NULL
    timeleft  : 0:00:00
    uri       : lcg-voms.cern.ch:15004
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
    2010-03-17 15:14:04,622 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!

  • Bug #61243 glite-ce-service-info needs another command line switch... FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info -L 2 devel05.cnaf.infn.it:8443
    2010-03-17 15:18:00,461 WARN - No configuration file suitable for loading. Using built-in configuration
    Interface Version  = [2.1]
    Service Version    = [1.12]
    Description        = [CREAM 2]
    Started at         = [Tue Mar  9 12:23:34 2010]
    Submission enabled = [YES]
    Status             = [RUNNING]
    Service Property   = [cemon_url]->[NA]
    Service Property   = [SUBMISSION_THRESHOLD_MESSAGE]->[Threshold for Load Average(1 min): 40 => Detected value for Load Average(1 min):  0.00
    Threshold for Load Average(5 min): 40 => Detected value for Load Average(5 min):  0.00
    Threshold for Load Average(15 min): 20 => Detected value for Load Average(15 min):  0.00
    Threshold for Memory Usage: 95 => Detected value for Memory Usage: 59.04%
    Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
    Threshold for Free FD: 500 => Detected value for Free FD: 400404
    Threshold for tomcat FD: 800 => Detected value for Tomcat FD: 249
    Threshold for FTP Connection: 30 => Detected value for FTP Connection: 1
    Threshold for Number of active jobs: -1 => Detected value for Number of active jobs: 0
    Threshold for Number of pending commands: -1 => Detected value for Number of pending commands: 0
    Threshold for Disk Usage: 95% => Detected value for Partition / : 4%
    
    ]

  • Bug #61437 bug in expiration proxy validation in cream-client-api-c Internal fix

  • Bug #61523 Problem in proxy expiration detection in cream-client-api-c FIXED
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
    WARNING: Unable to verify signature! Server certificate possibly not installed.
    Error: Cannot verify AC signature!
    subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
    issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    type      : proxy
    strength  : 1024 bits
    path      : /tmp/x509up_u500
    timeleft  : 23:48:49
    === VO dteam extension information ===
    VO        : dteam
    subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
    issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
    attribute : /dteam/Role=NULL/Capability=NULL
    timeleft  : 0:00:00
    uri       : voms.cern.ch:15004
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
    2010-03-18 11:02:16,225 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!

  • Bug #61894 Bad string name mapping for REALLY-RUNNING status in CREAM client API C++ Internal fix

  • Bug #62066 A better check of proxy file existance is needed in the CREAM Client C++ API FIXED
    [ale@egee-rb-03 CREAM-cli]$ rm /tmp/x509up_u500 
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
    
    Couldn't find a valid proxy.
    
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
    2010-03-18 11:35:19,243 FATAL - Certificate file /tmp/x509up_u500 is not there or is not accessible 

  • Bug #63006 error in glite-ce-job-status help text FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-status -h
    CREAM User Interface version 1.2.0
    
    glite-ce-job-status displays information concerning jobs submitted to CREAM based CEs
    
    
    Usage: glite-ce-job-status [options] <JobID_1> <JobID_2> ... <JobID_N>
    [...]
    Finally the specification of --all with --endpoint and no JobIDs argument
    neither --input <file> returns status of all jobs of the current user on the specified
    endpoint.
    [...]

  • Bug #64397 Crash in cemon consumer FIXED
    • run the glite-ce-monitor-consumer with SSL support
    • execute the command
      openssl s_client -cert usercert.pem -key userkey.pem -CApath /etc/grid-security/certificates -ssl3 -connect <consumer_host:consumer_port>
      
      , send a bunch of characters and verify that the consumer does not crash

Topic attachments
I Attachment Action SizeSorted ascending Date Who Comment
Unknown file formatgz yum_upgrade_log.txt.gz manage 0.9 K 2010-04-12 - 10:10 PaoloAndreetto YUM log for upgrade
Unknown file formatout test_CREAM_PBS.out manage 137.6 K 2010-04-08 - 13:28 AlessioGianelle Testsuite output for pbs
Unknown file formatout test_CREAM_LSF.out manage 143.6 K 2010-04-08 - 13:27 AlessioGianelle Testsuite output for lsf

This topic: EgeeJra1It > CreamCliP3671
Topic revision: r14 - 2010-04-12 - PaoloAndreetto
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback