PATCH 3671

Upgrade from production

  • Upgrade steps: 
    wget http://etics-repository.cern.ch/repository/pm/volatile/repomd/name/patch_3671/etics-volatile-build-by-name.repo -O /etc/yum.repos.d/glite-CREAMCLI.repo
yum update

  • view the log of YUM for the client upgrade

Automatic tests

  • Run the following tests from the testsuite: output for lsf and pbs CE.
    • CREAM-cli-delegation.sh: OK
    • CREAM-cli-delegation-renew.sh: OK
    • CREAM-cli-job-submit: OK
    • CREAM-cli-job-status-simple.sh: OK
    • CREAM-cli-job-status-filtered.sh: OK
    • CREAM-cli-job-cancel.sh: OK
    • CREAM-cli-job-suspend.sh: OK Failed on pbs because suspend command is not supported
    • CREAM-cli-job-resume.sh: OK Failed on pbs because resume command is not supported
    • CREAM-cli-job-purge.sh: OK
    • CREAM-cli-job-list.sh: OK
    • CREAM-cli-submission-management.sh: OK
    • CREAM-cli-event-query.sh: OK
    • CREAM-cli-service-info.sh: OK

Checked bugs

  • Bug #50476 glite-ce-monitor-getinfo (CREAM CLI) gives wrong error message (missing certif path) FIXED 
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 23:54:22
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 23:54:22
uri       : voms.cern.ch:15004
[ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-getinfo cream-33.pd.infn.it
Description=[cemonitor service]
Version    =[1.0]
HostDN     =[/C=IT/O=INFN/OU=Host/L=Padova/CN=cream-33.pd.infn.it]
Action [SendExpiredNotification::]
Action [DoNotSendNotification::]
Action [SendNotification::]

  • Bug #51457 REALLY-RUNNING missing in glite-ce-job-status --help (option -s) FIXED
    [ale@egee-rb-03 CREAM-cli]$  glite-ce-job-status --help
[...]
<STATUS> optional argument must have the format

   STATUS_1[:STATUS_2:...:STATUS_N]

where ':' means OR; this option will filter out all jobs that are not in one
of the states OR'ed. STATUS_X can be one of the following:

   DONE-OK
   DONE-FAILED
   REGISTERED
   PENDING
   IDLE
   RUNNING
   REALLY-RUNNING
   HELD
   CANCELLED
   ABORTED
   UNKNOWN
[...]

  • Bug #53165 Wrong reference to glite-ce-monitor-pause in glite-ce-monitor-resume help FIXED 
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-resume 
The CEMon's URL is mandatory... 
The subscription ID is mandatory... 
Usage: glite-ce-monitor-resume [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] --id <SUBSCRIPTION_ID_TO_RESUME> <CEMon_URL>

  • Bug #53178 Wrong --capath option in glite-ce-monitor-gettopics' help FIXED 
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-gettopics
The CEMon's URL is mandatory... 
Usage: glite-ce-monitor-gettopics [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] <CEMon_URL>

  • Bug #53762 CREAM client produces version 4 certificates on delegation FIXED
    • Delegate a proxy on a CE
      [ale@egee-rb-03 CREAM-cli]$ glite-ce-delegate-proxy -e cream-19.pd.infn.it ale
2010-04-08 10:58:23,721 WARN - No configuration file suitable for loading. Using built-in configuration
2010-04-08 10:58:25,276 NOTICE - Proxy with delegation id [ale] succesfully delegated to endpoint [https://cream-19.pd.infn.it:8443//ce-cream/services/gridsite-delegation]
    • Check the delegated proxy on the CE
      [root@cream-19 proxy]# openssl x509 -in ale17556828779687 -noout -text
Certificate:
    Data:
        Version: 3 (0x2)
        Serial Number: 1234 (0x4d2)
        Signature Algorithm: md5WithRSAEncryption
        Issuer: C=IT, O=INFN, OU=Personal Certificate, L=Padova, CN=Alessio Gianelle, CN=proxy, CN=proxy
        Validity
            Not Before: Apr  8 08:53:25 2010 GMT
            Not After : Apr  9 08:20:24 2010 GMT

  • Bug #57879 Provide CREAM CLI command for GetServiceInfo FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info cream-38.pd.infn.it:8443
2010-03-17 14:54:21,951 WARN - No configuration file suitable for loading. Using built-in configuration
Interface Version  = [2.1]
Service Version    = [1.12]
Description        = [CREAM 2]
Started at         = [Tue Mar 16 10:51:33 2010]
Submission enabled = [YES]
Status             = [RUNNING]
Service Property   = [cemon_url]->[https://cream-38.pd.infn.it:8443/ce-monitor/services/CEMonitor]

  • Bug #58784 CREAM CLI: possible problem when there is a wildcard in InputSandbox FIXED
    • Submit this JDL:
      [ale@egee-rb-03 CREAM-cli]$ cat example.jdl 
[
JobType = "Normal";
Executable = "/bin/sleep";
InputSandBox = "CVS/*";
Arguments = "30";
StdOuput="out.txt";
StdError="err.txt";
]
[ale@egee-rb-03 CREAM-cli]$ ls CVS/
Entries  Repository  Root  Template
    • Verify on the CE the InputSandBox dir of the job:
      [root@cream-20 CREAM505718957]# ls -l ISB/
total 12
-rw-r--r-- 1 dteam004 dteam 999 Apr  8 16:16 Entries
-rw-r--r-- 1 dteam004 dteam  41 Apr  8 16:16 Repository
-rw-r--r-- 1 dteam004 dteam  45 Apr  8 16:16 Root
-rw-r--r-- 1 dteam004 dteam   0 Apr  8 16:16 Template

  • Bug #59063 ICE can fail to start due to socket bind error FIXED
    • Start a first glite-ce-monitor-consumer:
      [ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
Socket connection successful on port 56655 master socket 3
Accepting connection ...
    • And then a second one on the same port:
      [ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...

  • Bug #60381 Problem in proxy time left calculation when VOMS extensions expire before proxy FIXED
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 23:55:01
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
issuer    : /DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 0:00:00
uri       : lcg-voms.cern.ch:15004
[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
2010-03-17 15:14:04,622 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!

  • Bug #61243 glite-ce-service-info needs another command line switch... FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info -L 2 devel05.cnaf.infn.it:8443
2010-03-17 15:18:00,461 WARN - No configuration file suitable for loading. Using built-in configuration
Interface Version  = [2.1]
Service Version    = [1.12]
Description        = [CREAM 2]
Started at         = [Tue Mar  9 12:23:34 2010]
Submission enabled = [YES]
Status             = [RUNNING]
Service Property   = [cemon_url]->[NA]
Service Property   = [SUBMISSION_THRESHOLD_MESSAGE]->[Threshold for Load Average(1 min): 40 => Detected value for Load Average(1 min):  0.00
Threshold for Load Average(5 min): 40 => Detected value for Load Average(5 min):  0.00
Threshold for Load Average(15 min): 20 => Detected value for Load Average(15 min):  0.00
Threshold for Memory Usage: 95 => Detected value for Memory Usage: 59.04%
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
Threshold for Free FD: 500 => Detected value for Free FD: 400404
Threshold for tomcat FD: 800 => Detected value for Tomcat FD: 249
Threshold for FTP Connection: 30 => Detected value for FTP Connection: 1
Threshold for Number of active jobs: -1 => Detected value for Number of active jobs: 0
Threshold for Number of pending commands: -1 => Detected value for Number of pending commands: 0
Threshold for Disk Usage: 95% => Detected value for Partition / : 4%

]

  • Bug #61437 bug in expiration proxy validation in cream-client-api-c Internal fix

  • Bug #61523 Problem in proxy expiration detection in cream-client-api-c FIXED
    [ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
WARNING: Unable to verify signature! Server certificate possibly not installed.
Error: Cannot verify AC signature!
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 23:48:49
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 0:00:00
uri       : voms.cern.ch:15004
[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
2010-03-18 11:02:16,225 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!

  • Bug #61894 Bad string name mapping for REALLY-RUNNING status in CREAM client API C++ Internal fix

  • Bug #62066 A better check of proxy file existance is needed in the CREAM Client C++ API FIXED
    [ale@egee-rb-03 CREAM-cli]$ rm /tmp/x509up_u500 
[ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all

Couldn't find a valid proxy.

[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
2010-03-18 11:35:19,243 FATAL - Certificate file /tmp/x509up_u500 is not there or is not accessible

  • Bug #63006 error in glite-ce-job-status help text FIXED
    [ale@egee-rb-03 CREAM-cli]$ glite-ce-job-status -h
CREAM User Interface version 1.2.0

glite-ce-job-status displays information concerning jobs submitted to CREAM based CEs


Usage: glite-ce-job-status [options] <JobID_1> <JobID_2> ... <JobID_N>
[...]
Finally the specification of --all with --endpoint and no JobIDs argument
neither --input <file> returns status of all jobs of the current user on the specified
endpoint.
[...]

  • Bug #64397 Crash in cemon consumer FIXED
    • run the glite-ce-monitor-consumer with SSL support
    • execute the command 
      openssl s_client -cert usercert.pem -key userkey.pem -CApath /etc/grid-security/certificates -ssl3 -connect <consumer_host:consumer_port>
      , send a bunch of characters and verify that the consumer does not crash

Attachments Attachments
Topic attachments
I Attachment Action Size Date Who CommentSorted ascending
Unknown file formatout test_CREAM_LSF.out manage 143.6 K 2010-04-08 - 13:27 AlessioGianelle Testsuite output for lsf
Unknown file formatout test_CREAM_PBS.out manage 137.6 K 2010-04-08 - 13:28 AlessioGianelle Testsuite output for pbs
Unknown file formatgz yum_upgrade_log.txt.gz manage 0.9 K 2010-04-12 - 10:10 PaoloAndreetto YUM log for upgrade
This topic: EgeeJra1It > CreamCliP3671
Topic revision: r14 - 2010-04-12 - PaoloAndreetto
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback