CreamCliP3671 < EgeeJra1It

Tags: , view all tags
%TOC%



---+ *[[https://savannah.cern.ch/patch/index.php?3671][PATCH 3671]]*

---+++ Upgrade from production
   * Upgrade steps: <verbatim>
wget http://etics-repository.cern.ch/repository/pm/volatile/repomd/name/patch_3671/etics-volatile-build-by-name.repo -O /etc/yum.repos.d/glite-CREAMCLI.repo
yum update
</verbatim>

   * view the [[%ATTACHURL%/yum_upgrade_log.txt.gz][log]] of YUM for the client upgrade


---+++ Automatic tests
   * Run the following tests from the [[https://twiki.cnaf.infn.it/cgi-bin/twiki/view/EgeeJra1It/CreamCli][testsuite]]: output for [[%ATTACHURL%/test_CREAM_LSF.out][lsf]] and [[%ATTACHURL%/test_CREAM_PBS.out][pbs]] CE.
      * CREAM-cli-delegation.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-delegation-renew.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-job-submit: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-job-status-simple.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-job-status-filtered.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-job-cancel.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-job-suspend.sh: %GREEN% OK%ENDCOLOR% %ORANGE%Failed on pbs because =suspend= command is not supported%ENDCOLOR%
      * CREAM-cli-job-resume.sh: %GREEN% OK%ENDCOLOR% %ORANGE%Failed on pbs because =resume= command is not supported%ENDCOLOR%
      * CREAM-cli-job-purge.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-job-list.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-submission-management.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-event-query.sh: %GREEN% OK%ENDCOLOR%
      * CREAM-cli-service-info.sh: %GREEN% OK%ENDCOLOR%

---+++ Checked bugs

   * Bug [[https://savannah.cern.ch/bugs/?50476][#50476]] glite-ce-monitor-getinfo (CREAM CLI) gives wrong error message (missing certif path)  %GREEN% FIXED %ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 23:54:22
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 23:54:22
uri       : voms.cern.ch:15004
[ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-getinfo cream-33.pd.infn.it
Description=[cemonitor service]
Version    =[1.0]
HostDN     =[/C=IT/O=INFN/OU=Host/L=Padova/CN=cream-33.pd.infn.it]
Action [SendExpiredNotification::]
Action [DoNotSendNotification::]
Action [SendNotification::]</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?51457][#51457]] REALLY-RUNNING missing in glite-ce-job-status --help (option -s) %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$  glite-ce-job-status --help
[...]
<STATUS> optional argument must have the format

	STATUS_1[:STATUS_2:...:STATUS_N]

where ':' means OR; this option will filter out all jobs that are not in one
of the states OR'ed. STATUS_X can be one of the following:

	DONE-OK
	DONE-FAILED
	REGISTERED
	PENDING
	IDLE
	RUNNING
	REALLY-RUNNING
	HELD
	CANCELLED
	ABORTED
	UNKNOWN
[...]</verbatim>


   * Bug [[https://savannah.cern.ch/bugs/?53165][#53165]] Wrong reference to glite-ce-monitor-pause in glite-ce-monitor-resume help %GREEN% FIXED %ENDCOLOR% <verbatim>
[ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-resume 
The CEMon's URL is mandatory... 
The subscription ID is mandatory... 
Usage: glite-ce-monitor-resume [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] --id <SUBSCRIPTION_ID_TO_RESUME> <CEMon_URL></verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?53178][#53178]] Wrong --capath option in glite-ce-monitor-gettopics' help %GREEN% FIXED%ENDCOLOR% <verbatim>
[ale@egee-rb-03 CREAM-cli]$ glite-ce-monitor-gettopics
The CEMon's URL is mandatory... 
Usage: glite-ce-monitor-gettopics [--cert <CERTIFICATE_FILE] [--key <KEY_FILE>] <CEMon_URL></verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?53762][#53762]] CREAM client produces version 4 certificates on delegation %GREEN% FIXED %ENDCOLOR%
      * Delegate  a proxy on a CE<verbatim>
[ale@egee-rb-03 CREAM-cli]$ glite-ce-delegate-proxy -e cream-19.pd.infn.it ale
2010-04-08 10:58:23,721 WARN - No configuration file suitable for loading. Using built-in configuration
2010-04-08 10:58:25,276 NOTICE - Proxy with delegation id [ale] succesfully delegated to endpoint [https://cream-19.pd.infn.it:8443//ce-cream/services/gridsite-delegation]</verbatim>
      * Check the delegated proxy on the CE<verbatim>
[root@cream-19 proxy]# openssl x509 -in ale17556828779687 -noout -text
Certificate:
    Data:
        Version: 3 (0x2)
        Serial Number: 1234 (0x4d2)
        Signature Algorithm: md5WithRSAEncryption
        Issuer: C=IT, O=INFN, OU=Personal Certificate, L=Padova, CN=Alessio Gianelle, CN=proxy, CN=proxy
        Validity
            Not Before: Apr  8 08:53:25 2010 GMT
            Not After : Apr  9 08:20:24 2010 GMT</verbatim>


   * Bug [[https://savannah.cern.ch/bugs/?57879][#57879]] Provide CREAM CLI command for !GetServiceInfo %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info cream-38.pd.infn.it:8443
2010-03-17 14:54:21,951 WARN - No configuration file suitable for loading. Using built-in configuration
Interface Version  = [2.1]
Service Version    = [1.12]
Description        = [CREAM 2]
Started at         = [Tue Mar 16 10:51:33 2010]
Submission enabled = [YES]
Status             = [RUNNING]
Service Property   = [cemon_url]->[https://cream-38.pd.infn.it:8443/ce-monitor/services/CEMonitor]</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?58784][#58784]] CREAM CLI: possible problem when there is a wildcard in !InputSandbox  %GREEN% FIXED %ENDCOLOR%
      * Submit this JDL:<verbatim>
[ale@egee-rb-03 CREAM-cli]$ cat example.jdl 
[
JobType = "Normal";
Executable = "/bin/sleep";
InputSandBox = "CVS/*";
Arguments = "30";
StdOuput="out.txt";
StdError="err.txt";
]
[ale@egee-rb-03 CREAM-cli]$ ls CVS/
Entries  Repository  Root  Template</verbatim>
      * Verify on the CE the !InputSandBox dir of the job:<verbatim>
[root@cream-20 CREAM505718957]# ls -l ISB/
total 12
-rw-r--r-- 1 dteam004 dteam 999 Apr  8 16:16 Entries
-rw-r--r-- 1 dteam004 dteam  41 Apr  8 16:16 Repository
-rw-r--r-- 1 dteam004 dteam  45 Apr  8 16:16 Root
-rw-r--r-- 1 dteam004 dteam   0 Apr  8 16:16 Template</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?59063][#59063]] ICE can fail to start due to socket bind error %GREEN% FIXED %ENDCOLOR%
      * Start a first =glite-ce-monitor-consumer=:<verbatim>
[ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
Socket connection successful on port 56655 master socket 3
Accepting connection ... </verbatim>
      * And then a second one on the same port:<verbatim>
[ale@egee-rb-03 ~]$ glite-ce-monitor-consumer 56655
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...
error message=Address already in use
error code   =SOAP-ENV:Server
Retrying in 5 seconds...</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?60381][#60381]] Problem in proxy time left calculation when VOMS extensions expire before proxy %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 23:55:01
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
issuer    : /DC=ch/DC=cern/OU=computers/CN=lcg-voms.cern.ch
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 0:00:00
uri       : lcg-voms.cern.ch:15004
[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
2010-03-17 15:14:04,622 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?61243][#61243]] glite-ce-service-info needs another command line switch... %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ glite-ce-service-info -L 2 devel05.cnaf.infn.it:8443
2010-03-17 15:18:00,461 WARN - No configuration file suitable for loading. Using built-in configuration
Interface Version  = [2.1]
Service Version    = [1.12]
Description        = [CREAM 2]
Started at         = [Tue Mar  9 12:23:34 2010]
Submission enabled = [YES]
Status             = [RUNNING]
Service Property   = [cemon_url]->[NA]
Service Property   = [SUBMISSION_THRESHOLD_MESSAGE]->[Threshold for Load Average(1 min): 40 => Detected value for Load Average(1 min):  0.00
Threshold for Load Average(5 min): 40 => Detected value for Load Average(5 min):  0.00
Threshold for Load Average(15 min): 20 => Detected value for Load Average(15 min):  0.00
Threshold for Memory Usage: 95 => Detected value for Memory Usage: 59.04%
Threshold for Swap Usage: 95 => Detected value for Swap Usage: 0.00%
Threshold for Free FD: 500 => Detected value for Free FD: 400404
Threshold for tomcat FD: 800 => Detected value for Tomcat FD: 249
Threshold for FTP Connection: 30 => Detected value for FTP Connection: 1
Threshold for Number of active jobs: -1 => Detected value for Number of active jobs: 0
Threshold for Number of pending commands: -1 => Detected value for Number of pending commands: 0
Threshold for Disk Usage: 95% => Detected value for Partition / : 4%

]</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?61437][#61437]] bug in expiration proxy validation in cream-client-api-c %GREEN% Internal fix %ENDCOLOR%

   * Bug [[https://savannah.cern.ch/bugs/?61523][#61523]] Problem in proxy expiration detection in cream-client-api-c  %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all
WARNING: Unable to verify signature! Server certificate possibly not installed.
Error: Cannot verify AC signature!
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 23:48:49
=== VO dteam extension information ===
VO        : dteam
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
issuer    : /DC=ch/DC=cern/OU=computers/CN=voms.cern.ch
attribute : /dteam/Role=NULL/Capability=NULL
timeleft  : 0:00:00
uri       : voms.cern.ch:15004
[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
2010-03-18 11:02:16,225 FATAL - Problems with proxyfile [/tmp/x509up_u500]: The proxy is EXPIRED!</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?61894][#61894]] Bad string name mapping for REALLY-RUNNING status in CREAM client API C++ %GREEN% Internal fix %ENDCOLOR%

   * Bug [[https://savannah.cern.ch/bugs/?62066][#62066]] A better check of proxy file existance is needed in the CREAM Client C++ API %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ rm /tmp/x509up_u500 
[ale@egee-rb-03 CREAM-cli]$ voms-proxy-info -all

Couldn't find a valid proxy.

[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-submit -a  -r devel05.cnaf.infn.it:8443/cream-pbs-creamtest1 example.jdl 
2010-03-18 11:35:19,243 FATAL - Certificate file /tmp/x509up_u500 is not there or is not accessible </verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?63006][#63006]] error in glite-ce-job-status help text %GREEN%FIXED%ENDCOLOR%<verbatim>
[ale@egee-rb-03 CREAM-cli]$ glite-ce-job-status -h
CREAM User Interface version 1.2.0

glite-ce-job-status displays information concerning jobs submitted to CREAM based CEs


Usage: glite-ce-job-status [options] <JobID_1> <JobID_2> ... <JobID_N>
[...]
Finally the specification of --all with --endpoint and no JobIDs argument
neither --input <file> returns status of all jobs of the current user on the specified
endpoint.
[...]</verbatim>

   * Bug [[https://savannah.cern.ch/bugs/?64397][#64397]] Crash in cemon consumer %GREEN%FIXED%ENDCOLOR%
      * run the glite-ce-monitor-consumer with SSL support
      * execute the command <verbatim>
openssl s_client -cert usercert.pem -key userkey.pem -CApath /etc/grid-security/certificates -ssl3 -connect <consumer_host:consumer_port>
</verbatim>, send a bunch of characters and verify that the consumer does not crash
Attachments
Topic attachments
I	Attachment	Action	Size	Date	Who	Comment
out	test_CREAM_LSF.out	manage	143.6 K	2010-04-08 - 13:27	AlessioGianelle	Testsuite output for lsf
out	test_CREAM_PBS.out	manage	137.6 K	2010-04-08 - 13:28	AlessioGianelle	Testsuite output for pbs
gz	yum_upgrade_log.txt.gz	manage	0.9 K	2010-04-12 - 10:10	PaoloAndreetto	YUM log for upgrade
Topic revision: r14 - 2010-04-12 - PaoloAndreetto
Account
- Log In
Edit
Attach