Tags:
, view all tags

Testing Report for Release 4.0.13-0

Update & Configuration

Log from the HLR host::

  • update log here
  • configuration log here

Installation & Configuration

Log from the HLR host::

  • installation log here
  • configuration log here

Log from the CE sensors dgas host:

  • installation log here
  • configuration is not necessary (it hasn't been performed)

RPM checks

The rpms installed:

[root@cert-13 ~]# rpm -qa | grep -i dgas | sort
glite-dgas-common-4.0.15-0.centos5
glite-dgas-hlr-clients-4.0.15-0.centos5
glite-dgas-hlr-service-4.0.15-0.centos5
glite-dgas-hlr-service-consumers-4.0.15-0.centos5
yaim-dgas-5.0.0-5

Check the rpm installed put the executable, libraries and configuration file in the right palce:

[[root@cert-13 ~]# rpm -ql glite-dgas-common-4.0.15-0.centos5
/usr/include
/usr/include/glite
/usr/include/glite/dgas
/usr/include/glite/dgas/tls
/usr/include/glite/dgas/tls/socket++
/usr/include/glite/dgas/tls/socket++/errors.h
/usr/include/glite/dgas/tls/socket++/tokens.h
/usr/lib64
/usr/lib64/libglite_dgas_config.a
/usr/lib64/libglite_dgas_config.so
/usr/lib64/libglite_dgas_config.so.0
/usr/lib64/libglite_dgas_config.so.0.0.0
/usr/lib64/libglite_dgas_localSecurity.a
/usr/lib64/libglite_dgas_localSecurity.so
/usr/lib64/libglite_dgas_localSecurity.so.0
/usr/lib64/libglite_dgas_localSecurity.so.0.0.0
/usr/lib64/libglite_dgas_lock.a
/usr/lib64/libglite_dgas_lock.so
/usr/lib64/libglite_dgas_lock.so.0
/usr/lib64/libglite_dgas_lock.so.0.0.0
/usr/lib64/libglite_dgas_log.a
/usr/lib64/libglite_dgas_log.so
/usr/lib64/libglite_dgas_log.so.0
/usr/lib64/libglite_dgas_log.so.0.0.0
/usr/lib64/libglite_dgas_tls_gsisocket_pp.a
/usr/lib64/libglite_dgas_tls_gsisocket_pp.so
/usr/lib64/libglite_dgas_tls_gsisocket_pp.so.0
/usr/lib64/libglite_dgas_tls_gsisocket_pp.so.0.0.0
/usr/lib64/libglite_dgas_tls_socket_pp.a
/usr/lib64/libglite_dgas_tls_socket_pp.so
/usr/lib64/libglite_dgas_tls_socket_pp.so.0
/usr/lib64/libglite_dgas_tls_socket_pp.so.0.0.0
/usr/lib64/libglite_dgas_xmlutil.a
/usr/lib64/libglite_dgas_xmlutil.so
/usr/lib64/libglite_dgas_xmlutil.so.0
/usr/lib64/libglite_dgas_xmlutil.so.0.0.0


[root@cert-13 ~]# rpm -ql glite-dgas-hlr-clients-4.0.15-0.centos5
/usr/bin
/usr/bin/dgas-hlr-query
/usr/bin/dgas-ping
/usr/lib64
/usr/lib64/libglite_dgas_pingClient.a
/usr/lib64/libglite_dgas_pingClient.so
/usr/lib64/libglite_dgas_pingClient.so.0
/usr/lib64/libglite_dgas_pingClient.so.0.0.0
/usr/share/man
/usr/share/man/man1
/usr/share/man/man1/dgas-hlr-query.1.gz
/usr/share/man/man1/dgas-ping.1.gz


[root@cert-13 ~]# rpm -ql glite-dgas-hlr-service-4.0.15-0.centos5
/etc/dgas
/etc/dgas/dgas_hlr.conf.template
/etc/dgas/dgas_hlr.sql
/etc/dgas/dgas_hlr_tmp.sql
/etc/dgas/dgas_sumrecords2goc.conf.template
/etc/dgas/glite-dgas-sumrecords2goc-SumCPU.sql
/usr/lib64
/usr/lib64/libdgasAtmResourceEngine.a
/usr/lib64/libdgasAtmResourceEngine.so
/usr/lib64/libdgasAtmResourceEngine.so.0
/usr/lib64/libdgasAtmResourceEngine.so.0.0.0
/usr/lib64/libdgasAtmResourceEngine2.a
/usr/lib64/libdgasAtmResourceEngine2.so
/usr/lib64/libdgasAtmResourceEngine2.so.0
/usr/lib64/libdgasAtmResourceEngine2.so.0.0.0
/usr/lib64/libdgasEngineCmnUtl.a
/usr/lib64/libdgasEngineCmnUtl.so
/usr/lib64/libdgasEngineCmnUtl.so.0
/usr/lib64/libdgasEngineCmnUtl.so.0.0.0
/usr/lib64/libglite_dgas_atmResBankClient.a
/usr/lib64/libglite_dgas_atmResBankClient.so
/usr/lib64/libglite_dgas_atmResBankClient.so.0
/usr/lib64/libglite_dgas_atmResBankClient.so.0.0.0
/usr/lib64/libglite_dgas_atmResBankClient2.a
/usr/lib64/libglite_dgas_atmResBankClient2.so
/usr/lib64/libglite_dgas_atmResBankClient2.so.0
/usr/lib64/libglite_dgas_atmResBankClient2.so.0.0.0
/usr/lib64/libglite_dgas_dbhelper.a
/usr/lib64/libglite_dgas_dbhelper.so
/usr/lib64/libglite_dgas_dbhelper.so.0
/usr/lib64/libglite_dgas_dbhelper.so.0.0.0
/usr/lib64/libglite_dgas_hlr.a
/usr/lib64/libglite_dgas_hlr.so
/usr/lib64/libglite_dgas_hlr.so.0
/usr/lib64/libglite_dgas_hlr.so.0.0.0
/usr/lib64/libglite_dgas_hlrGenericQuery.a
/usr/lib64/libglite_dgas_hlrGenericQuery.so
/usr/lib64/libglite_dgas_hlrGenericQuery.so.0
/usr/lib64/libglite_dgas_hlrGenericQuery.so.0.0.0
/usr/lib64/libglite_dgas_hlrQTransaction.a
/usr/lib64/libglite_dgas_hlrQTransaction.so
/usr/lib64/libglite_dgas_hlrQTransaction.so.0
/usr/lib64/libglite_dgas_hlrQTransaction.so.0.0.0
/usr/lib64/libglite_dgas_hlrTransLog.a
/usr/lib64/libglite_dgas_hlrTransLog.so
/usr/lib64/libglite_dgas_hlrTransLog.so.0
/usr/lib64/libglite_dgas_hlrTransLog.so.0.0.0
/usr/lib64/libglite_dgas_serviceCommonUtils.a
/usr/lib64/libglite_dgas_serviceCommonUtils.so
/usr/lib64/libglite_dgas_serviceCommonUtils.so.0
/usr/lib64/libglite_dgas_serviceCommonUtils.so.0.0.0
/usr/libexec
/usr/libexec/dgas-hlr-checkHostCertProxy.sh
/usr/libexec/dgas-hlr-urforward
/usr/libexec/dgas-ml-client
/usr/libexec/dgasmonitor
/usr/libexec/dgasmonitor/glite-dgas-monitor-run.sh
/usr/libexec/dgasmonitor/plugins
/usr/libexec/dgasmonitor/plugins/ping_2
/usr/libexec/dgasmonitor/plugins/ping_3
/usr/libexec/dgasmonitor/plugins/ping_4
/usr/libexec/dgastests
/usr/libexec/dgastests/full.test
/usr/libexec/dgastests/glite-dgas-testrun.pl
/usr/libexec/dgastests/joinCover.pl
/usr/libexec/dgastests/level1.test
/usr/libexec/dgastests/level2.test
/usr/libexec/dgastests/sensors_full.test
/usr/libexec/dgastests/storage.test
/usr/libexec/dgastests/test.conf
/usr/libexec/dgastests/tests
/usr/libexec/dgastests/tests/UR_LRMS_lsf.records
/usr/libexec/dgastests/tests/UR_LRMS_pbs.records
/usr/libexec/dgastests/tests/addResourceAuth.sh
/usr/libexec/dgastests/tests/atmClient.sh
/usr/libexec/dgastests/tests/benchmarksTest.sh
/usr/libexec/dgastests/tests/checkTable.sh
/usr/libexec/dgastests/tests/cleanResubJob.sh
/usr/libexec/dgastests/tests/cleanUpJob.sh
/usr/libexec/dgastests/tests/createLSFRecords.sh
/usr/libexec/dgastests/tests/delResourceAuth.sh
/usr/libexec/dgastests/tests/dgas_sensors_test.conf
/usr/libexec/dgastests/tests/dgas_sensors_test.conf.lsf.ldif.sed
/usr/libexec/dgastests/tests/dgas_sensors_test.conf.lsf.sed
/usr/libexec/dgastests/tests/dgas_sensors_test.conf.template
/usr/libexec/dgastests/tests/dgas_sensors_test_poolPatterns.conf
/usr/libexec/dgastests/tests/generateJobId.sh
/usr/libexec/dgastests/tests/glideInTest.sh
/usr/libexec/dgastests/tests/glite-info-dynamic-ce.ldif.4482
/usr/libexec/dgastests/tests/grid-jobmap.template
/usr/libexec/dgastests/tests/grid-jobmap.template.lsf
/usr/libexec/dgastests/tests/gridJobFQAN.lsf.sed
/usr/libexec/dgastests/tests/gridJobFQAN.sed
/usr/libexec/dgastests/tests/gridJobGlideIn.sed
/usr/libexec/dgastests/tests/gridJobpool.sed
/usr/libexec/dgastests/tests/hlrDBExists.sh
/usr/libexec/dgastests/tests/hlrHADIsAlive.sh
/usr/libexec/dgastests/tests/hlrQmgrIsAlive.sh
/usr/libexec/dgastests/tests/hlrServerdIsAlive.sh
/usr/libexec/dgastests/tests/hlr_tmpDBExists.sh
/usr/libexec/dgastests/tests/localJobmap.sed
/usr/libexec/dgastests/tests/missingStartQtimeJob.sh
/usr/libexec/dgastests/tests/multiplePing.sh
/usr/libexec/dgastests/tests/multipleRecords.sh
/usr/libexec/dgastests/tests/mysqldPing.sh
/usr/libexec/dgastests/tests/mysqldStatus.sh
/usr/libexec/dgastests/tests/negativeWCTJob.sh
/usr/libexec/dgastests/tests/poolAccountPattern.conf.template
/usr/libexec/dgastests/tests/putLSFURindgasURBox.sh
/usr/libexec/dgastests/tests/putURindgasURBox.SQL.sh
/usr/libexec/dgastests/tests/putURindgasURBox.sh
/usr/libexec/dgastests/tests/static-test.ldif
/usr/libexec/dgastests/tests/test.lsf.UR
/usr/libexec/dgastests/tests/test.pbs.UR
/usr/libexec/dgastests/tests/test.pbs.UR.SQL
/usr/libexec/dgastests/tests/testJobMap.conf
/usr/libexec/dgastests/tests/testMinus_a.sh
/usr/libexec/dgastests/tests/testMinus_o.sh
/usr/libexec/dgastests/tests/testResubmission.sh
/usr/libexec/dgastests/tests/voOriginTest.sh
/usr/libexec/dgastests/tests/voproblemjob.sh
/usr/libexec/dgastests/tests/waitForJob.sh
/usr/libexec/dgastests/tests/wrongcputjob.sh
/usr/sbin
/usr/sbin/dgas-hlr-addadmin
/usr/sbin/dgas-hlr-addresource
/usr/sbin/dgas-hlr-archive
/usr/sbin/dgas-hlr-bdiiresimport.pl
/usr/sbin/dgas-hlr-checkqueue
/usr/sbin/dgas-hlr-dbcreate
/usr/sbin/dgas-hlr-deladmin
/usr/sbin/dgas-hlr-delresource
/usr/sbin/dgas-hlr-had.pl
/usr/sbin/dgas-hlr-listener
/usr/sbin/dgas-hlr-populateJobTransSummary
/usr/sbin/dgas-hlr-qmgr
/usr/sbin/dgas-hlr-queryadmin
/usr/sbin/dgas-hlr-queryresource
/usr/sbin/dgas-hlr-sqlexec
/usr/sbin/dgas-hlr-translatedb
/usr/sbin/dgas-hlrd
/usr/sbin/dgas-sumrecords2goc.pl
/usr/sbin/dgas-sumrecords2gocSSMAggregate.pl


[root@cert-13 ~]# rpm -ql glite-dgas-hlr-service-consumers-4.0.15-0.centos5
/etc/dgas
/etc/dgas/car_aggregated_v1.2.xsd
/etc/dgas/car_v1.2.xsd
/etc/dgas/dgas_amq_consumer.conf.template
/etc/dgas/ogfur_v1.xsd.xml
/usr/lib64
/usr/lib64/libglite_dgas_AMQConsumer.a
/usr/lib64/libglite_dgas_AMQConsumer.so
/usr/lib64/libglite_dgas_AMQConsumer.so.0
/usr/lib64/libglite_dgas_AMQConsumer.so.0.0.0
/usr/lib64/libglite_dgas_legacyRecordManager.a
/usr/lib64/libglite_dgas_legacyRecordManager.so
/usr/lib64/libglite_dgas_legacyRecordManager.so.0
/usr/lib64/libglite_dgas_legacyRecordManager.so.0.0.0
/usr/libexec
/usr/libexec/dgas-AMQConsumer
/usr/libexec/dgas-legacyRecordManager
/usr/libexec/glite-dgas-ogfurParser
/usr/sbin
/usr/sbin/dgas-hlr-amq-consumer


[root@cert-13 ~]# rpm -ql yaim-dgas-5.0.0-5
/opt/glite/yaim/defaults
/opt/glite/yaim/defaults/hlr.pre
/opt/glite/yaim/examples/siteinfo/services
/opt/glite/yaim/examples/siteinfo/services/dgas_sensors
/opt/glite/yaim/examples/siteinfo/services/hlr
/opt/glite/yaim/examples/siteinfo/services/igi-hlr
/opt/glite/yaim/functions
/opt/glite/yaim/functions/config_dgas_ce
/opt/glite/yaim/functions/config_dgas_hlr
/opt/glite/yaim/functions/config_dgas_mysql
/opt/glite/yaim/functions/utils
/opt/glite/yaim/functions/utils/manage_conf
/opt/glite/yaim/node-info.d
/opt/glite/yaim/node-info.d/dgas_sensors
/opt/glite/yaim/node-info.d/hlr
/opt/glite/yaim/node-info.d/igi-hlr

Only yaim files are in /opt/glite all other HLR server files are in EMI or linux standard places.

First Functionality Test (Legacy mode):

Try to submit 20 jobs to a CE and see if the records arrive to HLR :

From HLR Server : Check the dgas-hlrd status and add the resource (CE DN is needed) from dgas:

[root@cert-13 ~]# /etc/init.d/dgas-hlrd status
/var/lock/dgas/dgas_hlrd.lock
Process HLR listener: 8465
root      8465 99.8  0.1 113028  3540 pts/0    R    Jan30 1089:59 /usr//sbin/dgas-hlr-listener -c /etc/dgas/dgas_hlr.conf
The process is running.
/var/lock/dgas/dgas_hlr_qmgrd.lock
Process Batch Transaction manager: 8466
root      8466  0.0  0.1 110588  4000 pts/0    S    Jan30   0:11 /usr//sbin/dgas-hlr-qmgr -l /var/log/dgas/dgas_hlr_qmgrd.log -c /etc/dgas/dgas_hlr.conf
The process is running.
/var/lock/dgas/dgas_hlr_urforward.lock
Process urForward: 8467
root      8467  0.0  0.1 100512  5316 pts/0    S    Jan30   0:00 /usr//libexec/dgas-hlr-urforward -c /etc/dgas/dgas_hlr.conf -d
The process is running.

[root@cert-13 ~]# dgas-hlr-addadmin -Sa "/C=IT/O=INFN/OU=Host/L=Padova/CN=cert-34.pd.infn.it"
Record added!

From CE CREAM Host: The dgas sensors into the CE CREAM host cert-34.pd.infn.it are the production sensors release:

 
[root@cert-34 ~]# rpm -qa | grep -i dgas | sort
glite-dgas-common-4.0.13-0.centos5
glite-dgas-hlr-clients-4.0.13-0.centos5
glite-dgas-hlr-sensors-4.0.13-1.centos5
glite-dgas-hlr-sensors-producers-4.0.13-2.centos5
yaim-dgas-5.0.0-3

From UI :

[traldi@cert-25 ~]$  for i in `seq 1 20`; do glite-ce-job-submit -r cert-34.pd.infn.it:8443/cream-pbs-cert -a outputTest.jdl; done
https://cert-34.pd.infn.it:8443/CREAM454293718
https://cert-34.pd.infn.it:8443/CREAM771354464
https://cert-34.pd.infn.it:8443/CREAM648230101
https://cert-34.pd.infn.it:8443/CREAM371216538
https://cert-34.pd.infn.it:8443/CREAM062490903
https://cert-34.pd.infn.it:8443/CREAM496753688
https://cert-34.pd.infn.it:8443/CREAM583232492
https://cert-34.pd.infn.it:8443/CREAM124393641
https://cert-34.pd.infn.it:8443/CREAM671949895
https://cert-34.pd.infn.it:8443/CREAM397215650
https://cert-34.pd.infn.it:8443/CREAM355727761
https://cert-34.pd.infn.it:8443/CREAM433740729
https://cert-34.pd.infn.it:8443/CREAM962473061
https://cert-34.pd.infn.it:8443/CREAM547526727
https://cert-34.pd.infn.it:8443/CREAM832741628
https://cert-34.pd.infn.it:8443/CREAM496403740
https://cert-34.pd.infn.it:8443/CREAM949026022
https://cert-34.pd.infn.it:8443/CREAM520168772
https://cert-34.pd.infn.it:8443/CREAM178680557
https://cert-34.pd.infn.it:8443/CREAM083653896

[traldi@cert-25 ~]$ glite-ce-job-status https://cert-34.pd.infn.it:8443/CREAM454293718

******  JobID=[https://cert-34.pd.infn.it:8443/CREAM454293718]
        Status        = [DONE-OK]
        ExitCode      = [0]


[traldi@cert-25 ~]$ glite-ce-job-status https://cert-34.pd.infn.it:8443/CREAM355727761

******  JobID=[https://cert-34.pd.infn.it:8443/CREAM355727761]
        Status        = [DONE-OK]
        ExitCode      = [0]

From HLR Server : Check the data before sending:

mysql> select count(*) from jobTransSummary;
+----------+
| count(*)  |
+----------+
|        0       | 
+----------+
1 row in set (0.00 sec)

Check the data after sending:

mysql> select count(*) from jobTransSummary;
+----------+
| count(*)   |
+----------+
|       20      | 
+----------+
1 row in set (0.00 sec)

Second Functionality Test (Legacy mode) using new sensors version:

In the section above you could have a look to update sensors log.

From CE CREAM Host: The dgas sensors into the CE CREAM host cert-34.pd.infn.it are the new release of sensors (nothing should be change):

 
[root@cert-34 ~]# rpm -qa | grep -i dgas
yaim-dgas-5.0.0-5
glite-dgas-hlr-sensors-4.0.13-1.centos5
glite-dgas-hlr-clients-4.0.15-0.centos5
glite-dgas-common-4.0.15-0.centos5
glite-dgas-hlr-sensors-producers-4.0.13-2.centos5

No service dgas-urcollector and dgas-pushd restart have been performed.

From UI :

[traldi@cert-25 ~]$  for i in `seq 1 10`; do glite-ce-job-submit -r cert-34.pd.infn.it:8443/cream-pbs-cert -a outputTest.jdl; done
https://cert-34.pd.infn.it:8443/CREAM768368487
https://cert-34.pd.infn.it:8443/CREAM675666899
https://cert-34.pd.infn.it:8443/CREAM313629381
https://cert-34.pd.infn.it:8443/CREAM840991372
https://cert-34.pd.infn.it:8443/CREAM849130647
https://cert-34.pd.infn.it:8443/CREAM211683581
https://cert-34.pd.infn.it:8443/CREAM245534322
https://cert-34.pd.infn.it:8443/CREAM389791164
https://cert-34.pd.infn.it:8443/CREAM893412136
https://cert-34.pd.infn.it:8443/CREAM031719644
[traldi@cert-25 ~]$ glite-ce-job-status https://cert-34.pd.infn.it:8443/CREAM768368487

******  JobID=[https://cert-34.pd.infn.it:8443/CREAM768368487]
        Status        = [DONE-OK]
        ExitCode      = [0]

In HLR Server host : Have a look into the database:


mysql> select count(*) from jobTransSummary;
+----------+
| count(*) |
+----------+
|       32 | 
+----------+
1 row in set (0.00 sec)

The data is correctly arrived.

-- SergioTraldi - 2013-01-31

Edit | Attach | PDF | History: r5 | r4 < r3 < r2 < r1 | Backlinks | Raw View | More topic actions...
Topic revision: r1 - 2013-01-31 - SergioTraldi
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback