Tags:
, view all tags

Testing report: IGIRTC #22

Summary

  • Product: Storm 1.8.2
  • Release Task: Task #25353
  • ETICS Subsystem Configuration Name: emi-storm_R_1_8_2_1_RC
  • VCS Tag: BE_1.8.2-2, common_1.1.3-1, FE_1.7.3-1 and yaim-storm_4.1.8-1
  • EMI Major Release: EMI 1 (Kebnekaise)
  • Platform: SL5 epel
  • Author: Alessio Gianelle
  • Testing report:
  • Certification report:
  • Outcome: CERTIFIED

Deployment tests

Clean Installation

We use two hosts, one for the FE and the other for BE, globus-gridftp and gridhttps

Upgrade Installation

We use two hosts, one for the FE and the other for BE, globus-gridftp and gridhttps

Unit Tests

???

System tests

Functionality tests

[ale@cream-12 tstorm-1.2.0-5]$ tstorm-tests 
test_settings (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.001s

OK
test_storm_ping (tstorm.tests.atomics.AtomicsTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.142s

OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_ls_unexist_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_mkdir_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_mkdir_exist_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_ls_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_cp_bt (tstorm.tests.atomics.AtomicsTest) ... ok
test_ls_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_cp_at (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_unexist_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_unexist_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 13 tests in 39.912s

OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_cksm (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 3 tests in 12.469s

OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_data_transfer_out_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_out_exist_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_in_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_in_unexist_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_rm_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 8 tests in 33.506s

OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_voms_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms_no_auth (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 9 tests in 6.293s

OK
test_update_free_space_upon_rm (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 3.151s

OK
test_eight_digit_string_checksum (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 2.895s

OK
test_update_used_space_upon_pd (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 7.057s

OK
test_unsupported_protocols (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.062s

OK
test_non_ascii_chars (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.124s

OK
test_storm_backend_age (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.064s

OK
test_storm_database_password (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 2.666s

OK
test_storm_gridhttps_authorization_denied (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 1.606s

OK

Complete log file are here

  • Tests without voms extension


[ale@cream-12 tstorm-1.2.0-5]$ voms-proxy-init 
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
Creating proxy ....................................................... Done

Your proxy is valid until Thu Feb  9 00:00:52 2012
[ale@cream-12 tstorm-1.2.0-5]$ voms-proxy-info -all
subject   : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer    : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity  : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type      : proxy
strength  : 1024 bits
path      : /tmp/x509up_u500
timeleft  : 11:59:55
key usage : Digital Signature, Key Encipherment, Data Encipherment
[ale@cream-12 tstorm-1.2.0-5]$ tstorm-tests --novoms
test_settings (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.001s

OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_http_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_http_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_http (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 8 tests in 6.068s

OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_https (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https (tstorm.tests.https.HttpsTest) ... ADD UID for test_direct_transfer_inbound_https
ok
test_direct_transfer_inbound_https_no_auth (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_https (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok

----------------------------------------------------------------------
Ran 9 tests in 6.445s

OK
test_get_space_metadata_failure (tstorm.tests.regression.RegressionTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.106s

OK

Complete log file are here

  • Configuration tests

Run on the BE host

[root@cream-51 tstorm-1.2.0-5]# tstorm-sanity-tests 
test_glue_service (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.002s

OK
test_gluetwo_storage_share_capacity (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.002s

OK
test_glue_available_space_info_service (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.112s

OK
test_glue_available_space (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.157s

OK
test_glue_used_space (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.090s

OK
test_size (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.101s

OK
test_info_service_failure (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.041s

OK
test_gluetwo_endpoint_undefined (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.001s

OK
test_gluetwo_storage_undefined (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.001s

OK
test_gluetwo_endpoint (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.001s

OK
test_backend_server_status (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.216s

OK
test_backend_logrotate_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.007s

OK
test_backend_gridhttps (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.225s

OK
test_yaim_version_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.491s

OK
test_size_in_namespace_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.016s

OK
test_gridhttps_plugin_links (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.024s

OK
test_backend_server_name_status (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.234s

OK
test_mysql_storage_space_update (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 111.748s

OK
test_mysql_connector_java_links (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok

----------------------------------------------------------------------
Ran 1 test in 0.017s

OK

Complete log file are here

Regression tests

Verification attached bugs (which are not part of the automatic tests)

BUG #195: logrotate and cron.d task FIXED

[root@cream-51 ~]# dd if=/dev/zero of=big_file.txt bs=53477376 count=1
1+0 records in
1+0 records out
53477376 bytes (53 MB) copied, 0.103273 seconds, 518 MB/s

[root@cream-51 ~]# ls -lh big_file.txt
-rw-r--r-- 1 root root 51M Feb  8 13:59 big_file.txt

[root@cream-51 ~]# cat big_file.txt >> /var/log/storm/storm-backend.stderr
[root@cream-51 ~]# cat big_file.txt >> /var/log/storm/storm-backend.stdout

[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 52M Feb  8 14:00 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52M Feb  8 14:00 /var/log/storm/storm-backend.stdout

[root@cream-51 ~]# vi /etc/crontab
[root@cream-51 ~]# service crond restart
Stopping crond:                                            [  OK  ]
Starting crond:                                            [  OK  ]


[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm   0 Feb  8 14:03 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52K Feb  8 14:03 /var/log/storm/storm-backend.stderr-20120208.gz
-rw------- 1 storm storm   0 Feb  8 14:03 /var/log/storm/storm-backend.stdout
-rw------- 1 storm storm 55K Feb  8 14:03 /var/log/storm/storm-backend.stdout-20120208.gz

[root@cream-51 ~]# /etc/init.d/storm-backend-server restart
Stopping storm-backend-server                              [  OK  ]
Bootstrapping storm-backend-server                         [  OK  ]
Starting storm-backend-server                              [  OK  ]
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm   0 Feb  8 14:03 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52K Feb  8 14:03 /var/log/storm/storm-backend.stderr-20120208.gz
-rw------- 1 storm storm 15K Feb  8 14:03 /var/log/storm/storm-backend.stdout
-rw------- 1 storm storm 55K Feb  8 14:03 /var/log/storm/storm-backend.stdout-20120208.gz


BUG #196: logrotate and cron.d task FIXED

[root@cert-18 ~]# dd if=/dev/zero of=big_file.txt bs=53477376 count=1
1+0 records in
1+0 records out
53477376 bytes (53 MB) copied, 0.231383 seconds, 231 MB/s

[root@cert-18 ~]# ls -lh big_file.txt
-rw-r--r-- 1 root root 51M Feb  8 13:44 big_file.txt

[root@cert-18 ~]# cat big_file.txt >> /var/log/storm/storm-frontend-server.log
[root@cert-18 ~]# 

[root@cert-18 ~]# ls -lh /var/log/storm/
total 53M
-rw-r--r-- 1 storm storm 52M Feb  8 13:45 storm-frontend-server.log

[root@cert-18 ~]# vi /etc/crontab
[root@cert-18 ~]# /etc/init.d/crond restart
Stopping crond:                                            [  OK  ]
Starting crond:                                            [  OK  ]

[root@cert-18 ~]# ls -lh /var/log/storm/
total 116K
-rw-r--r-- 1 storm storm    0 Feb  8 13:52 storm-frontend-server.log
-rw-r--r-- 1 storm storm 112K Feb  8 13:52 storm-frontend-server.log-20120208.gz

[ale@cream-12 tstorm-1.2.0-5]$ /opt/d-cache/srm/bin/srmping -2  srm://cert-18.pd.infn.it:8444/
VersionInfo : v2.2
backend_type:StoRM
backend_version:<FE:1.7.3-1><BE:1.8.2-2>
backend_os_distribution:Scientific Linux SL release 5.7 (Boron)

[root@cert-18 ~]# tail -f /var/log/storm/storm-frontend-server.log


02/08 13:52:54 0x1eef16c0 main: AUDIT - Active tasks: 0
02/08 13:52:54 0x1eef16c0 main: AUDIT - Pending tasks: 1
02/08 13:52:55 0x1ef61b70 Ping: Received Ping request from: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
02/08 13:52:55 0x1ef61b70 Ping: UserDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
02/08 13:52:55 0x1ef61b70 Ping: Client IP=::ffff:193.206.210.167
02/08 13:52:55 0x1ef61b70 Ping: Number of FQANs: 1
02/08 13:52:55 0x1ef61b70 Ping: Request done.

BUG #228: Null pointer in DAO usage FIXED

[root@cream-51 ~]# vi /etc/storm/backend-server/storm.properties
[root@cream-51 ~]# service storm-backend-server restart
Stopping storm-backend-server                              [  OK  ]
Bootstrapping storm-backend-server                         [  OK  ]
Starting storm-backend-server                              [  OK  ]

[root@cream-51 ~]# service mysqld stop
Stopping MySQL:                                            [  OK  ]


[ale@cream-12 tstorm-1.2.0-5]$ srmls srm://cert-18.pd.infn.it:8444/srm/managerv2?SFN=/testers.eu-emi.eu/a1328612878.0/b1328612878.0/tstorm-output-file-1328612870.0.txt
  1048576 /testers.eu-emi.eu/a1328612878.0/b1328612878.0/tstorm-output-file-1328612870.0.txt


[root@cream-51 ~]# tail -f /var/log/storm/storm-backend.log
15:10:13.091 - ERROR [XML-RPC-0] - PtP CHUNK DAO: numberInSRM_SPACE_AVAILABLE - unable to get a valid connection!
15:10:13.092 - INFO [XML-RPC-0] - srmLs: <Grid User (VOMS) =  DN:'C=IT, O=INFN, OU=Personal Certificate, L=Padova, CN=Alessio Gianelle' FQANS:[/testers.eu-emi.eu/Role=NULL/Capability=NULL]> Request for [SURL:'srm://cert-18.pd.infn.it:8444/srm/managerv2?SFN=/testers.eu-emi.eu/a1328612878.0/b1328612878.0/tstorm-output-file-1328612870.0.txt'] successfully done with [status:SRM_SUCCESS: All requests successfully completed]
15:10:13.961 - ERROR [Timer-5] - REQUEST SUMMARY DAO! Exception in setUpConnection! com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure

The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.


BUG #231: BE restart sometimes fail HOPEFULLY FIXED

[root@cream-51 ~]# service storm-backend-server restart
Stopping storm-backend-server                              [  OK  ]
Bootstrapping storm-backend-server                         [  OK  ]
Starting storm-backend-server                              [  OK  ]
[root@cream-51 ~]# service storm-backend-server restart
Stopping storm-backend-server                              [  OK  ]
Bootstrapping storm-backend-server                         [  OK  ]
Starting storm-backend-server                              [  OK  ]

Topic attachments
I Attachment Action Size Date Who Comment
Texttxt configure.txt manage 123.7 K 2012-02-08 - 10:41 AlessioGianelle Configure log file (clean install)
Texttxt install.txt manage 249.3 K 2012-02-08 - 10:42 AlessioGianelle Install log file (clean install)
Unknown file formatlog tstorm_1328634899.0.log manage 24.8 K 2012-02-08 - 10:42 AlessioGianelle Test suite log file
Unknown file formatlog tstorm_1328698864.0.log manage 10.8 K 2012-02-08 - 11:06 AlessioGianelle Test suite log file (novoms)
Unknown file formatlog tstorm_1328700501.0.log manage 12.1 K 2012-02-08 - 11:38 AlessioGianelle Test suite log file (configuration)
Unknown file formatlog tstorm_1328712708.0.log manage 24.8 K 2012-02-08 - 15:02 AlessioGianelle Test suite log file (on update hosts)
Texttxt update.txt manage 21.2 K 2012-02-08 - 15:01 AlessioGianelle Update log file
Texttxt update_conf.txt manage 103.0 K 2012-02-08 - 15:01 AlessioGianelle Update configuration log file
Edit | Attach | PDF | History: r5 < r4 < r3 < r2 < r1 | Backlinks | Raw View | More topic actions...
Topic revision: r4 - 2012-03-01 - AlessioGianelle
 
  • Edit
  • Attach
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback