Summary
- Product: Storm 1.8.2
- Release Task: Task #25353
- ETICS Subsystem Configuration Name: emi-storm_R_1_8_2_1_RC
- VCS Tag: BE_1.8.2-2, common_1.1.3-1, FE_1.7.3-1 and yaim-storm_4.1.8-1
- EMI Major Release: EMI 1 (Kebnekaise)
- Platform: SL5 epel
- Author: Alessio Gianelle
- Testing report:
- Certification report:
- Outcome: On going...
Deployment tests
Clean Installation
We use two hosts, one for the FE and the other for BE, globus-gridftp and gridhttps
Upgrade Installation
TBD
Unit Tests
???
System tests
Functionality tests
[ale@cream-12 tstorm-1.2.0-5]$ tstorm-tests
test_settings (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_storm_ping (tstorm.tests.atomics.AtomicsTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.142s
OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_ls_unexist_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_mkdir_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_mkdir_exist_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_ls_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_cp_bt (tstorm.tests.atomics.AtomicsTest) ... ok
test_ls_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_cp_at (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_unexist_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_unexist_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 13 tests in 39.912s
OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_cksm (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 3 tests in 12.469s
OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_data_transfer_out_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_out_exist_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_in_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_in_unexist_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_rm_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 8 tests in 33.506s
OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_voms_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms_no_auth (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 9 tests in 6.293s
OK
test_update_free_space_upon_rm (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 3.151s
OK
test_eight_digit_string_checksum (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 2.895s
OK
test_update_used_space_upon_pd (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 7.057s
OK
test_unsupported_protocols (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.062s
OK
test_non_ascii_chars (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.124s
OK
test_storm_backend_age (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.064s
OK
test_storm_database_password (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 2.666s
OK
test_storm_gridhttps_authorization_denied (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 1.606s
OK
Complete log file are
here
- Tests without voms extension
[ale@cream-12 tstorm-1.2.0-5]$ voms-proxy-init
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
Creating proxy ....................................................... Done
Your proxy is valid until Thu Feb 9 00:00:52 2012
[ale@cream-12 tstorm-1.2.0-5]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type : proxy
strength : 1024 bits
path : /tmp/x509up_u500
timeleft : 11:59:55
key usage : Digital Signature, Key Encipherment, Data Encipherment
[ale@cream-12 tstorm-1.2.0-5]$ tstorm-tests --novoms
test_settings (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_http_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_http_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_http (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 8 tests in 6.068s
OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_https (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https (tstorm.tests.https.HttpsTest) ... ADD UID for test_direct_transfer_inbound_https
ok
test_direct_transfer_inbound_https_no_auth (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_https (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 9 tests in 6.445s
OK
test_get_space_metadata_failure (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.106s
OK
Complete log file are
here
Run on the BE host
[root@cream-51 tstorm-1.2.0-5]# tstorm-sanity-tests
test_glue_service (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.002s
OK
test_gluetwo_storage_share_capacity (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.002s
OK
test_glue_available_space_info_service (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.112s
OK
test_glue_available_space (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.157s
OK
test_glue_used_space (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.090s
OK
test_size (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.101s
OK
test_info_service_failure (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.041s
OK
test_gluetwo_endpoint_undefined (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_gluetwo_storage_undefined (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_gluetwo_endpoint (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_backend_server_status (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.216s
OK
test_backend_logrotate_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.007s
OK
test_backend_gridhttps (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.225s
OK
test_yaim_version_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.491s
OK
test_size_in_namespace_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.016s
OK
test_gridhttps_plugin_links (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.024s
OK
test_backend_server_name_status (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.234s
OK
test_mysql_storage_space_update (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 111.748s
OK
test_mysql_connector_java_links (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.017s
OK
Complete log file are
here
Regression tests
Verification attached bugs (which are not part of the automatic tests)
[root@cream-51 ~]# dd if=/dev/zero of=big_file.txt bs=53477376 count=1
1+0 records in
1+0 records out
53477376 bytes (53 MB) copied, 0.103273 seconds, 518 MB/s
[root@cream-51 ~]# ls -lh big_file.txt
-rw-r--r-- 1 root root 51M Feb 8 13:59 big_file.txt
[root@cream-51 ~]# cat big_file.txt >> /var/log/storm/storm-backend.stderr
[root@cream-51 ~]# cat big_file.txt >> /var/log/storm/storm-backend.stdout
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 52M Feb 8 14:00 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52M Feb 8 14:00 /var/log/storm/storm-backend.stdout
[root@cream-51 ~]# vi /etc/crontab
[root@cream-51 ~]# service crond restart
Stopping crond: [ OK ]
Starting crond: [ OK ]
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 0 Feb 8 14:03 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52K Feb 8 14:03 /var/log/storm/storm-backend.stderr-20120208.gz
-rw------- 1 storm storm 0 Feb 8 14:03 /var/log/storm/storm-backend.stdout
-rw------- 1 storm storm 55K Feb 8 14:03 /var/log/storm/storm-backend.stdout-20120208.gz
[root@cream-51 ~]# /etc/init.d/storm-backend-server restart
Stopping storm-backend-server [ OK ]
Bootstrapping storm-backend-server [ OK ]
Starting storm-backend-server [ OK ]
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 0 Feb 8 14:03 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52K Feb 8 14:03 /var/log/storm/storm-backend.stderr-20120208.gz
-rw------- 1 storm storm 15K Feb 8 14:03 /var/log/storm/storm-backend.stdout
-rw------- 1 storm storm 55K Feb 8 14:03 /var/log/storm/storm-backend.stdout-20120208.gz
[root@cert-18 ~]# dd if=/dev/zero of=big_file.txt bs=53477376 count=1
1+0 records in
1+0 records out
53477376 bytes (53 MB) copied, 0.231383 seconds, 231 MB/s
[root@cert-18 ~]# ls -lh big_file.txt
-rw-r--r-- 1 root root 51M Feb 8 13:44 big_file.txt
[root@cert-18 ~]# cat big_file.txt >> /var/log/storm/storm-frontend-server.log
[root@cert-18 ~]#
[root@cert-18 ~]# ls -lh /var/log/storm/
total 53M
-rw-r--r-- 1 storm storm 52M Feb 8 13:45 storm-frontend-server.log
[root@cert-18 ~]# vi /etc/crontab
[root@cert-18 ~]# /etc/init.d/crond restart
Stopping crond: [ OK ]
Starting crond: [ OK ]
[root@cert-18 ~]# ls -lh /var/log/storm/
total 116K
-rw-r--r-- 1 storm storm 0 Feb 8 13:52 storm-frontend-server.log
-rw-r--r-- 1 storm storm 112K Feb 8 13:52 storm-frontend-server.log-20120208.gz
[ale@cream-12 tstorm-1.2.0-5]$ /opt/d-cache/srm/bin/srmping -2 srm://cert-18.pd.infn.it:8444/
VersionInfo : v2.2
backend_type:StoRM
backend_version:<FE:1.7.3-1><BE:1.8.2-2>
backend_os_distribution:Scientific Linux SL release 5.7 (Boron)
[root@cert-18 ~]# tail -f /var/log/storm/storm-frontend-server.log
02/08 13:52:54 0x1eef16c0 main: AUDIT - Active tasks: 0
02/08 13:52:54 0x1eef16c0 main: AUDIT - Pending tasks: 1
02/08 13:52:55 0x1ef61b70 Ping: Received Ping request from: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
02/08 13:52:55 0x1ef61b70 Ping: UserDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
02/08 13:52:55 0x1ef61b70 Ping: Client IP=::ffff:193.206.210.167
02/08 13:52:55 0x1ef61b70 Ping: Number of FQANs: 1
02/08 13:52:55 0x1ef61b70 Ping: Request done.