Summary
- Product: Storm 1.8.2
- Release Task: Task #25353
- ETICS Subsystem Configuration Name: emi-storm_R_1_8_2_1_RC
- VCS Tag: BE_1.8.2-2, common_1.1.3-1, FE_1.7.3-1 and yaim-storm_4.1.8-1
- EMI Major Release: EMI 1 (Kebnekaise)
- Platform: SL5 epel
- Author: Alessio Gianelle
- Testing report:
- Certification report:
- Outcome: CERTIFIED
Deployment tests
Clean Installation
We use two hosts, one for the FE and the other for BE, globus-gridftp and gridhttps
Upgrade Installation
We use two hosts, one for the FE and the other for BE, globus-gridftp and gridhttps
Unit Tests
???
System tests
Functionality tests
[ale@cream-12 tstorm-1.2.0-5]$ tstorm-tests
test_settings (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_storm_ping (tstorm.tests.atomics.AtomicsTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.142s
OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_ls_unexist_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_mkdir_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_mkdir_exist_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_ls_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_cp_bt (tstorm.tests.atomics.AtomicsTest) ... ok
test_ls_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_cp_at (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_unexist_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_unexist_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 13 tests in 39.912s
OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_cksm (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 3 tests in 12.469s
OK
test_dd (tstorm.tests.utilities.UtilitiesTest) ... ok
test_data_transfer_out_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_out_exist_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_in_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_data_transfer_in_unexist_file (tstorm.tests.functionalities.FunctionalitiesTest) ... ok
test_rm_file (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_dir (tstorm.tests.atomics.AtomicsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 8 tests in 33.506s
OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_voms_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms_no_auth (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_voms_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_https_voms (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 9 tests in 6.293s
OK
test_update_free_space_upon_rm (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 3.151s
OK
test_eight_digit_string_checksum (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 2.895s
OK
test_update_used_space_upon_pd (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 7.057s
OK
test_unsupported_protocols (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.062s
OK
test_non_ascii_chars (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.124s
OK
test_storm_backend_age (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.064s
OK
test_storm_database_password (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 2.666s
OK
test_storm_gridhttps_authorization_denied (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 1.606s
OK
Complete log file are
here
- Tests without voms extension
[ale@cream-12 tstorm-1.2.0-5]$ voms-proxy-init
Your identity: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
Creating proxy ....................................................... Done
Your proxy is valid until Thu Feb 9 00:00:52 2012
[ale@cream-12 tstorm-1.2.0-5]$ voms-proxy-info -all
subject : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle/CN=proxy
issuer : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
identity : /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
type : proxy
strength : 1024 bits
path : /tmp/x509up_u500
timeleft : 11:59:55
key usage : Digital Signature, Key Encipherment, Data Encipherment
[ale@cream-12 tstorm-1.2.0-5]$ tstorm-tests --novoms
test_settings (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_http_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_http (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_http_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_http (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 8 tests in 6.068s
OK
test_cr_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
test_srm_transfer_outbound_https (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_outbound_https_exist_file (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https (tstorm.tests.https.HttpsTest) ... ADD UID for test_direct_transfer_inbound_https
ok
test_direct_transfer_inbound_https_no_auth (tstorm.tests.https.HttpsTest) ... ok
test_direct_transfer_inbound_https_unexist_file (tstorm.tests.https.HttpsTest) ... ok
test_srm_transfer_inbound_https (tstorm.tests.https.HttpsTest) ... ok
test_rm_lf (tstorm.tests.utilities.UtilitiesTest) ... ok
----------------------------------------------------------------------
Ran 9 tests in 6.445s
OK
test_get_space_metadata_failure (tstorm.tests.regression.RegressionTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.106s
OK
Complete log file are
here
Run on the BE host
[root@cream-51 tstorm-1.2.0-5]# tstorm-sanity-tests
test_glue_service (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.002s
OK
test_gluetwo_storage_share_capacity (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.002s
OK
test_glue_available_space_info_service (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.112s
OK
test_glue_available_space (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.157s
OK
test_glue_used_space (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.090s
OK
test_size (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.101s
OK
test_info_service_failure (tstorm.tests.deployment.regression.ldapquery.LdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.041s
OK
test_gluetwo_endpoint_undefined (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_gluetwo_storage_undefined (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_gluetwo_endpoint (tstorm.tests.deployment.regression.gluetwo_ldapquery.GluetwoLdapTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.001s
OK
test_backend_server_status (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.216s
OK
test_backend_logrotate_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.007s
OK
test_backend_gridhttps (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.225s
OK
test_yaim_version_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.491s
OK
test_size_in_namespace_file (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.016s
OK
test_gridhttps_plugin_links (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.024s
OK
test_backend_server_name_status (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.234s
OK
test_mysql_storage_space_update (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 111.748s
OK
test_mysql_connector_java_links (tstorm.tests.deployment.regression.service_configuration.RegressionConfigurationTest) ... ok
----------------------------------------------------------------------
Ran 1 test in 0.017s
OK
Complete log file are
here
Regression tests
Verification attached bugs (which are not part of the automatic tests)
[root@cream-51 ~]# dd if=/dev/zero of=big_file.txt bs=53477376 count=1
1+0 records in
1+0 records out
53477376 bytes (53 MB) copied, 0.103273 seconds, 518 MB/s
[root@cream-51 ~]# ls -lh big_file.txt
-rw-r--r-- 1 root root 51M Feb 8 13:59 big_file.txt
[root@cream-51 ~]# cat big_file.txt >> /var/log/storm/storm-backend.stderr
[root@cream-51 ~]# cat big_file.txt >> /var/log/storm/storm-backend.stdout
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 52M Feb 8 14:00 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52M Feb 8 14:00 /var/log/storm/storm-backend.stdout
[root@cream-51 ~]# vi /etc/crontab
[root@cream-51 ~]# service crond restart
Stopping crond: [ OK ]
Starting crond: [ OK ]
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 0 Feb 8 14:03 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52K Feb 8 14:03 /var/log/storm/storm-backend.stderr-20120208.gz
-rw------- 1 storm storm 0 Feb 8 14:03 /var/log/storm/storm-backend.stdout
-rw------- 1 storm storm 55K Feb 8 14:03 /var/log/storm/storm-backend.stdout-20120208.gz
[root@cream-51 ~]# /etc/init.d/storm-backend-server restart
Stopping storm-backend-server [ OK ]
Bootstrapping storm-backend-server [ OK ]
Starting storm-backend-server [ OK ]
[root@cream-51 ~]# ls -lh /var/log/storm/storm-backend.std*
-rw------- 1 storm storm 0 Feb 8 14:03 /var/log/storm/storm-backend.stderr
-rw------- 1 storm storm 52K Feb 8 14:03 /var/log/storm/storm-backend.stderr-20120208.gz
-rw------- 1 storm storm 15K Feb 8 14:03 /var/log/storm/storm-backend.stdout
-rw------- 1 storm storm 55K Feb 8 14:03 /var/log/storm/storm-backend.stdout-20120208.gz
[root@cert-18 ~]# dd if=/dev/zero of=big_file.txt bs=53477376 count=1
1+0 records in
1+0 records out
53477376 bytes (53 MB) copied, 0.231383 seconds, 231 MB/s
[root@cert-18 ~]# ls -lh big_file.txt
-rw-r--r-- 1 root root 51M Feb 8 13:44 big_file.txt
[root@cert-18 ~]# cat big_file.txt >> /var/log/storm/storm-frontend-server.log
[root@cert-18 ~]#
[root@cert-18 ~]# ls -lh /var/log/storm/
total 53M
-rw-r--r-- 1 storm storm 52M Feb 8 13:45 storm-frontend-server.log
[root@cert-18 ~]# vi /etc/crontab
[root@cert-18 ~]# /etc/init.d/crond restart
Stopping crond: [ OK ]
Starting crond: [ OK ]
[root@cert-18 ~]# ls -lh /var/log/storm/
total 116K
-rw-r--r-- 1 storm storm 0 Feb 8 13:52 storm-frontend-server.log
-rw-r--r-- 1 storm storm 112K Feb 8 13:52 storm-frontend-server.log-20120208.gz
[ale@cream-12 tstorm-1.2.0-5]$ /opt/d-cache/srm/bin/srmping -2 srm://cert-18.pd.infn.it:8444/
VersionInfo : v2.2
backend_type:StoRM
backend_version:<FE:1.7.3-1><BE:1.8.2-2>
backend_os_distribution:Scientific Linux SL release 5.7 (Boron)
[root@cert-18 ~]# tail -f /var/log/storm/storm-frontend-server.log
02/08 13:52:54 0x1eef16c0 main: AUDIT - Active tasks: 0
02/08 13:52:54 0x1eef16c0 main: AUDIT - Pending tasks: 1
02/08 13:52:55 0x1ef61b70 Ping: Received Ping request from: /C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
02/08 13:52:55 0x1ef61b70 Ping: UserDN=/C=IT/O=INFN/OU=Personal Certificate/L=Padova/CN=Alessio Gianelle
02/08 13:52:55 0x1ef61b70 Ping: Client IP=::ffff:193.206.210.167
02/08 13:52:55 0x1ef61b70 Ping: Number of FQANs: 1
02/08 13:52:55 0x1ef61b70 Ping: Request done.
[root@cream-51 ~]# vi /etc/storm/backend-server/storm.properties
[root@cream-51 ~]# service storm-backend-server restart
Stopping storm-backend-server [ OK ]
Bootstrapping storm-backend-server [ OK ]
Starting storm-backend-server [ OK ]
[root@cream-51 ~]# service mysqld stop
Stopping MySQL: [ OK ]
[ale@cream-12 tstorm-1.2.0-5]$ srmls srm://cert-18.pd.infn.it:8444/srm/managerv2?SFN=/testers.eu-emi.eu/a1328612878.0/b1328612878.0/tstorm-output-file-1328612870.0.txt
1048576 /testers.eu-emi.eu/a1328612878.0/b1328612878.0/tstorm-output-file-1328612870.0.txt
[root@cream-51 ~]# tail -f /var/log/storm/storm-backend.log
15:10:13.091 - ERROR [XML-RPC-0] - PtP CHUNK DAO: numberInSRM_SPACE_AVAILABLE - unable to get a valid connection!
15:10:13.092 - INFO [XML-RPC-0] - srmLs: <Grid User (VOMS) = DN:'C=IT, O=INFN, OU=Personal Certificate, L=Padova, CN=Alessio Gianelle' FQANS:[/testers.eu-emi.eu/Role=NULL/Capability=NULL]> Request for [SURL:'srm://cert-18.pd.infn.it:8444/srm/managerv2?SFN=/testers.eu-emi.eu/a1328612878.0/b1328612878.0/tstorm-output-file-1328612870.0.txt'] successfully done with [status:SRM_SUCCESS: All requests successfully completed]
15:10:13.961 - ERROR [Timer-5] - REQUEST SUMMARY DAO! Exception in setUpConnection! com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
[root@cream-51 ~]# service storm-backend-server restart
Stopping storm-backend-server [ OK ]
Bootstrapping storm-backend-server [ OK ]
Starting storm-backend-server [ OK ]
[root@cream-51 ~]# service storm-backend-server restart
Stopping storm-backend-server [ OK ]
Bootstrapping storm-backend-server [ OK ]
Starting storm-backend-server [ OK ]