Cream regression, BLAH functionality and regression testsuites installation, configuration and use

cream_blah_testsuite installation

Prerequisite: cream_testing (i.e. cream functionality testsuite) installed

All cream and blah testsuites (functionality and regression) work "over" a EMI User Interface. First step:

• install a emi user interface
• create your user
• install your user certificate
• test your EMI UI with a simple job submission.

EMI UI installation and configuration instructions are available here.

When the UI is running, be sure that the environment variable X509_USER_PROXY is set to your proxy path (something like /tmp/x509up_u0). If not, set it.

cream_blah_testsuites depend from cream_test testsuite. Second step:

• install cream_test testsuite.

cream_test testsuite installation, configuration and use instructions are available here.

Set italiangrid repository

Install cream_blah_testsuite

cream_blah_testsuite configuration

Set SSH keys authentication

Configure cream functionality testsuite

Configure cream_blah_testsuites

• Create (as root user) the cream_blah testsuites configuration file:

       cp /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini.template /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini
     

  and customize it. Be careful:
  • Set the right middleware version installed in the ce under test
  • Set the right path of the yaim configuration files (site-info-path) and be sure they are editable
  • Check the blah_parser parameter value. It must be adequate to the blparser version (old or new) and batch system
• In the user shell you will use to launch tests source the file: /opt/cream_blah_testsuites/testsuite_env.sh

       source /opt/cream_blah_testsuites/testsuite_env.sh 
     

  It will setup the environment needed to run the testsuites.
• Set python4 pythonpath doing:

     export PYTHONPATH=/usr/lib/python2.4/site-packages:$PYTHONPATH
     

Testsuite run

A generic description on how to run tests in cream testsuites is available here.

• At first create a user proxy:

      voms-proxy-init -voms <VO>
      

• Caveats:
  • lauch the testsuites in a shell where you run previously /opt/cream_blah_testsuites/testsuite_env.sh and set PYTHONPATH
  • lauch the testsuites in a shell where you have write permissions: robot fremework tryes to write log files in the path where it is launched and it fails if it is unable to create its logs.

Run BLAH testsuites

• Run BLAH functionality testsuite:

   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests

• Run BLAH functionality tests one by one:

   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_normally_finished_jobs.html
   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_cancelled_jobs.html
   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_suspended_resumed_jobs.html

• Run BLAH regression tests for cream configured with old blparser

   pybot -i old_parser /opt/cream_blah_testsuites/testsuites/blah_regression/tests/bug_*.html

• Run all BLAH regression tests for cream configured with new blparser

   pybot -i new_parser /opt/cream_blah_testsuites/testsuites/blah_regression/tests/bug_*.html

• Run BLAH regression tests for a specific release, ex. blah 1.18.0

   pybot -i blah_1.18.0 /opt/cream_blah_testsuites/testsuites/blah_regression/tests/bug_*.html

• To switch from old to new blparser you have to:
  • Go to the cream ce, set

    BLPARSER_WITH_UPDATER_NOTIFIER=true

    in

    <site_info_dir>/services/glite-creamce

    and reconfigure using yaim.
  • In file /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini set in section [blah_specific]:

            parser_type = with_updater_notifier
            parser_log_file = /var/log/cream/glite-ce-bnotifier.log
            

• To switch from new to old blparser you have to:
  • Go to the cream ce, set

    BLPARSER_WITH_UPDATER_NOTIFIER=false

    in

    <site_info_dir>/services/glite-creamce

    and reconfigure using yaim.
  • In file /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini set in section [blah_specific]:

            parser_type = with_blparser_only
            parser_log_file = /var/log/cream/glite-lsfparser.log
            

Run CREAM regression testsuite

• Run all CREAM regression tests

   pybot  /opt/cream_blah_testsuites/testsuites/cream_regression/tests/bug_*.html

-- SaraBertocco - 2012-10-12