Difference: Cream_blah_testsuites (1 vs. 9)

Revision 92013-01-31 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

CREAM regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 114 to 114
  voms-proxy-init -voms
Added:
>
>
  • Set database access permissions runing on CE:
        mysql -h $CE_HOST -u root --password="$MYSQL_PASSWORD"  -e "GRANT ALL PRIVILEGES to $CREAMDB_USER@'<FQDN_UI_HOST>' IDENTIFIED BY '$CREAMDB_PASSWORD' WITH GRANT OPTION";
        
 
  • Caveats:
    • lauch the testsuites in a shell where you run previously /opt/cream_blah_testsuites/testsuite_env.sh and set PYTHONPATH
    • lauch the testsuites in a shell where you have write permissions: robot fremework tryes to write log files in the path where it is launched and it fails if it is unable to create its logs.

Revision 82012-11-14 - CristinaAiftimiei

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"
Changed:
<
<

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

>
>

CREAM regression, BLAH functionality and regression testsuites installation, configuration and use

 
Line: 17 to 17
  When the UI is running, be sure that the environment variable X509_USER_PROXY is set to your proxy path (something like /tmp/x509up_u0). If not, set it.
Changed:
<
<
cream_blah_testsuites depend from cream_test testsuite. Second step:
>
>
cream_blah_testsuite depends on cream_test testsuite. Second step:
 
  • install cream_test testsuite.

cream_test testsuite installation, configuration and use instructions are available here.

Line: 26 to 26
 Repository Not Available now.

Install cream_blah_testsuite

Changed:
<
<
Get the last cream_blah_testsuites rpm availablehere and install it with:
>
>
Get the lastest cream_blah_testsuites rpm available here and install it with:
 
yum install cream_blah_testsuites-X.Y-Z.noarch.rpm 
Line: 34 to 34
 Note: EMI UI and cream_test must be already installed to be able to install cream_blah_testsuites.

Set SSH keys authentication

Changed:
<
<
Since cream_test 1.8 it is provided a script to semi-automate the process, check in cream_test installation and documentation.
>
>
Since cream_test v. 1.8 it is provided a script to semi-automate the process - please check in cream_test installation and documentation for more details.
  Tha manual procedure is the standard procedure to grant ssh key access in linux:
Line: 68 to 68
  my-ce ~ # rm id_rsa.pub
Changed:
<
<
  • Test if the setup is correct. You must be able to copy or to connect to the CREAM CE from the EMI UI without supplying passwd:
>
>
  • Test if the setup is correct. You must be able to copy or to connect to the CREAM CE from the EMI UI without supplying passwd.
  Note:

Revision 72012-11-12 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 45 to 45
 
  • Now you need to copy the public key to the CREAM CE to be tested (do NOT copy the private key), obviously use scp to do this

Changed:
<
<
my-ui:~# scp ~/.ssh/id_rsa.pub my-ce:~
>
>
my-ui:~# scp ~/.ssh/id_rsa.pub root@my-ce:~
 

  • Connect to the CREAM CE (my-ce):
Line: 80 to 80
  If you change sshd_config file with these values you need to restart ssh daemon (/etc/init.d/sshd restart)
Added:
>
>
Note: Thanks to Andrea Benini Ben for this page
 

Configure cream functionality testsuite

Edit and customize

Revision 62012-11-07 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 23 to 23
 cream_test testsuite installation, configuration and use instructions are available here.

Set italiangrid repository

Added:
>
>
Repository Not Available now.
 

Install cream_blah_testsuite

Added:
>
>
Get the last cream_blah_testsuites rpm availablehere and install it with:
yum install cream_blah_testsuites-X.Y-Z.noarch.rpm 
 
Changed:
<
<

cream_blah_testsuite configuration

>
>
Note: EMI UI and cream_test must be already installed to be able to install cream_blah_testsuites.
 

Set SSH keys authentication

Added:
>
>
Since cream_test 1.8 it is provided a script to semi-automate the process, check in cream_test installation and documentation.

Tha manual procedure is the standard procedure to grant ssh key access in linux:

  • From EMI UI where testsuites are installed create an ssh rsa key pair for host validation, here's how:
         my-ui:~# ssh-keygen -t rsa
       

  • Now you need to copy the public key to the CREAM CE to be tested (do NOT copy the private key), obviously use scp to do this
         my-ui:~# scp ~/.ssh/id_rsa.pub my-ce:~
       

  • Connect to the CREAM CE (my-ce):
         my-ui:~# ssh root@my-ce
       

  • Check out .ssh stuff, if .ssh dir doesn't exist you need to create it
         my-ce ~ # ls -la ~/.ssh
         ls: cannot access /root/.ssh: No such file or directory
         my-ce ~ # mkdir .ssh
         my-ce ~ # chmod 700 .ssh
       

  • Now copy your ssh public key into authorized keys file and delete it when finished:
         my-ce ~ # cat ~/id_rsa.pub >> .ssh/authorized_keys
         my-ce ~ # chmod 600 .ssh/authorized_keys
         my-ce ~ # rm id_rsa.pub
       

  • Test if the setup is correct. You must be able to copy or to connect to the CREAM CE from the EMI UI without supplying passwd:

Note:

Sometimes additional configurations are requested on remote ssh daemon, this may vary from basic security configuration. If final test failed you probably have PublicAuthentication or RSA disabled. In this case you need to change them (it doesn't affect or lower your current security). Tipically this change is done by editing /etc/ssh/sshd_config file or better (for security) the user-specific ~/.ssh/config. To get the correct configuration, see that the following attributes are set (not commented or set to "no") in your sshd_config or ~/.ssh/config file RSAAuthentication yes PubkeyAuthentication yes

If you change sshd_config file with these values you need to restart ssh daemon (/etc/init.d/sshd restart)

 

Configure cream functionality testsuite

Added:
>
>
Edit and customize
/opt/cream_test/lib/vars.py
 

Configure cream_blah_testsuites

Changed:
<
<
  • Create (as root user) the cream_blah testsuites configuration file:
>
>
  • Create the cream_blah testsuites configuration file:
 
     cp /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini.template /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini
   
Line: 109 to 163
  pybot /opt/cream_blah_testsuites/testsuites/cream_regression/tests/bug_*.html
Changed:
<
<

>
>

Versions compatibility

  • cream_blah_testsuite-0.1-0 is tested with cream_test-1.8.el5-1 and python 2.6
  -- SaraBertocco - 2012-10-12

Revision 52012-11-07 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 7 to 7
 

cream_blah_testsuite installation

Prerequisite: cream_testing (i.e. cream functionality testsuite) installed

Changed:
<
<
  • All cream and blah testsuites (functionality and regression) work "over" a EMI User Interface, so for first install it, create your user, install your user certificates and test your EMI UI with a simple job submission. EMI UI installation and configuration instructions are available here.
>
>
All cream and blah testsuites (functionality and regression) work "over" a EMI User Interface. First step:
  • install a emi user interface
  • create your user
  • install your user certificate
  • test your EMI UI with a simple job submission.

EMI UI installation and configuration instructions are available here.

 When the UI is running, be sure that the environment variable X509_USER_PROXY is set to your proxy path (something like /tmp/x509up_u0). If not, set it.
Changed:
<
<
  • cream_blah_testsuites depend from cream_test testsuite, whose installation, configuration and use instructions are available here.
>
>
cream_blah_testsuites depend from cream_test testsuite. Second step:
  • install cream_test testsuite.

cream_test testsuite installation, configuration and use instructions are available here.

 

Set italiangrid repository

Line: 41 to 52
 

Testsuite run

Changed:
<
<
Caveats:
>
>
A generic description on how to run tests in cream testsuites is available here.

  • At first create a user proxy:
        voms-proxy-init -voms <VO>
        

  • Caveats:
  * lauch the testsuites in a shell where you run previously /opt/cream_blah_testsuites/testsuite_env.sh and set PYTHONPATH * lauch the testsuites in a shell where you have write permissions: robot fremework tryes to write log files in the path where it is launched and it fails if it is unable to create its logs.

Run BLAH testsuites

Changed:
<
<
A generic description on how to run tests in cream testsuites is available here.
>
>
 
  • Run BLAH functionality testsuite:
Line: 90 to 108
 
   pybot  /opt/cream_blah_testsuites/testsuites/cream_regression/tests/bug_*.html
Changed:
<
<
  • Run CREAM regression tests for a specific release, ex. cream 1.14
   pybot -i cream_1.14 /opt/cream_blah_testsuites/testsuites/cream_regression/tests/bug_*.html
>
>
 

Revision 42012-11-05 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 41 to 41
 

Testsuite run

Added:
>
>
Caveats: * lauch the testsuites in a shell where you run previously /opt/cream_blah_testsuites/testsuite_env.sh and set PYTHONPATH * lauch the testsuites in a shell where you have write permissions: robot fremework tryes to write log files in the path where it is launched and it fails if it is unable to create its logs.
 
Added:
>
>

Run BLAH testsuites

 A generic description on how to run tests in cream testsuites is available here.

  • Run BLAH functionality testsuite:
Line: 54 to 58
  pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_cancelled_jobs.html pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_suspended_resumed_jobs.html
Added:
>
>
  • Run BLAH regression tests for cream configured with old blparser
   pybot -i old_parser /opt/cream_blah_testsuites/testsuites/blah_regression/tests/bug_*.html
  • Run all BLAH regression tests for cream configured with new blparser
   pybot -i new_parser /opt/cream_blah_testsuites/testsuites/blah_regression/tests/bug_*.html
  • Run BLAH regression tests for a specific release, ex. blah 1.18.0
   pybot -i blah_1.18.0 /opt/cream_blah_testsuites/testsuites/blah_regression/tests/bug_*.html
  • To switch from old to new blparser you have to:
    • Go to the cream ce, set
      BLPARSER_WITH_UPDATER_NOTIFIER=true
      in
      <site_info_dir>/services/glite-creamce
      and reconfigure using yaim.
    • In file /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini set in section [blah_specific]:
              parser_type = with_updater_notifier
              parser_log_file = /var/log/cream/glite-ce-bnotifier.log
              
  • To switch from new to old blparser you have to:
    • Go to the cream ce, set
      BLPARSER_WITH_UPDATER_NOTIFIER=false
      in
      <site_info_dir>/services/glite-creamce
      and reconfigure using yaim.
    • In file /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini set in section [blah_specific]:
              parser_type = with_blparser_only
              parser_log_file = /var/log/cream/glite-lsfparser.log
              

Run CREAM regression testsuite

  • Run all CREAM regression tests
   pybot  /opt/cream_blah_testsuites/testsuites/cream_regression/tests/bug_*.html
  • Run CREAM regression tests for a specific release, ex. cream 1.14
   pybot -i cream_1.14 /opt/cream_blah_testsuites/testsuites/cream_regression/tests/bug_*.html

 
Deleted:
<
<
Remember: to switch from new to old blparser or vice versa you have to do two things:
 
Deleted:
<
<
Caveats:
  • lauch the testsuites in a shell where you have write permissions: robot fremework tryes to write log files in the path where it is launched and it fails if it is unable to create its logs.
 

Revision 32012-10-15 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 8 to 8
 

Prerequisite: cream_testing (i.e. cream functionality testsuite) installed

  • All cream and blah testsuites (functionality and regression) work "over" a EMI User Interface, so for first install it, create your user, install your user certificates and test your EMI UI with a simple job submission. EMI UI installation and configuration instructions are available here.
Added:
>
>
When the UI is running, be sure that the environment variable X509_USER_PROXY is set to your proxy path (something like /tmp/x509up_u0). If not, set it.
 
  • cream_blah_testsuites depend from cream_test testsuite, whose installation, configuration and use instructions are available here.

Set italiangrid repository

Line: 21 to 22
 

Configure cream functionality testsuite

Configure cream_blah_testsuites

Added:
>
>
  • Create (as root user) the cream_blah testsuites configuration file:
         cp /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini.template /opt/cream_blah_testsuites/lib/conf/cream_testsuite_conf.ini
       
    and customize it. Be careful:
    • Set the right middleware version installed in the ce under test
    • Set the right path of the yaim configuration files (site-info-path) and be sure they are editable
    • Check the blah_parser parameter value. It must be adequate to the blparser version (old or new) and batch system
  • In the user shell you will use to launch tests source the file: /opt/cream_blah_testsuites/testsuite_env.sh
         source /opt/cream_blah_testsuites/testsuite_env.sh 
       
    It will setup the environment needed to run the testsuites.
  • Set python4 pythonpath doing:
       export PYTHONPATH=/usr/lib/python2.4/site-packages:$PYTHONPATH
       
 

Testsuite run

Added:
>
>
A generic description on how to run tests in cream testsuites is available here.

  • Run BLAH functionality testsuite:
   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests
  • Run BLAH functionality tests one by one:
   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_normally_finished_jobs.html
   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_cancelled_jobs.html
   pybot /opt/cream_blah_testsuites/testsuites/blah_testing/tests/check_notifications_for_suspended_resumed_jobs.html

Remember: to switch from new to old blparser or vice versa you have to do two things:

Caveats:

  • lauch the testsuites in a shell where you have write permissions: robot fremework tryes to write log files in the path where it is launched and it fails if it is unable to create its logs.
 

Revision 22012-10-15 - SaraBertocco

Line: 1 to 1
 
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

Line: 7 to 7
 

cream_blah_testsuite installation

Prerequisite: cream_testing (i.e. cream functionality testsuite) installed

Changed:
<
<
cream_blah_testsuites depend from cream_test testsuite, whose installation, configuration and use instructions are available here
>
>
  • All cream and blah testsuites (functionality and regression) work "over" a EMI User Interface, so for first install it, create your user, install your user certificates and test your EMI UI with a simple job submission. EMI UI installation and configuration instructions are available here.
  • cream_blah_testsuites depend from cream_test testsuite, whose installation, configuration and use instructions are available here.
 

Set italiangrid repository

Revision 12012-10-12 - SaraBertocco

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="TestingCreamDgas"

Cream regression, BLAH functionality and regression testsuites installation, configuration and use

cream_blah_testsuite installation

Prerequisite: cream_testing (i.e. cream functionality testsuite) installed

cream_blah_testsuites depend from cream_test testsuite, whose installation, configuration and use instructions are available here

Set italiangrid repository

Install cream_blah_testsuite

cream_blah_testsuite configuration

Set SSH keys authentication

Configure cream functionality testsuite

Configure cream_blah_testsuites

Testsuite run

-- SaraBertocco - 2012-10-12

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback