Tutorial StoRM

Pre-requisite checks

  • Verify the ntpd service
    ]# service ntpd status
    ntpd (pid  1713) is running...
    ]# chkconfig --list | grep ntpd
    ntpd            0:off   1:off   2:on    3:on    4:on    5:on    6:off
     

  • Verify the hostname output (Fully Qualified Domain Name (FQAN))
    ]# hostname -f
    tutor-storm.cnaf.infn.it
    ]# cat /etc/hosts
    # Do not remove the following line, or various programs
    # that require network functionality will fail.
    127.0.0.1               localhost.localdomain localhost
    ::1             localhost6.localdomain6 localhost6
    131.154.100.145         tutor-storm.cnaf.infn.it tutor-storm
     
    • In the case the hosts file does not contain the last line, please modify the file and restart network service (Foundamental check for having a gridftp service running properly)
  • Verify host file certificates on the StoRM node
    ]# ll /etc/grid-security/
    total 60
    drwxr-xr-x 2 root root 49152 Sep 25 13:07 certificates
    -rw-r--r-- 1 root root  1452 Oct  2 17:42 hostcert.pem
    -r-------- 1 root root   891 Oct  2 17:42 hostkey.pem
     
    • hostcert.pem must have permission 0644. If no, please change it
      ]# chmod 0644 hostcert.pem
       
    • hostkey.pem must have permission 0400. If no, please change it
      ]# chmod 0400 hostkey.pem
       
  • Verify acl support. StoRM uses the ACLs on files and directory to implement the security model by using the native access to the file system.
    • Verify acl CLIs
      ]# rpm -qa | grep acl
      ]# yum install acl
      Loaded plugins: downloadonly, kernel-module, priorities, protect-packages,
                   : protectbase, security, verify, versionlock
      521 packages excluded due to repository priority protections 
      0 packages excluded due to repository protections
      Reading version lock configuration
      Setting up Install Process
      Resolving Dependencies
      --> Running transaction check
      ---> Package acl.x86_64 0:2.2.39-8.el5 set to be updated
      --> Finished Dependency Resolution
      Beginning Kernel Module Plugin
      Finished Kernel Module Plugin
      
      Dependencies Resolved
      
      ================================================================================
       Package        Arch              Version                 Repository       Size
      ================================================================================
      Installing:
       acl            x86_64            2.2.39-8.el5            sl5x             69 k
      
      Transaction Summary
      ================================================================================
      Install       1 Package(s)
      Upgrade       0 Package(s)
      
      Total download size: 69 k
      Is this ok [y/N]: y
      Downloading Packages:
      acl-2.2.39-8.el5.x86_64.rpm                              |  69 kB     00:00
      Running rpm_check_debug
      Running Transaction Test
      Finished Transaction Test
      Transaction Test Succeeded
      Running Transaction
        Installing     : acl                                                      1/1
      
      Installed:
        acl.x86_64 0:2.2.39-8.el5
      
      Complete!
       
    • Verify extended ACL support by using the root user
      ]# echo test > testfile
      ]# setfacl -m u:root:rw testfile
      ]# getfacl  testfile
      # file: testfile
      # owner: root
      # group: root
      user::rw-
      user:root:rw
      group::r--
      mask::rw-
      other::r--
      ]# rm -rf testfile
       
  • Verify attr support. StoRM uses the extended attributes on files to store some metadata related to the file (e.g., checksum)
    • Verify attr CLIs
      ]# rpm -qa | grep attr
      ]# yum install attr
      Loaded plugins: downloadonly, kernel-module, priorities, protect-packages,
                    : protectbase, security, verify, versionlock
      521 packages excluded due to repository priority protections
      0 packages excluded due to repository protections
      Reading version lock configuration
      Setting up Install Process
      Resolving Dependencies
      --> Running transaction check
      ---> Package attr.x86_64 0:2.4.32-1.1 set to be updated
      --> Finished Dependency Resolution
      Beginning Kernel Module Plugin
      Finished Kernel Module Plugin
      
      Dependencies Resolved
      
      ================================================================================
       Package         Arch              Version                Repository       Size
      ================================================================================
      Installing:
       attr            x86_64            2.4.32-1.1             sl5x             52 k
      
      Transaction Summary
      ================================================================================
      Install       1 Package(s)
      Upgrade       0 Package(s)
      
      Total download size: 52 k
      Is this ok [y/N]: y
      Downloading Packages:
      attr-2.4.32-1.1.x86_64.rpm                               |  52 kB     00:00
      Running rpm_check_debug
      Running Transaction Test
      Finished Transaction Test
      Transaction Test Succeeded
      Running Transaction
        Installing     : attr                                                     1/1
      
      Installed:
        attr.x86_64 0:2.4.32-1.1
      
      Complete!
       
    • Verify extended attribute support by using
      ]# touch testfile
      ]# setfattr -n user.test -v test testfile
      ]# getfattr -d testfile
      # file: testfile
      user.test="test"
      ]# rm testfile
       

  • Satisfy common repository settings
    ]# rpm -qa | grep epel
    epel-release-5-4
     

  • Satisfy EMI repository settings
    ]# mkdir localrpm
    ]# cd localrpm
    ]# wget http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
    --2012-10-02 18:46:32--  http://emisoft.web.cern.ch/emisoft/dist/EMI/2/sl5/x86_64/base/emi-release-2.0.0-1.sl5.noarch.rpm
    Resolving emisoft.web.cern.ch... 137.138.139.27
    Connecting to emisoft.web.cern.ch|137.138.139.27|:80... connected.
    HTTP request sent, awaiting response... 200 OK
    Length: 5189 (5.1K) [application/x-rpm]
    Saving to: `emi-release-2.0.0-1.sl5.noarch.rpm'
    
    100%[======================================>] 5,189       --.-K/s   in 0s
    
    2012-10-02 18:46:32 (353 MB/s) - `emi-release-2.0.0-1.sl5.noarch.rpm' saved [5189/5189]
    ]# yum localinstall --nogpgcheck emi-release-2.0.0-1.sl5.noarch.rpm
    Loaded plugins: downloadonly, kernel-module, priorities, protect-packages,
                  : protectbase, security, verify, versionlock
    Setting up Local Package Process
    Examining emi-release-2.0.0-1.sl5.noarch.rpm: emi-release-2.0.0-1.sl5.noarch
    Marking emi-release-2.0.0-1.sl5.noarch.rpm to be installed
    521 packages excluded due to repository priority protections
    0 packages excluded due to repository protections
    Reading version lock configuration
    Resolving Dependencies
    --> Running transaction check
    ---> Package emi-release.noarch 0:2.0.0-1.sl5 set to be updated
    --> Finished Dependency Resolution
    Beginning Kernel Module Plugin
    Finished Kernel Module Plugin
    
    Dependencies Resolved
    
    ================================================================================
     Package       Arch     Version         Repository                         Size
    ================================================================================
    Installing:
     emi-release   noarch   2.0.0-1.sl5     /emi-release-2.0.0-1.sl5.noarch   2.7 k
    
    Transaction Summary
    ================================================================================
    Install       1 Package(s)
    Upgrade       0 Package(s)
    
    Total size: 2.7 k
    Is this ok [y/N]: y
    Downloading Packages:
    Running rpm_check_debug
    Running Transaction Test
    Finished Transaction Test
    Transaction Test Succeeded
    Running Transaction
      Installing     : emi-release                                              1/1
    
    Installed:
      emi-release.noarch 0:2.0.0-1.sl5
    
    Complete!
     

  • Satisfy EGI repository settings
    ]# ls /etc/yum.repos.d/egi-trustanchors.repo
     

  • Verify the ca-policy-egi-core package
    ]# rpm -qa | grep ca-policy-egi-core
    ca-policy-egi-core-1.50-1
     

Install the StoRM services in a standalone deployment

  • Clean yum cache
    ]# yum clean all
    Loaded plugins: downloadonly, kernel-module, priorities, protect-packages,
                  : protectbase, security, verify, versionlock
    Cleaning up Everything
     

  • Install the main StoRM node metapackages:
    ]# yum install emi-storm-backend-mp emi-storm-frontend-mp emi-storm-globus-gridftp-mp emi-storm-gridhttps-mp
    ...
    EMI-2-base/gpgkey                                                                                                                     | 1.7 kB     00:00
    Importing GPG key 0xDF9E12EF "Doina Cristina Aiftimiei (EMI Release Manager) <aiftim@pd.infn.it>" from /etc/pki/rpm-gpg/RPM-GPG-KEY-emi
    Is this ok [y/N]: y
    ...
     

  • Install the StoRM pre-assembled configuration package
    ]# yum install storm-pre-assembled-configuration
    ...
    ]# rpm -ql  storm-pre-assembled-configuration
    /etc/storm
    /etc/storm/siteinfo
    /etc/storm/siteinfo/storm-groups.conf
    /etc/storm/siteinfo/storm-users.conf
    /etc/storm/siteinfo/storm-wn-list.conf
    /etc/storm/siteinfo/storm.def
    /etc/storm/siteinfo/storm.def.template
    /etc/storm/siteinfo/vo.d
    /etc/storm/siteinfo/vo.d/dteam
    /etc/storm/siteinfo/vo.d/infngrid
    /etc/storm/siteinfo/vo.d/ops
    /etc/storm/siteinfo/vo.d/testers.eu-emi.eu
    /usr/sbin/EMI_1_repos_install
    /usr/share/doc/storm-pre-assembled-configuration-1.0.0
    /usr/share/doc/storm-pre-assembled-configuration-1.0.0/AUTHORS
    /usr/share/doc/storm-pre-assembled-configuration-1.0.0/CREDITS
    /usr/share/doc/storm-pre-assembled-configuration-1.0.0/ChangeLog
    /usr/share/doc/storm-pre-assembled-configuration-1.0.0/LICENSE
    /usr/share/doc/storm-pre-assembled-configuration-1.0.0/README
     

Pre-configure checks

  • Configure the igi.italiangrid.it and infngrid VOs
    • Create vo.d/igi.italiangrid.it file inside the configuration /etc/storm/siteinfo/ directory
      ]# vi /etc/storm/siteinfo/vo.d/igi.italiangrid.it
      SW_DIR=/cvmfs/igi.italiangrid.it
      DEFAULT_SE=$SE_HOST
      STORAGE_DIR=$CLASSIC_STORAGE_DIR/igi
      VOMS_SERVERS="'vomss://vomsmania.cnaf.infn.it:8443/voms/igi.italiangrid.it?/igi.italiangrid.it'"
      VOMSES="'igi.italiangrid.it vomsmania.cnaf.infn.it 15003 /C=IT/O=INFN/OU=Host/L=CNAF/CN=vomsmania.cnaf.infn.it igi.italiangrid.it'"
      VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA'"
         
    • Create vo.d/infngrid file inside the configuration /etc/storm/siteinfo/ directory
      ]# vi /etc/storm/siteinfo/vo.d/infngrid
      SW_DIR=$VO_SW_DIR/infngrid
      DEFAULT_SE=$SE_HOST
      STORAGE_DIR=$CLASSIC_STORAGE_DIR/infngrid
      VOMS_SERVERS="'vomss://voms.cnaf.infn.it:8443/voms/infngrid?/infngrid' 'vomss://voms-01.pd.infn.it:8443/voms/infngrid?/infngrid'"
      VOMSES="'infngrid voms.cnaf.infn.it 15000 /C=IT/O=INFN/OU=Host/L=CNAF/CN=voms.cnaf.infn.it infngrid' 'infngrid voms-01.pd.infn.it 15000 /C=IT/O=INFN/OU=Host/L=Padova/CN=voms-01.pd.infn.it infngrid'"
      VOMS_CA_DN="'/C=IT/O=INFN/CN=INFN CA' '/C=IT/O=INFN/CN=INFN CA'"
         
    • Modify the storm-users.conf file adding igi.italiagrid.it users
      ]# vi /etc/storm/siteinfo/storm-users.conf
      ...
      3601:igi001:7400:igi:igi.italiangrid.it::
      3602:igi002:7400:igi:igi.italiangrid.it::
      3603:igi003:7400:igi:igi.italiangrid.it::
      3604:igi004:7400:igi:igi.italiangrid.it::
      3605:igi005:7400:igi:igi.italiangrid.it::
      3606:igi006:7400:igi:igi.italiangrid.it::
      3607:igi007:7400:igi:igi.italiangrid.it::
      3608:igi008:7400:igi:igi.italiangrid.it::
      3609:igi009:7400:igi:igi.italiangrid.it::
      3610:igi010:7400:igi:igi.italiangrid.it::
      3611:igi011:7400:igi:igi.italiangrid.it::
      3612:igi012:7400:igi:igi.italiangrid.it::
      3613:igi013:7400:igi:igi.italiangrid.it::
      3614:igi014:7400:igi:igi.italiangrid.it::
      3615:igi015:7400:igi:igi.italiangrid.it::
      3616:igi016:7400:igi:igi.italiangrid.it::
      3617:igi017:7400:igi:igi.italiangrid.it::
      3618:igi018:7400:igi:igi.italiangrid.it::
      3619:igi019:7400:igi:igi.italiangrid.it::
      3620:igi020:7400:igi:igi.italiangrid.it::
      3621:igi021:7400:igi:igi.italiangrid.it::
      3622:igi022:7400:igi:igi.italiangrid.it::
      3623:igi023:7400:igi:igi.italiangrid.it::
      3624:igi024:7400:igi:igi.italiangigi:it::
      3625:igi025:7400:igi:igi.italiangrid.it::
      10161:sgmigi001:7450,7400:sgmigi,igi:igi.italiangrid.it:sgm:
      10162:sgmigi002:7450,7400:sgmigi,igi:igi.italiangrid.it:sgm:
      10163:sgmigi003:7450,7400:sgmigi,igi:igi.italiangrid.it:sgm:
      10164:sgmigi004:7450,7400:sgmigi,igi:igi.italiangrid.it:sgm:
      10165:sgmigi005:7450,7400:sgmigi,igi:igi.italiangrid.it:sgm:
      7106:sgminfngrid001:2504,2405:sgminfngrid,infngrid:infngrid:sgm:
      7206:sgminfngrid002:2504,2405:sgminfngrid,infngrid:infngrid:sgm:
      7306:sgminfngrid003:2504,2405:sgminfngrid,infngrid:infngrid:sgm:
      7401:pilinfngrid001:2604,2405:pilinfngrid,infngrid:infngrid:pilot:
      7402:pilinfngrid002:2604,2405:pilinfngrid,infngrid:infngrid:pilot:
      7403:pilinfngrid003:2604,2405:pilinfngrid,infngrid:infngrid:pilot:
      2451:infngrid001:2405:infngrid:infngrid::
      2452:infngrid002:2405:infngrid:infngrid::
      2453:infngrid003:2405:infngrid:infngrid::
      2454:infngrid004:2405:infngrid:infngrid::
      2455:infngrid005:2405:infngrid:infngrid::
      2456:infngrid006:2405:infngrid:infngrid::
      2457:infngrid007:2405:infngrid:infngrid::
      2458:infngrid008:2405:infngrid:infngrid::
      2459:infngrid009:2405:infngrid:infngrid::
      2460:infngrid010:2405:infngrid:infngrid::
      2461:infngrid011:2405:infngrid:infngrid::
      2462:infngrid012:2405:infngrid:infngrid::
      2463:infngrid013:2405:infngrid:infngrid::
      2464:infngrid014:2405:infngrid:infngrid::
      2465:infngrid015:2405:infngrid:infngrid::
      2466:infngrid016:2405:infngrid:infngrid::
      2467:infngrid017:2405:infngrid:infngrid::
      2468:infngrid018:2405:infngrid:infngrid::
      2469:infngrid019:2405:infngrid:infngrid::
      2470:infngrid020:2405:infngrid:infngrid::
         
    • Modify the storm-groups.conf file adding igi.italiagrid.it details
      ]# vi /etc/storm/siteinfo/storm-groups.conf
      ...
      "/igi.italiangrid.it/ROLE=SoftwareManager":::sgm:
      "/igi.italiangrid.it"::::
      "/igi.italiangrid.it/*"::::
      "/infngrid/ROLE=SoftwareManager":::sgm:
      "/infngrid/ROLE=pilot":::pilot:
      "/infngrid"::::
         
    • Modify the storm.def file adding the igi.italiangrid.it VO
      ]# vi /etc/storm/siteinfo/storm.def
      ...
      VOS="igi.italiangrid.it infngrid dteam"
         

  • Configure the mysqld service
    • Modify the my.cnf file
      ]# cat /etc/my.cnf
      [mysqld]
      datadir=/var/lib/mysql
      socket=/var/lib/mysql/mysql.sock
      user=mysql
      # Default to using old password format for compatibility with mysql 3.x
      # clients (those using the mysqlclient10 compatibility package).
      old_passwords=1
      
      # Disabling symbolic-links is recommended to prevent assorted security risks;
      # to do so, uncomment this line:
      # symbolic-links=0
      
      [mysqld_safe]
      log-error=/var/log/mysqld.log
      pid-file=/var/run/mysqld/mysqld.pid
       
    • Add to the mysqld section the following options
      max_connections=2000
      wait_timeout=86400
      innodb_buffer_pool_size=256M
       

  • Modify the storm.def file
    • Modify top BDII hostname
      BDII_HOST=gridit-bdii-01.cnaf.infn.it
        
    • Modify MY_DOMAIN
      MY_DOMAIN="cnaf.infn.it"
        

Configure the StoRM services

  • Check DB information
    MYSQL_PASSWORD="storm"
    STORM_DB_PWD="bluemoon"
    STORM_DB_USER="storm"
     
  • Modify information useful for the Backend and Gridhttps services
    • Change STORM BACKEND HOST value
      STORM_BACKEND_HOST=tutor02-storm.cnaf.infn.it
       
  • Modify information useful for the Backend and Frontend services
    STORM_DB_HOST=$STORM_BACKEND_HOST
    STORM_USER="storm"
     
  • Check Frontend information
    STORM_FE_BE_XMLRPC_HOST=$STORM_BACKEND_HOST
     
  • Check BDII information
    STORM_INFO_OVERWRITE=true
    SITE_NAME="storm-1.10-all-in-one"
    STORM_BDII_OVERWRITE="true"
    STORM_ENDPOINT_QUALITY_LEVEL=2
    STORM_ENDPOINT_SERVING_STATE=4
    SE_TYPE="disk"
    SE_LIST=$STORM_FRONTEND_PUBLIC_HOST
     
  • Check Backend Information
    • Set Frontend service host list
      STORM_FRONTEND_HOST_LIST=$STORM_BACKEND_HOST
      STORM_FRONTEND_PUBLIC_HOST=$STORM_BACKEND_HOST
       
      * Set Gridftp service host list
      STORM_GRIDFTP_POOL_LIST=${STORM_BACKEND_HOST}
       
      * Set Gridhttps service host list
      STORM_GRIDHTTPS_PLUGIN_CLASSNAME=it.grid.storm.https.GhttpsHTTPSPluginInterface
      STORM_GRIDHTTPS_SERVER_PORT=8088
      STORM_GRIDHTTPS_ENABLED=true 
      STORM_INFO_HTTP_SUPPORT=true
      STORM_INFO_HTTPS_SUPPORT=true
      STORM_GRIDHTTPS_SERVER_USER_UID=91
      STORM_GRIDHTTPS_SERVER_GROUP_UID=91
      
    • Set default directory for Storage Area
      STORM_DEFAULT_ROOT="/storage"
       
      * Specify the list of the supported Storage Areas (Please remember that the values of the Storage Areas can be different to the VO name)
      STORM_STORAGEAREA_LIST="$VOS"
       
      * Set for each Storage Area at least the total size expressed in GB (Must be an integer value)
      STORM_DTEAM_ONLINE_SIZE=4
      STORM_TESTERSEUEMIEU_ONLINE_SIZE=4
      STORM_IGIITALIANGRIDIT_ONLINE_SIZE=4
        

  • Disable Checksum service
        
    STORM_CKSUM_SUPPORT=false
       

  • Set Gridhttps service
        
    STORM_GRIDHTTPS_SERVER_PORT=8088
       

  • Set Gridftp service to support
        
    GRIDFTP_WITH_DSI="yes"
    GRIDFTP_CONNECTIONS_MAX="2000"
     

  • Run yaim
        
    /opt/glite/yaim/bin/yaim -c -d 6 -s /etc/storm/siteinfo/storm.def -n se_storm_backend -n se_storm_frontend -n se_storm_gridftp -n se_storm_gridhttps
     

Verify the StoRM deployment

  • Check the StoRM services
        
    ]# service storm-backend-server status
    storm-backend-server (pid 27449) is RUNNING                [  OK  ]
    ]# service storm-frontend-server status
    storm-frontend-server (pid 13321) is running...
    ]# service storm-globus-gridftp status
    globus-gridftp-server (pid 13432) is running...
    ]#  service tomcat5 status
    /etc/init.d/tomcat5 is already running (29536)
     
  • Check the StoRM log files
        
    ]# tail -f /var/log/storm/storm-backend.log
    ]# tail -f /var/log/storm/storm-frontend-server.log
    ]# tail -f /var/log/storm/storm-globus-gridftp.log
    ]# tail -f /var/log/storm/storm-gridftp-session.log
     
  • BDII by using for example an LDAP browser or ldapsearch
  • Transfer the /home/TIER1/ronchieri/tests/testfile-1.txt local file in the remote machine by using globus-url-copy
    ]#  globus-url-copy -dbg file:///home/TIER1/ronchieri/tests/testfile-1.txt gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: starting to put gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: connecting to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    220 tutor02-storm.cnaf.infn.it GridFTP Server 6.14 (gcc64, 1342551528-83) [Globus Toolkit 5.2.1] ready.
    
    debug: authenticating with gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    230 User dteam027 logged in.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    SITE HELP
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    214-The following commands are recognized:
        ALLO    APPE    REST    CWD     CDUP    DCAU    EPSV    FEAT
        ERET    MDTM    STAT    ESTO    HELP    LIST    MODE    NLST
        MLSC    MLSD    PASV    RNFR    MLSR    MLST    NOOP    OPTS
        STOR    PASS    PBSZ    PORT    PROT    SITE    EPRT    RETR
        SPOR    MFMT    SCKS    TREV    PWD     QUIT    SBUF    SIZE
        SPAS    STRU    SYST    RNTO    TYPE    USER    LANG    MKD
        RMD     DELE    CKSM    DCSC
    214 End
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    FEAT
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    211-Extensions supported
     DCSC P,D
     MFMT
     AUTHZ_ASSERT
     MLSR
     MLSC
     UTF8
     LANG EN
     DCAU
     PARALLEL
     SIZE
     MLST Type*;Size*;Modify*;Perm*;Charset;UNIX.mode*;UNIX.owner*;UNIX.uid*;UNIX.group*;UNIX.gid*;Unique*;UNIX.slink*;X.count;
     ERET
     ESTO
     SPAS
     SPOR
     REST STREAM
     MDTM
     PASV AllowDelayed;
    211 End.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    SITE CLIENTINFO scheme=gsiftp;appname="globus-url-copy";appver="8.2 (gcc64, 1323102900-1) [unknown]";
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    250 OK.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    TYPE I
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    200 Type set to I.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    PBSZ 1048576
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    200 PBSZ=1048576
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    PASV
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    227 Entering Passive Mode (131,154,100,164,95,63)
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    ALLO 22
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    200 ALLO command successful.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    STOR /tmp/test-joda_10.txt
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    150 Beginning transfer.
    
    debug: writing buffer 0x2ab08ff66010, length 22, offset=0, eof=true
    debug: data callback, no error, buffer 0x2ab08ff66010, length 22, offset=0, eof=true
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    226 Transfer Complete.
    
    debug: operation complete
     
  • Verify the StoRM status by using ping
        
    ]# clientSRM ping -e httpg://tutor02-storm.cnaf.infn.it:8444/
    ============================================================
    Sending Ping request to: httpg://tutor02-storm.cnaf.infn.it:8444/
    Before execute:
    execute Request with:Ping
    started calling ns1__srmPing:
    finished calling ns1__srmPing:
    Afer execute:
    Request Status Code 0
    Poll Flag 0
    ============================================================
    Request status:
      statusCode="SRM_SUCCESS"(0)
      explanation="SRM server successfully contacted"
    ============================================================
    SRM Response:
      versionInfo="v2.2"
      otherInfo (size=3)
        [0] key="backend_type"
        [0] value="StoRM"
        [1] key="backend_version"
        [1] value="<FE:1.8.0-10><BE:1.10.0-1>"
        [2] key="backend_os_distribution"
        [2] value="Scientific Linux release 5.8 (Boron)"
    ============================================================
     
  • Transfer the /home/TIER1/ronchieri/pippo local file in the remote machine by using lcg-cp
    ]# lcg-cp -b --verbose -D srmv2 file:///home/TIER1/ronchieri/pippo srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test_joda_10.txt
    Using grid catalog type: UNKNOWN
    Using grid catalog : prod-lfc-shared-central.cern.ch
    VO name: dteam
    Checksum type: None
    Destination SE type: SRMv2
    Destination SRM Request Token: 39e9fb0b-64b2-4a81-a072-484d53af6597
    Source URL: file:/home/TIER1/ronchieri/pippo
    File size: 13616
    Source URL for copy: file:/home/TIER1/ronchieri/pippo
    Destination URL: gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test_joda_10.txt
    # streams: 1
                0 bytes      0.00 KB/sec avg      0.00 KB/sec inst
    Transfer took 1010 ms
     
  • Transfer the /home/TIER1/ronchieri/tests/testfile-1.txt local file in the remote machine by using clientSRM
     
    ]#  clientSRM ptp -e httpg://tutor02-storm.cnaf.infn.it:8444/ -s  srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt -p
    ============================================================
    Sending PtP request to: httpg://tutor02-storm.cnaf.infn.it:8444/
    Before execute:
    Afer execute:
    Request Status Code 17
    Poll Flag 1
    ============================================================
    Polling request status:
    Current status: SRM_REQUEST_QUEUED (Ctrl+c to stop polling).
    ============================================================
    Request status:
      statusCode="SRM_SUCCESS"(0)
      explanation="All chunks successfully handled!"
    ============================================================
    SRM Response:
      requestToken="66c2babf-6f67-41ec-b965-787bbe84777f"
      arrayOfFileStatuses (size=1)
          [0] SURL="srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt"
          [0] status: statusCode="SRM_SPACE_AVAILABLE"(24)
                      explanation="srmPrepareToPut successfully handled!"
          [0] TURL="gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt"
    ============================================================
    ]# globus-url-copy -dbg file:///home/TIER1/ronchieri/tests/testfile-1.txt gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: starting to put gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: connecting to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    220 tutor02-storm.cnaf.infn.it GridFTP Server 6.14 (gcc64, 1342551528-83) [Globus Toolkit 5.2.1] ready.
    
    debug: authenticating with gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    230 User dteam027 logged in.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    SITE HELP
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    214-The following commands are recognized:
        ALLO    APPE    REST    CWD     CDUP    DCAU    EPSV    FEAT
        ERET    MDTM    STAT    ESTO    HELP    LIST    MODE    NLST
        MLSC    MLSD    PASV    RNFR    MLSR    MLST    NOOP    OPTS
        STOR    PASS    PBSZ    PORT    PROT    SITE    EPRT    RETR
        SPOR    MFMT    SCKS    TREV    PWD     QUIT    SBUF    SIZE
        SPAS    STRU    SYST    RNTO    TYPE    USER    LANG    MKD
        RMD     DELE    CKSM    DCSC
    214 End
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    FEAT
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    211-Extensions supported
     DCSC P,D
     MFMT
     AUTHZ_ASSERT
     MLSR
     MLSC
     UTF8
     LANG EN
     DCAU
     PARALLEL
     SIZE
     MLST Type*;Size*;Modify*;Perm*;Charset;UNIX.mode*;UNIX.owner*;UNIX.uid*;UNIX.group*;UNIX.gid*;Unique*;UNIX.slink*;X.count;
     ERET
     ESTO
     SPAS
     SPOR
     REST STREAM
     MDTM
     PASV AllowDelayed;
    211 End.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    SITE CLIENTINFO scheme=gsiftp;appname="globus-url-copy";appver="8.2 (gcc64, 1323102900-1) [unknown]";
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    250 OK.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    TYPE I
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    200 Type set to I.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    PBSZ 1048576
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    200 PBSZ=1048576
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    PASV
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    227 Entering Passive Mode (131,154,100,164,95,63)
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    ALLO 22
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    200 ALLO command successful.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    STOR //storage/dteam/test-joda-11.txt
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    150 Beginning transfer.
    
    debug: writing buffer 0x2ad48bc19010, length 22, offset=0, eof=true
    debug: data callback, no error, buffer 0x2ad48bc19010, length 22, offset=0, eof=true
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    226 Transfer Complete.
    
    debug: operation complete
    ]# clientSRM pd -e httpg://tutor02-storm.cnaf.infn.it:8444/ -s  srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt -t 66c2babf-6f67-41ec-b965-787bbe84777f
    ============================================================
    Sending PutDone request to: httpg://tutor02-storm.cnaf.infn.it:8444/
    Before execute:
    Afer execute:
    Request Status Code 0
    Poll Flag 0
    ============================================================
    Request status:
      statusCode="SRM_SUCCESS"(0)
      explanation="All file requests are successfully completed"
    ============================================================
    SRM Response:
      arrayOfFileStatuses (size=1)
          [0] SURL="srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt"
          [0] status: statusCode="SRM_SUCCESS"(0)
                      explanation=""
    ============================================================
     

References

  1. System Guide, http://storm.forge.cnaf.infn.it/_media/documentation/storm-1.10.0-sysadminguide.pdf?id=documentation%3Ahome&cache=cache
  2. Functionalities, http://storm.forge.cnaf.infn.it/_media/documentation/storm_guide_v0.5.pdf?id=documentation%3Ahome&cache=cache

-- Main.Elisabetta Ronchieri - 2012-10-2

Edit | Attach | PDF | History: r9 < r8 < r7 < r6 < r5 | Backlinks | Raw View | More topic actions
Topic revision: r9 - 2012-10-03 - RonchieriElisabetta
 
This site is powered by the TWiki collaboration platformCopyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback