Difference: TutorialStoRM (8 vs. 9)

Revision 92012-10-03 - RonchieriElisabetta

Line: 1 to 1
 
META TOPICPARENT name="WebHome"

Tutorial StoRM

Line: 152 to 152
 
    • Verify extended attribute support by using
      ]# touch testfile
Changed:
<
<
]# setfattr -n joda.test -v test testfile
>
>
]# setfattr -n user.test -v test testfile
 ]# getfattr -d testfile # file: testfile user.test="test"
Line: 180 to 180
 100%[======================================>] 5,189 --.-K/s in 0s

2012-10-02 18:46:32 (353 MB/s) - `emi-release-2.0.0-1.sl5.noarch.rpm' saved [5189/5189]

Changed:
<
<
]# # yum localinstall --nogpgcheck emi-release-2.0.0-1.sl5.noarch.rpm
>
>
]# yum localinstall --nogpgcheck emi-release-2.0.0-1.sl5.noarch.rpm
 Loaded plugins: downloadonly, kernel-module, priorities, protect-packages, : protectbase, security, verify, versionlock Setting up Local Package Process
Line: 381 to 381
 
]# vi /etc/storm/siteinfo/storm.def
...
Changed:
<
<
VOS="igi.italiangrid.it testers.eu-emi.eu dteam"
>
>
VOS="igi.italiangrid.it infngrid dteam"
 

  • Configure the mysqld service
Line: 432 to 432
 
  • Modify information useful for the Backend and Gridhttps services
    • Change STORM BACKEND HOST value

Changed:
<
<
STORM_BACKEND_HOST=tutor-storm.cnaf.infn.it
>
>
STORM_BACKEND_HOST=tutor02-storm.cnaf.infn.it
 
  • Modify information useful for the Backend and Frontend services

Line: 457 to 457
 
    • Set Frontend service host list
      STORM_FRONTEND_HOST_LIST=$STORM_BACKEND_HOST
Deleted:
<
<
* Set Frontend service public host

 STORM_FRONTEND_PUBLIC_HOST=$STORM_BACKEND_HOST * Set Gridftp service host list
Line: 470 to 467
 
STORM_GRIDHTTPS_PLUGIN_CLASSNAME=it.grid.storm.https.GhttpsHTTPSPluginInterface
STORM_GRIDHTTPS_SERVER_PORT=8088
Deleted:
<
<
STORM_GRIDFTP_POOL_LIST=${STORM_BACKEND_HOST}
 STORM_GRIDHTTPS_ENABLED=true STORM_INFO_HTTP_SUPPORT=true STORM_INFO_HTTPS_SUPPORT=true
Line: 517 to 513
 
  • Check the StoRM services
        
    ]# service storm-backend-server status
Changed:
<
<
>
>
storm-backend-server (pid 27449) is RUNNING [ OK ]
 ]# service storm-frontend-server status storm-frontend-server (pid 13321) is running... ]# service storm-globus-gridftp status globus-gridftp-server (pid 13432) is running...
Changed:
<
<
service tomcat5 status
>
>
]# service tomcat5 status /etc/init.d/tomcat5 is already running (29536)
 
  • Check the StoRM log files
        
Changed:
<
<
tail -f /var/log/storm/storm-backend.log tail -f /var/log/storm/storm-frontend-server.log
>
>
]# tail -f /var/log/storm/storm-backend.log ]# tail -f /var/log/storm/storm-frontend-server.log ]# tail -f /var/log/storm/storm-globus-gridftp.log ]# tail -f /var/log/storm/storm-gridftp-session.log
  • BDII by using for example an LDAP browser or ldapsearch
  • Transfer the /home/TIER1/ronchieri/tests/testfile-1.txt local file in the remote machine by using globus-url-copy
    ]#  globus-url-copy -dbg file:///home/TIER1/ronchieri/tests/testfile-1.txt gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: starting to put gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: connecting to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    220 tutor02-storm.cnaf.infn.it GridFTP Server 6.14 (gcc64, 1342551528-83) [Globus Toolkit 5.2.1] ready.
    
    debug: authenticating with gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    230 User dteam027 logged in.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    SITE HELP
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    214-The following commands are recognized:
        ALLO    APPE    REST    CWD     CDUP    DCAU    EPSV    FEAT
        ERET    MDTM    STAT    ESTO    HELP    LIST    MODE    NLST
        MLSC    MLSD    PASV    RNFR    MLSR    MLST    NOOP    OPTS
        STOR    PASS    PBSZ    PORT    PROT    SITE    EPRT    RETR
        SPOR    MFMT    SCKS    TREV    PWD     QUIT    SBUF    SIZE
        SPAS    STRU    SYST    RNTO    TYPE    USER    LANG    MKD
        RMD     DELE    CKSM    DCSC
    214 End
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    FEAT
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    211-Extensions supported
     DCSC P,D
     MFMT
     AUTHZ_ASSERT
     MLSR
     MLSC
     UTF8
     LANG EN
     DCAU
     PARALLEL
     SIZE
     MLST Type*;Size*;Modify*;Perm*;Charset;UNIX.mode*;UNIX.owner*;UNIX.uid*;UNIX.group*;UNIX.gid*;Unique*;UNIX.slink*;X.count;
     ERET
     ESTO
     SPAS
     SPOR
     REST STREAM
     MDTM
     PASV AllowDelayed;
    211 End.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    SITE CLIENTINFO scheme=gsiftp;appname="globus-url-copy";appver="8.2 (gcc64, 1323102900-1) [unknown]";
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    250 OK.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    TYPE I
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    200 Type set to I.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    PBSZ 1048576
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    200 PBSZ=1048576
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    PASV
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    227 Entering Passive Mode (131,154,100,164,95,63)
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    ALLO 22
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    200 ALLO command successful.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    STOR /tmp/test-joda_10.txt
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    150 Beginning transfer.
    
    debug: writing buffer 0x2ab08ff66010, length 22, offset=0, eof=true
    debug: data callback, no error, buffer 0x2ab08ff66010, length 22, offset=0, eof=true
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811/tmp/test-joda_10.txt:
    226 Transfer Complete.
    
    debug: operation complete
     
  • Verify the StoRM status by using ping
        
    ]# clientSRM ping -e httpg://tutor02-storm.cnaf.infn.it:8444/
    ============================================================
    Sending Ping request to: httpg://tutor02-storm.cnaf.infn.it:8444/
    Before execute:
    execute Request with:Ping
    started calling ns1__srmPing:
    finished calling ns1__srmPing:
    Afer execute:
    Request Status Code 0
    Poll Flag 0
    ============================================================
    Request status:
      statusCode="SRM_SUCCESS"(0)
      explanation="SRM server successfully contacted"
    ============================================================
    SRM Response:
      versionInfo="v2.2"
      otherInfo (size=3)
        [0] key="backend_type"
        [0] value="StoRM"
        [1] key="backend_version"
        [1] value="<FE:1.8.0-10><BE:1.10.0-1>"
        [2] key="backend_os_distribution"
        [2] value="Scientific Linux release 5.8 (Boron)"
    ============================================================
     
  • Transfer the /home/TIER1/ronchieri/pippo local file in the remote machine by using lcg-cp
    ]# lcg-cp -b --verbose -D srmv2 file:///home/TIER1/ronchieri/pippo srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test_joda_10.txt
    Using grid catalog type: UNKNOWN
    Using grid catalog : prod-lfc-shared-central.cern.ch
    VO name: dteam
    Checksum type: None
    Destination SE type: SRMv2
    Destination SRM Request Token: 39e9fb0b-64b2-4a81-a072-484d53af6597
    Source URL: file:/home/TIER1/ronchieri/pippo
    File size: 13616
    Source URL for copy: file:/home/TIER1/ronchieri/pippo
    Destination URL: gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test_joda_10.txt
    # streams: 1
                0 bytes      0.00 KB/sec avg      0.00 KB/sec inst
    Transfer took 1010 ms
     
  • Transfer the /home/TIER1/ronchieri/tests/testfile-1.txt local file in the remote machine by using clientSRM
     
    ]#  clientSRM ptp -e httpg://tutor02-storm.cnaf.infn.it:8444/ -s  srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt -p
    ============================================================
    Sending PtP request to: httpg://tutor02-storm.cnaf.infn.it:8444/
    Before execute:
    Afer execute:
    Request Status Code 17
    Poll Flag 1
    ============================================================
    Polling request status:
    Current status: SRM_REQUEST_QUEUED (Ctrl+c to stop polling).
    ============================================================
    Request status:
      statusCode="SRM_SUCCESS"(0)
      explanation="All chunks successfully handled!"
    ============================================================
    SRM Response:
      requestToken="66c2babf-6f67-41ec-b965-787bbe84777f"
      arrayOfFileStatuses (size=1)
          [0] SURL="srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt"
          [0] status: statusCode="SRM_SPACE_AVAILABLE"(24)
                      explanation="srmPrepareToPut successfully handled!"
          [0] TURL="gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt"
    ============================================================
    ]# globus-url-copy -dbg file:///home/TIER1/ronchieri/tests/testfile-1.txt gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: starting to put gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: connecting to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    220 tutor02-storm.cnaf.infn.it GridFTP Server 6.14 (gcc64, 1342551528-83) [Globus Toolkit 5.2.1] ready.
    
    debug: authenticating with gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    230 User dteam027 logged in.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    SITE HELP
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    214-The following commands are recognized:
        ALLO    APPE    REST    CWD     CDUP    DCAU    EPSV    FEAT
        ERET    MDTM    STAT    ESTO    HELP    LIST    MODE    NLST
        MLSC    MLSD    PASV    RNFR    MLSR    MLST    NOOP    OPTS
        STOR    PASS    PBSZ    PORT    PROT    SITE    EPRT    RETR
        SPOR    MFMT    SCKS    TREV    PWD     QUIT    SBUF    SIZE
        SPAS    STRU    SYST    RNTO    TYPE    USER    LANG    MKD
        RMD     DELE    CKSM    DCSC
    214 End
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    FEAT
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    211-Extensions supported
     DCSC P,D
     MFMT
     AUTHZ_ASSERT
     MLSR
     MLSC
     UTF8
     LANG EN
     DCAU
     PARALLEL
     SIZE
     MLST Type*;Size*;Modify*;Perm*;Charset;UNIX.mode*;UNIX.owner*;UNIX.uid*;UNIX.group*;UNIX.gid*;Unique*;UNIX.slink*;X.count;
     ERET
     ESTO
     SPAS
     SPOR
     REST STREAM
     MDTM
     PASV AllowDelayed;
    211 End.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    SITE CLIENTINFO scheme=gsiftp;appname="globus-url-copy";appver="8.2 (gcc64, 1323102900-1) [unknown]";
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    250 OK.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    TYPE I
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    200 Type set to I.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    PBSZ 1048576
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    200 PBSZ=1048576
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    PASV
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    227 Entering Passive Mode (131,154,100,164,95,63)
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    ALLO 22
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    200 ALLO command successful.
    
    debug: sending command to gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    STOR //storage/dteam/test-joda-11.txt
    
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    150 Beginning transfer.
    
    debug: writing buffer 0x2ad48bc19010, length 22, offset=0, eof=true
    debug: data callback, no error, buffer 0x2ad48bc19010, length 22, offset=0, eof=true
    debug: response from gsiftp://tutor02-storm.cnaf.infn.it:2811//storage/dteam/test-joda-11.txt:
    226 Transfer Complete.
    
    debug: operation complete
    ]# clientSRM pd -e httpg://tutor02-storm.cnaf.infn.it:8444/ -s  srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt -t 66c2babf-6f67-41ec-b965-787bbe84777f
    ============================================================
    Sending PutDone request to: httpg://tutor02-storm.cnaf.infn.it:8444/
    Before execute:
    Afer execute:
    Request Status Code 0
    Poll Flag 0
    ============================================================
    Request status:
      statusCode="SRM_SUCCESS"(0)
      explanation="All file requests are successfully completed"
    ============================================================
    SRM Response:
      arrayOfFileStatuses (size=1)
          [0] SURL="srm://tutor02-storm.cnaf.infn.it:8444/srm/managerv2?SFN=/dteam/test-joda-11.txt"
          [0] status: statusCode="SRM_SUCCESS"(0)
                      explanation=""
    ============================================================
 
Deleted:
<
<
  • BDII by using for example an LDAP browser
  • srmping
  • lcg-cp
  • lcg-del
 

References

 
This site is powered by the TWiki collaboration platformCopyright © 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback