User Tools

Site Tools


lbaops:copying_data_of_parkes_mark5b

Copying Mark5 data

For a local copy to pam-store

  • Run /opt/jive5ab on pkmk5b-ext (as oper)
  • Run jive5ab on pam-store-ext (as vlbi)
  • On pam-store-ext run m5copy 'mk5://pkmk5b-ext/A/*' file://pam-store-ext/data/mark5/v493c/

For a direct transfer to cass-01-per

On pkmk5b as oper:

EndDIM       # (Kill existing DIMino)
jive5ab

On pam-store-ext as vlbi to see what data is on each bank:

DirList.py -a pkmk5b-ext -b A
DirList.py -a pkmk5b-ext -b B

On cass-01-per (or whatever destination machine) as yourself:

/opt/jive5ab -p 40050

On pam-store-ext as vlbi:

m5copy -udt -p 40051 'mk5://pkmk5b-ext/A/v566a*' file://cass-01-per.it.csiro.au:40050/OSM/PER/CASS_LBA/data/2018/v566a/Parkes/

Recovering blank User Directory

10,11c10
< #LD_SDK = -lssapi  /usr/local/src/streamstor/linux/driver/lib/libwdapi1110.so
< LD_SDK = -lssapi  /usr/local/src/streamstor/linux/driver/lib/libwdapi1031.so
---
> LD_SDK = -lssapi  /usr/local/src/streamstor/linux/driver/lib/libwdapi1110.so
15c14
< CF_SDK = -DXLR_SDK_VERSION=10
---
> CF_SDK = -DXLR_SDK_VERSION=9
  • Parse fs log to create text dirlist ./fuseMk5A/fslog2scanlist.py v493cpa.log v493c.scans. If 2 diskpacks, edit appropriately
  • Create a binary version of the userdir ./fuseMk5A/text2userdir.py v493c.scans v493c.dir
  • Write the userdir to the diskpack in bank A ./fuseMk5A/writeuserdir v493c.dir

JIVE5ab File2File copying

cira10 to cass01-per

  • On cira10 run jive5ab
  • On cass-01-per run jive5ab -p 50033
  • On cira10 run m5copy -p 40034 'file:///data/vt02ad/*' file://cass-01-per.it.csiro.au:40033/OSM/PER/CASS_LBA/data/ASKAP/vt02ad/

However TCP so very slow - 29 Mbps. UDT won't work as firewall not setup

Copying data to Shanghai

  • Data directory /data1/geo/raw/aua011/pa (for example)
  • IP 159.226.233.196
  • Usual pcfs username
  • VLBI public key
lbaops/copying_data_of_parkes_mark5b.txt · Last modified: 2018/08/29 16:01 by cormac