From: <stingay_at_email.protected>
Date: Thu, 4 May 2006 23:01:14 +1000 (EST)

Dear All,

Here is a global summary of disk usage for the following experiments in
the May 2006 VLBI session:

vt06b doy 132 128 Mbps
v188a doy 132/133 512/256 Mbps
v190a doy 133/134 512/256 Mbps
vt07b1 doy 135 512 Mbps
v190b doy 135 512/256 Mbps
v184a doy 136 32 Mbps
vt08a doy 136 256 Mbps

An email directed to each telescope will follow, giving a timeline of
when disks at each telescope need to be mounted, unmounted, recorded, and
cleaned, over the course of the session. These details will also go up
onto the wiki for each experiment.

This plan is relatively complicated, so please look through it. The
telescope-based timelines will be easier to look at. Please take the time
to check them out. If you spot any problems or have any comments, please
let me know ASAP.

The total disk usage over the course of the session will be:

                vt06b v188a v190a vt07b1 v190b v184a vt08a

ATCA 0.6TB 2.8TB 2.5TB 0.7TB 3.6TB 0.2TB 0.3TB
Mopra 0.6TB 2.8TB 2.5TB 0.7TB 3.6TB 0.2TB 0.3TB
Parkes 0.6TB 2.8TB 2.5TB 0.7TB 3.6TB 0.2TB 0.3TB
Hobart 0.6TB 1.4TB 1.3TB ----- 1.8TB 0.2TB 0.3TB
Tidbinbilla ----- 1.0TB ----- ----- ----- ----- -----
Ceduna ----- 1.4TB 1.3TB ----- ----- 0.2TB -----

Totals 2.4TB 12.2TB 10.1TB 2.1TB 12.6TB 1.0TB 1.2TB

Grand total 41.6TB

An overview for each telescope, with comments, is as follows:

vt06b
-----

ATCA 0.6TB at 128 Mbps recorded to removable disks
Mopra 0.6TB at 128 Mbps recorded to removable disks
Parkes 0.6TB at 128 Mbps recorded to removable disks
Hobart 0.6TB at 128 Mbps recorded to 7 x 500 GB xraid disks

Total storage

 1.8 TB removable -> transfer to Sydney
 0.6 TB xraid

 2.4 TB

At the ATCA, Mopra, and Parkes, the data will be recorded to the removable
disks in parallel with recording to S2 tapes. Chris will copy the ATCA,
Mopra, and Parkes data to Sydney via the fibres. After this is done, the
data should be removed from the ATCA, Mopra, and Parkes removable disks
before the removable disks are required for v190b. If the data transfer
back to Sydney has not been completed before this time, the data can be
deleted from the removable disks at the ATCA, Mopra, and Parkes, as the S2
recording is being used as a backup. The data transfer via the fibres is
a test.

At Hobart, the data will be recorded to the set of 7 x 500 GB xraid disks
that is being shipped from Swinburne. These data should stay on these
disks.

v188a
-----

ATCA 2.8TB at 512 Mbps recorded to 14 x 500 GB xraid disks
Mopra 2.8TB at 512 Mbps recorded to 14 x 500 GB xraid disks
Parkes 2.8TB at 512 Mbps recorded to 14 x 500 GB xraid disks
Hobart 1.4TB at 256 Mbps recorded to 4 x 400 GB removable disks
Tidbinbilla 1.0TB at 256 Mbps recorded to 4 x 400 GB removable disks
Ceduna 1.4TB at 256 Mbps recorded to 4 x 400 GB removable disks

Total storage

 8.4 TB xraid
 3.8 TB removable

12.2TB

At the ATCA, Mopra, and Parkes, the data will be recorded to sets of 14 x
500 GB xraid disks. Seven of these disks (7 x 500 GB) will be shipped
from the ATNF - Tasso and Chris are looking after the shipping. The other
seven disks (7 x 500 GB) are being shipped from Swinburne - Craig is
looking after the shipping.

At Hobart, Ceduna, and Tidbinbilla, the data will be recorded to the sets
of removable 4 x 400 GB disks in the recorder machines.

v190a
-----

ATCA 2.5TB at 512 Mbps recorded to 14 x 500 GB xraid disks
Mopra 2.5TB at 512 Mbps recorded to 14 x 500 GB xraid disks
Parkes 2.5TB at 512 Mbps recorded to 14 x 500 GB xraid disks
Hobart 1.3TB at 256 Mbps recorded to 4 x 400 GB removable disks
Ceduna 1.3TB at 256 Mbps recorded to removable disks

Total storage
 7.5TB xraid
 2.6TB removable

10.1 TB

At the ATCA, Mopra, and Parkes, the same sets of 14 x 500 GB disks are
used as used above for v188a. The 2.8TB of v188a + 2.5TB of v190a nicely
matches the 5.4TB capacity of the 14 x 500 GB disks.

At Hobart, a set of 4 x 400 GB removable disks will be used. This is a
spare set of 4 x 400 GB disks from the ATNF that Chris is shipping to
Hobart.

At Ceduna, a set of removable disks will be used. Exactly which set
depends on which sets are available/convenient at Ceduna.

vt07b1
------

ATCA 0.7TB at 512 Mbps recorded to 4 x 400 GB removables
Mopra 0.7TB at 512 Mbps recorded to 4 x 400 GB removables
Parkes 0.7TB at 512 Mbps recorded to 4 x 400 GB removables

Total storage

 2.1TB removables -> deleted/transferred to Sydney

 2.1TB

This is a 64 MHz bandwidth test observation. After the experiment, the
data can be deleted from the disks, following advice from Chris on any
small amount of data that he wants saved. The data will need to be
deleted before the removables are required for v190b.

v190b
-----

ATCA 3.6 TB at 512 Mbps recorded to 14 x 180 GB xraid disks +
                4 x 400 GB removable disks + 2 x 400 GB internal
Mopra 3.6 TB at 512 Mbps recorded to 14 x 180 GB xraid disks +
                4 x 400 GB removable disks + 2 x 400 GB internal
Parkes 3.6 TB at 512 Mbps recorded to 14 x 180 GB xraid disks +
                4 x 400 GB removable disks + 2 x 400 GB internal
Hobart 1.8 TB at 256 Mbps recorded to 7 x 500 GB xraid disks

Total storage

 5.4TB xraid
 4.5TB removables -> some data transferred to internals during experiment
 0.9TB internals -> data transferred from removables. No rec. to int.
12.6TB

At the ATCA, Mopra, and Parkes, data for the first half of the experiment
should be recorded to one set of 7 x 180 GB xraid disks on one recorder
(first 7.5 hrs at 256 Mbps = 0.9TB), while the second recorder records
data to the 4 x 400 GB removable disks (first 7.5 hrs at 256 Mbps =
0.9TB).

As the first half is recording, the first 2.5 hrs of data on the removable
disks should be moved to the internal disks of the same machine, to free
up space on the removables for the second half of the experiment.

On the machine with the xraids mounted, the second set of 7 x 180 GB xraid
disks should be recorded to for the second half of the experiment (second
7.5 hrs at 256 Mbps = 0.9TB). And the recorder with the removables
mounted should record the second half of the experiment to the remaining
space on the removables (second 7.5 hrs at 256 Mbps = 0.9TB).

This is more easily understood from the telescope timelines that I have
sent out.

The xraids for this experiment will all be shipped from Swinburne.

At Hobart the data will be recorded to the same set of 7 x 500 GB xraid
disks that was used for vt06b.

v184a
-----

ATCA 0.2 TB at 32 Mbps recorded to internal disks
Mopra 0.2 TB at 32 Mbps recorded to internal disks
Parkes 0.2 TB at 32 Mbps recorded to internal disks
Hobart 0.2 TB at 32 Mbps recorded to 7 x 500 GB xraid disks
Ceduna 0.2 TB at 32 Mbps recorded to internal disks

Total storage
 0.2TB xraid
 0.8TB internals -> Sydney/Melbourne/La Cie

1.0TB

At the ATCA, Mopra, Parkes, and Ceduna, the data are recorded to the
internal disks. Data from ATCA, Mopra, and Parkes may be transferred to
Sydney or Swinburne via fibres following the experiment.

At Ceduna, a La Cie drive is being shipped from Swinburne. The data
should be recorded to the internal disks and then transferred to the La
Cie drive (along with data for vt08a - see below) and shipped back to
Swinburne after the session.

At Hobart, the data will be recorded to the same set of 7 x 500 GB xraid
disks used for vt06b and v190b.

vt08a
-----

ATCA 0.3 TB at 256 Mbps recorded to internal disks
Mopra 0.3 TB at 256 Mbps recorded to internal disks
Parkes 0.3 TB at 256 Mbps recorded to internal disks
Hobart 0.3 TB at 256 Mbps recorded to 4 x 400 GB removables

Total storage

 0.3TB removables
 0.9TB internal -> La Cie/Sydney

1.2TB

At the ATCA, Mopra, Parkes, and Ceduna, data will be recorded to the
internal drives. Data may be transferred to Sydney or Swinburne from the
ATCA, Mopra, and Parkes via fibres following the experiment.

At Ceduna, the data should be transferred to the La Cie drive shipped from
Swinburne, along with the v184a data (see above). The La Cie should be
shipped to Swinburne following the session.

At Hobart the data will be recorded to the same set of 4 x 400 GB
removable drives that was used for v190a.

##=====================================================##
Dr Steven Tingay stingay_at_astro.<!--nospam-->swin.edu.au
Swinburne SKA Project Leader
Associate Professor

Centre for Astrophysics and Supercomputing
Swinburne University of Technology
Mail No H39
P.O. Box 218, Hawthorn, Vic. 3122, Australia

ph: +61 3 9214 8758
fax: +61 3 9214 8797

http://astronomy.swin.edu.au/ska
##=====================================================##
Received on 2006-05-04 23:01:44