[askap-users] Changes to galaxy access for ASKAP science teams
- Contemporary messages sorted: [ by date ] [ by thread ] [ by subject ] [ by author ] [ by messages with attachments ]
From: <Aidan.Hotan_at_email.protected>
Date: Wed, 7 Nov 2018 07:21:30 +0000
Greetings all,
As many of you will know, the ASKAP pilot survey operations plan involves switching from a user-based processing model to a service-observing model where the observatory operations team handles the calibration and imaging of most observations. We are beginning this transition process, but the full shift will not occur until next year.
As part of the validation and verification work being carried out on the ASKAPsoft imaging package and related systems the ASKAP project is preparing to perform a full scale test of the imaging pipeline codes. This will require a reservation of all CPU nodes of galaxy from 12 November to 19 November. During this time ASKAPsoft will be used by the software development team to process data taken with the ASKAP-28 array at full spectral resolution. These data are large enough to exercise the imaging pipeline to the point where it will occupy galaxy's entire compute capacity. Several runs of this test will be required to explore the parameter space for optimisations and comparison purposes.
The reservation is made for all-of-galaxy to both acquire the necessary resources for a full scale test and to ensure a "single user" environment where all impacts due to other users could be discounted. ASKAP users will regain access to the galaxy work queue once this reservation is complete, however, from time to time during the next two months further large reservations will be required as this validation and verification work continues.
We will keep everyone informed about the progress of these large-scale tests and continue to discuss preferred processing strategies with the science teams in the lead-up to pilot surveys next year.
Best regards,
Aidan.
Received on 2018-11-07 18:21:32
Date: Wed, 7 Nov 2018 07:21:30 +0000
Greetings all,
As many of you will know, the ASKAP pilot survey operations plan involves switching from a user-based processing model to a service-observing model where the observatory operations team handles the calibration and imaging of most observations. We are beginning this transition process, but the full shift will not occur until next year.
As part of the validation and verification work being carried out on the ASKAPsoft imaging package and related systems the ASKAP project is preparing to perform a full scale test of the imaging pipeline codes. This will require a reservation of all CPU nodes of galaxy from 12 November to 19 November. During this time ASKAPsoft will be used by the software development team to process data taken with the ASKAP-28 array at full spectral resolution. These data are large enough to exercise the imaging pipeline to the point where it will occupy galaxy's entire compute capacity. Several runs of this test will be required to explore the parameter space for optimisations and comparison purposes.
The reservation is made for all-of-galaxy to both acquire the necessary resources for a full scale test and to ensure a "single user" environment where all impacts due to other users could be discounted. ASKAP users will regain access to the galaxy work queue once this reservation is complete, however, from time to time during the next two months further large reservations will be required as this validation and verification work continues.
We will keep everyone informed about the progress of these large-scale tests and continue to discuss preferred processing strategies with the science teams in the lead-up to pilot surveys next year.
Best regards,
Aidan.
Received on 2018-11-07 18:21:32