difx:difx-todolist-2011
To-Do and Wish List
High Priority
Cluster configuration file standard definition
Add large (~1 TB) dataset with variety of modes on Data Fabric (CR)
Synchronize data fabric test datasets at several sites. (Bonn, Curtin, NRAO)
Regression testing scripts (AD)
Make general version of NRAO Monitoring GUI, with generic database backend (USNO)
az/el in the calc file, + parallactic angle?
Amplitude correction for primary beam effects for multifield projects
IPP alternatives
Medium Priority
Choose framework for unit testing. Implement test cases (JM)
Certifying that non-power-of-2 FFTs works
vex2difx (or other) support for creating .machines and .threads (from the eVLBI perspective)
Add DiFX diagnostics
Storing the original pointing source somewhere in the FITS file (plus the attendant AIPS changes)
DiFX with ASKAP data (CP)
Add an option in startdifx to loop/wait for a module insertion if it is missing
Add per-IF phase polynomial in the calc file (and delay polynomial, too?)
Documentation
Doxygen of mpifxcorr source - automatically installed locally, also someone mirror to a webserver
Documentation of mpifxcorr internals (buffers etc.)
Documentation Algorithms
parameter optimisation (AD)
monitoring, etc - (list of error codes) (AD) ⇒ LOW
setting up native Mark5 access (WB+)
evlbi
Maintain database of benchmarking results (JM)
Phased array (RS, CR).
visplot (CP, JS)
Investigate sampler stats monitoring (AD/WB/CP)
subband distribution/parallelisation (with VDIF) (AD/CP)
Transition to using band centres instead of band edges (WB)
Baseband data generator for producting test datasets. (WB)
Parallelised calc server / Efficiency gains in CALC (same time, different sources etc)
Store polynomial tau(l, m) generalized delay model in FITS (WB,JM)
Standard way of setting up environment (JM)
Have different environments for building and operation (GC)
Chase up and eliminate the cause of occasional “Somehow Visibility X ended up with Y+1 subintegrations - was expecting only Y” errors
Mixed module and file list on one station
Investigate whether changing maxReadSize to 8MB (or going to 8 MB subreads) fixes the Bonn problem
Low Priority
Play back from both Mk5 banks in parallel (WB)
vex2difx to create an input file setup to be used with vlbi_fake
Complete Support for VDIF on module directories
Refactoring the mpifxcorr/mk5daemon libraries and merging functionality
Move to a binary format for pcal files and name by datastream not by antenna name
vex2 support (relies on vex2 finalization and some support from field systems)
On-the-fly application of calibration (bandpasses etc) with appropriate accountability
Modernize sniffer
cleanup of DiFX error messages
Single process multi-threaded non-mpi program for DiFX-specific CPU benchmarking.
Future proofing via non-prescriptive format (AD)
K5 format support (CP)
Space VLBI
eVLBI gui
Generic startup scripts (CR)
Shifted FT (moving channel boundary to edge of band) (AD)
DiFX2fits uv shifting in trunk (JM/AD)
Migrating to python3.0 (ensure current compatibility with python2.6) (everyone)
Add support for crosscorrelation of non matching sample rates
SVN cleanup
Auditing / refactoring the amplitude scaling
Pulsar predictor support in “polyco”
Get rid of printing to screen in mark5access (change to be called and printed from elsewhere)
Get Eric to improve AIPS PCAL (multi tone)
Improve the runtime predictor (make better use of the new cluster configuration file, better estimate true load)
Review DiFX installation (SCONS, autotools etc.) (JM)
Restitching contiguous zoom bands into wider bands (e.g. for ALMA)
difx/difx-todolist-2011.txt · Last modified: 2015/10/21 10:08 by 127.0.0.1