User Tools

Site Tools


difx:difx-todolist-2011

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Next revision
Previous revision
difx:difx-todolist-2011 [2012/09/25 16:40]
chrisphillips created
difx:difx-todolist-2011 [2015/10/21 10:08] (current)
Line 1: Line 1:
 +
 ===== To-Do and Wish List ===== ===== To-Do and Wish List =====
  
Line 5: Line 6:
     * Adapting various clients (genmachines / threads) to make use of cluster definition file     * Adapting various clients (genmachines / threads) to make use of cluster definition file
   * Add large (~1 TB) dataset with variety of modes on Data Fabric (CR)   * Add large (~1 TB) dataset with variety of modes on Data Fabric (CR)
-    * Regression testing scripts +    ​* Synchronize data fabric test datasets at several sites. (Bonn, Curtin, NRAO) 
-  * Make general version of NRAO Monitoring GUI, with generic database backend (USNO) +    ​* Regression testing scripts ​(AD) 
-  * Choose framework for unit testing. Implement test cases (JM) +  * <del>Make general version of NRAO Monitoring GUI, with generic database backend (USNO)</​del>​ 
-  * az/el in the calc file, + parallactic angle?+  * <del>az/el in the calc file, + parallactic angle?</​del>​
   * Amplitude correction for primary beam effects for multifield projects   * Amplitude correction for primary beam effects for multifield projects
-  * Support for VDIF on module directories +  * IPP alternatives 
-  * <​del>​Restarting a correlation that has died mid-job</​del>​ +
-  * <​del>​Support for zoom band in vex2difx, difx2fits, difxio (WB)</​del>​+
  
 == Medium Priority == == Medium Priority ==
-  * Certifying that non-power-of-2 FFTs works +  * Choose framework for unit testing. Implement test cases (JM) 
-  * vex2difx (or other) support for creating .machines and .threads (from the eVLBI perspective)+  * <del>Certifying that non-power-of-2 FFTs works</​del>​ 
 +  * <del>vex2difx (or other) support for creating .machines and .threads (from the eVLBI perspective)</​del>​
   * Add DiFX diagnostics   * Add DiFX diagnostics
   * Storing the original pointing source somewhere in the FITS file (plus the attendant AIPS changes)   * Storing the original pointing source somewhere in the FITS file (plus the attendant AIPS changes)
-  * DiFX with ASKAP data (CP) +  * <del>DiFX with ASKAP data (CP)</​del>​ 
-  * Add an option in startdifx to loop/wait for a module insertion if it is missing+  * <del>Add an option in startdifx to loop/wait for a module insertion if it is missing</​del>​
   * Add per-IF phase polynomial in the calc file (and delay polynomial, too?)   * Add per-IF phase polynomial in the calc file (and delay polynomial, too?)
   * Documentation   * Documentation
     * Doxygen of mpifxcorr source - <​del>​automatically installed locally</​del>,​ also someone mirror to a webserver     * Doxygen of mpifxcorr source - <​del>​automatically installed locally</​del>,​ also someone mirror to a webserver
-    * Documentation of mpifxcorr internals (buffers etc.)+    * <del>Documentation of mpifxcorr internals (buffers etc.)</​del>​
   * Documentation Algorithms   * Documentation Algorithms
-    * parameter optimisation (AD) +    * <del>parameter optimisation (AD)</​del>​ 
-    * monitoring, etc - (list of error codes) (AD) +    * monitoring, etc - (list of error codes) (AD)  => LOW 
-    * setting up native Mark5 access (WB+)+    * <del>setting up native Mark5 access (WB+)</​del>​
   * evlbi   * evlbi
     * reconnection/​long term drop-outs (CP)     * reconnection/​long term drop-outs (CP)
     * real-time delay/rate adjustment (CP)     * real-time delay/rate adjustment (CP)
-  * vex2difx to create an input file setup to be used with vlbi_fake ​ 
-  * Synchronize data fabric test datasets at several sites. (Bonn, Curtin, NRAO) 
   * Maintain database of benchmarking results (JM)   * Maintain database of benchmarking results (JM)
-  * Phased array (RS, CR). +  * Phased array (RS, CR).  
-  * visplot (Aquib)+  * visplot (CP, JS)
   * Investigate sampler stats monitoring (AD/WB/CP)   * Investigate sampler stats monitoring (AD/WB/CP)
   * subband distribution/​parallelisation (with VDIF) (AD/CP)   * subband distribution/​parallelisation (with VDIF) (AD/CP)
     * replumbing/​refactoring vex2difx setup     * replumbing/​refactoring vex2difx setup
-  * Play back from both Mk5 banks in parallel (WB) 
   * Transition to using band centres instead of band edges (WB)   * Transition to using band centres instead of band edges (WB)
   * Baseband data generator for producting test datasets. (WB)   * Baseband data generator for producting test datasets. (WB)
   * Parallelised calc server / Efficiency gains in CALC (same time, different sources etc)   * Parallelised calc server / Efficiency gains in CALC (same time, different sources etc)
   * Store polynomial tau(l, m) generalized delay model in FITS (WB,JM)   * Store polynomial tau(l, m) generalized delay model in FITS (WB,JM)
-  * Standard way of setting up environment (JM) +  * <del>Standard way of setting up environment (JM)</​del>​ 
-  * Have different environments for building and operation (GC) +  * <del>Have different environments for building and operation (GC)</​del>​
-  * <​del>​Resurrect the tweakIntTime option</​del>​+
   * Chase up and eliminate the cause of occasional "​Somehow Visibility X ended up with Y+1 subintegrations - was expecting only Y" errors   * Chase up and eliminate the cause of occasional "​Somehow Visibility X ended up with Y+1 subintegrations - was expecting only Y" errors
   * Mixed module and file list on one station   * Mixed module and file list on one station
-  * Investigate whether changing maxReadSize to 8MB (or going to 8 MB subreads) fixes the Bonn problem +  * <del>Investigate whether changing maxReadSize to 8MB (or going to 8 MB subreads) fixes the Bonn problem</​del>​ 
-  * Restitching contiguous zoom bands into wider bands (e.g. for ALMA)+
  
 == Low Priority == == Low Priority ==
 +  * Play back from both Mk5 banks in parallel (WB)
 +  * vex2difx to create an input file setup to be used with vlbi_fake ​
 +  * Complete Support for VDIF on module directories
   * Refactoring the mpifxcorr/​mk5daemon libraries and merging functionality   * Refactoring the mpifxcorr/​mk5daemon libraries and merging functionality
   * Move to a binary format for pcal files and name by datastream not by antenna name   * Move to a binary format for pcal files and name by datastream not by antenna name
Line 60: Line 60:
   * Modernize sniffer   * Modernize sniffer
   * cleanup of DiFX error messages   * cleanup of DiFX error messages
-  * Single process multi-threaded non-mpi program for DiFX-specific CPU benchmarking. +  * <del>Single process multi-threaded non-mpi program for DiFX-specific CPU benchmarking.</​del>​ 
-  * Future proofing via non-prescriptive format (AD)+  * <del>Future proofing via non-prescriptive format (AD)</​del>​
   * K5 format support (CP)   * K5 format support (CP)
   * Space VLBI   * Space VLBI
-    * Orbit model+    * <del>Orbit model</​del>​
     * Baseline dependent averaging     * Baseline dependent averaging
   * eVLBI gui   * eVLBI gui
-  * IPP alternatives 
   * Generic startup scripts (CR)   * Generic startup scripts (CR)
     * Documentation of startup philosophy     * Documentation of startup philosophy
   * Shifted FT (moving channel boundary to edge of band) (AD)   * Shifted FT (moving channel boundary to edge of band) (AD)
   * DiFX2fits uv shifting in trunk (JM/AD)   * DiFX2fits uv shifting in trunk (JM/AD)
-  * Migrating to python3.0 (ensure current compatibility with python2.6) (everyone) +  * <del>Migrating to python3.0 (ensure current compatibility with python2.6) (everyone)</​del>​ 
-  * Add support for crosscorrelation of non matching sample rates +  * <del>Add support for crosscorrelation of non matching sample rates</​del>​ 
-  * SVN cleanup+  * <del>SVN cleanup</​del>​
   * Auditing / refactoring the amplitude scaling   * Auditing / refactoring the amplitude scaling
-  * pulsar ​predictor support in "​polyco"​+  * Pulsar ​predictor support in "​polyco"​
   * Get rid of printing to screen in mark5access (change to be called and printed from elsewhere)   * Get rid of printing to screen in mark5access (change to be called and printed from elsewhere)
   * Get Eric to improve AIPS PCAL (multi tone)   * Get Eric to improve AIPS PCAL (multi tone)
   * Improve the runtime predictor (make better use of the new cluster configuration file, better estimate true load)   * Improve the runtime predictor (make better use of the new cluster configuration file, better estimate true load)
-  * Review DiFX installation (SCONS, autotools etc.) (JM) +  * <del>Review DiFX installation (SCONS, autotools etc.) (JM)</​del>​ 
 +  * Restitching contiguous zoom bands into wider bands (e.g. for ALMA)
difx/difx-todolist-2011.txt · Last modified: 2015/10/21 10:08 (external edit)