User Tools

Site Tools


difx:difx-todolist-2017

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

difx:difx-todolist-2017 [2018/09/06 00:38] (current)
helgerottmann created
Line 1: Line 1:
 +===== To-Do and Wish List =====
 +
 +== Before the end of the week ==
 +  * Clock units in vex2difx
 +     * progress: confirmed even newest FS vex library has no support for usec/sec units
 +     * progress: vex2difx currently behaves ligitimately -- no changes required
 +     * plan: <del>Ask Ed to add this.</del> Status: currently, according to vex2 doc, a "time1/time2" unit must have time1 > time 2.  Ed seems happy to relax this stipulation, perhaps even for vex1.5  (WFB)
 +  * Ensure that all files have been updated to reflect the new license. (Adam)
 +  * Testing architecture:
 +     * <del>make link available</del>
 +     * testing IPP setup
 +     * Jenkins -> vlbi-mgr.ira.inaf.it:8080 - login using Google credentials. (Matteo, John)
 +     * Make test datasets useable again (v2d files, etc.)
 +  * Documentathon with emphasis on inner workings (all)
 +  * Single read of .input .calc .im .threads .binconfig .polyco (phased array) file by manager then distribute...  (Adam)
 +  * <del>polConvert=true in .v2d to avoid needing --force in vex2difx (Walter)</del>
 +  * Mark6 workflow / file list / group handing plan (WFB, JJ, MW, JW)
 +  * <del>vex2difx switch to allow calculation of autocrosspols from multi-datastream antennas (Adam) </del>
 +  * <del>Add checkmpifxcorr to startdifx (Geoff)</del>
 +  * Update the utils page to show what package supplies each tool (all)
 +    * Reconsider the approach...
 +  * Update the pdf documentation for currently undocumented tools, and update pdf to version 2.5 (Adam, WFB)
 +  * <del>Update the wiki documentation on how to check out just trunk and current releases (Cormac)</del>
 +  * <del>Update the wiki documentation on tagging guidelines (Adam)</del>
 +  * Investigate whether merging pcal plotting tools is possible (Jan)
 +  * Documentation of polconvert on the wiki (Cormac)
 +    * Awaiting test data from Parkes
 +  * <del>Put up a plan for how to arrange next meeting (Adam) </del>
 +  * Investigate whether it is possible to have svn automatically emit a reminder to sign up to the mailing list when someone checks out code (Geoff)
 +    * Not trivial
 +    * Put in install-difx and difxbuild
 +  * <del>Add mount type override to vex2difx if it doesn't already exist (Walter)</del>
 +  * Contact Eric Greisen regarding support for 11,12,21,22 "stokes" type in FITS-IDI (Mark K.)
 +  * Get additional information regarding polconvert into FITS file history via difx2fits (Walter + Geoff)
 +    * <del>Implement general .difx/*.history file absorption in difx2fits (Walter)</del>
 +    * Generate .difx/polconvert.history file (Geoff)
 +  * Ocean loading: index by position rather than antenna name/code (Walter? + David Gordon)
 +    * Generally improve this experience
 +
 +== High Priority ==
 +  * Add fuse mounting support in mk5daemon/mk6daemon (MW)
 +  * <del>Look into treating single thread VDIF as interlaced VDIF (WB)</del>
 +    * Add warning to vex2difx to wean people off single-thread
 +  * Adding difxmessage support into fusemk6/vdifuse/jive5ab (JW)
 +  * <del>dirlist: parse Mark6.slist file (Walter)</del>
 +    * Mark W to confirm
 +  * Implement group/filelist handling for fuse-mounted Mark6 data (JJ, MW)
 +  * Regression testing scripts (send new datasets to Matteo)
 +    * Plan: Matteo investigate Jenkins
 +    * A more sophisticated pipeline than just diffDiFX?
 +    * Target size: 10G
 +    * Look for VDIF, Mark5B, LBA, zoom ...
 +  * vex2 support (relies on vex2 finalization and some support from field systems)
 +    * document almost complete
 +    * vex parser is almost complete
 +    * Support for $BITSTREAMS largely complete in vex2difx
 +    * Plan: finalise, test
 +
 +== Medium Priority ==
 +  * GPU acceleration of the DiFX core code
 +    * Adam to rerun tests once new architecture.h.in is available
 +    * Chris to do some controlled (small-scale) benchmarking
 +  * <del>Mount types in difxio/antenna_db, mainly to allow Nasmyth mounts to be handled properly (Walter)</del>
 +  * Add DiFX diagnostics
 +  * Documentation
 +    * Putting doxygen of mpifxcorr source on a webserver (link to this from the DiFX wiki if completed: Geoff)
 +  * Maintain database of benchmarking results
 +    * at least the regression tests
 +    * Even better, using fake data also 
 +  * visplot (CP, JS)
 +  * Investigate sampler stats monitoring (WB to dump out into .difx/ dir)
 +  * subband distribution/parallelisation (with VDIF) (AD/CP)
 +    * replumbing/refactoring vex2difx setup
 +  * Transition to using band centres instead of band edges (WB)
 +  * Cleanly separate data format and data source
 +  * Option for zero-padded FFT
 +
 +== Low Priority ==
 +  * evlbi
 +    * reconnection/long term drop-outs (CP)
 +    * reliability with UDP data (CP)
 +    * real-time delay/rate adjustment (CP)
 +  * Store polynomial tau(l, m) generalized delay model in FITS (WB,JM)
 +  * IF selection in difx2fits
 +  * addZoomFreq in the SETUP section (applies to all antennas)
 +  * Document Algorithms
 +    * monitoring, etc - (list of error codes) (AD)
 +  * Still produce one FITS file even when there was a clock change during the correlation
 +  * Refactoring the mpifxcorr/mk5daemon libraries and merging functionality
 +  * Move to a compressed text format for pcal files 
 +  * Modernize sniffer
 +  * cleanup of DiFX error messages (appropriate verbosity level everywhere)
 +  * Shifted FT (moving channel boundary to edge of band) (AD)
 +  * DiFX2fits uv shifting in trunk (JM/AD)
 +  * Pulsar predictor support in "polyco"
 +  * Get rid of printing to screen in mark5access (change to be called and printed from elsewhere)
 +  * Get Eric to improve AIPS PCAL (multi tone) - underway now
 +
 +== Fantasy wishlist ==
 +  * Choose framework for unit testing. Implement test cases.
 +  * Phased array
 +  * Add per-IF phase polynomial in the calc file (and delay polynomial, too?)
 +  * On-the-fly application of calibration (bandpasses etc) with appropriate accountability
 +  * Space VLBI
 +    * Baseline dependent averaging
 +  * Auditing / refactoring the amplitude scaling
 +  * Restitching contiguous zoom bands into wider bands (e.g. for ALMA): Jan has an implementation of difx2difx!
 +  * Expand/improve difxmessage
 +  * Two-stage FFT option for very large FFTs (e.g. when using 2 GHz wide bands)
 +
  
difx/difx-todolist-2017.txt · Last modified: 2018/09/06 00:38 by helgerottmann