User Tools

Site Tools


difx:utils

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
difx:utils [2017/10/18 18:13]
helgerottmann
difx:utils [2019/09/12 11:52]
chrisphillips
Line 13: Line 13:
   * ''difx2mark4'' : Takes the output of ''mpifxcorr'' and generates Mark4 format files   * ''difx2mark4'' : Takes the output of ''mpifxcorr'' and generates Mark4 format files
   * ''difx2profile'' : Takes the output of ''mpifxcorr'' and averages data of all antennas over the entire time, in preparation of ''profile2binconfig.py''. Related to pulsar processing.   * ''difx2profile'' : Takes the output of ''mpifxcorr'' and averages data of all antennas over the entire time, in preparation of ''profile2binconfig.py''. Related to pulsar processing.
-  * ''calcif2'' : Takes ''.calc'' file made by ''vex2difx'' and produces the delay model (''.im'') file+  * ''difxcalc'' : Takes ''.calc'' file made by ''vex2difx'' and calculates delay model (''.im'') file using built-in CALC 11 model 
 +  * ''calcif2'' : Wrapper for ''difxcalc'' or ''CalcServer'' Being phased out along with ''CalcServer'' in favor of ''difxcalc''
   * ''CalcServer'' : A service that makes calls to the CALC program (Calc9) upon request by an RPC call, easiest started with ''startCalcServer''.   * ''CalcServer'' : A service that makes calls to the CALC program (Calc9) upon request by an RPC call, easiest started with ''startCalcServer''.
-  * ''difxcalc'' : creates .im model (based on Calc11) from .calc files. Replaces the CalcServer. 
  
 == DiFX Operations == == DiFX Operations ==
  
-  * ''difxcopy'' : Copies DiFX output to another directory and updates internal path references (e.g. in ''.input'') accordingly.+  * ''difxcopy'' : Copies DiFX output to another directory and updates internal path references (e.g.in ''.input'') accordingly
 +  * ''mvdifxhere'' : Moves a DiFX fileset from a given path to the local directory, updating internal paths.
   * ''difxlog'' : Captures multicast status and messages from a running DiFX job and writes to a text file   * ''difxlog'' : Captures multicast status and messages from a running DiFX job and writes to a text file
   * ''difxsniff'' : Concattenates as appropriate output sniffer files from ''mpifxcorr'' and plots using ''plotwt'', ''plotapd'' and ''plotbp''   * ''difxsniff'' : Concattenates as appropriate output sniffer files from ''mpifxcorr'' and plots using ''plotwt'', ''plotapd'' and ''plotbp''
   * ''filteredDifx2Fits'' : Prepare difx2fits jobs based on source, timerange and/or mode.   * ''filteredDifx2Fits'' : Prepare difx2fits jobs based on source, timerange and/or mode.
-  * ''genmachines''Determines location of Mark5 modules via request to ''mk5daemon'' processes and makes ''.threads'' and ''.machines'' files+  * ''genmachines''Makes ''.threads'' and ''.machines'' files depending on the data location and type (file, network, mark5, mark6)
   * ''geteop.pl'' : Script to obtain EOP values from GSFC servers in VEX $EOP format.   * ''geteop.pl'' : Script to obtain EOP values from GSFC servers in VEX $EOP format.
   * ''makefits'' : Simplified wrapper interface for ''difx2fits'', tailored to NRAO's usage   * ''makefits'' : Simplified wrapper interface for ''difx2fits'', tailored to NRAO's usage
Line 29: Line 30:
   * ''startdifx'' : Command line utility to start ''mpifxcorr''   * ''startdifx'' : Command line utility to start ''mpifxcorr''
   * ''stopdifx'' : Command line utility to stop a single running instance of ''mpifxcorr''   * ''stopdifx'' : Command line utility to stop a single running instance of ''mpifxcorr''
-  * ''vexpeek'' : Program that reads a ''.vex'' file and prints the project name and list of stations and the time period each observed; used by ''db2vex''+  * ''vexpeek'' : Program that reads a ''.vex'' file and prints the project name and list of stations and the time period each observed
   * ''vlog'' : Splits up a TSM style text log file into ''pcal'', ''weather'', ''tsys'' and ''flags'' files; mainly for VLBA operations   * ''vlog'' : Splits up a TSM style text log file into ''pcal'', ''weather'', ''tsys'' and ''flags'' files; mainly for VLBA operations
   * ''[[startcorr.pl]]'' : Simple DiFX launcher, with eVLBI support   * ''[[startcorr.pl]]'' : Simple DiFX launcher, with eVLBI support
Line 52: Line 53:
   * ''vsum'' : Prints summary information about a vdif file. Can produce filelist to be digested by vex2difx   * ''vsum'' : Prints summary information about a vdif file. Can produce filelist to be digested by vex2difx
   * ''vmux'' : A program to take a multi-thread VDIF file and multiplex into a multi-channel, single thread file   * ''vmux'' : A program to take a multi-thread VDIF file and multiplex into a multi-channel, single thread file
-  * ''printVDIFheader'' : A program to dump some basic info about VDIF packets to the screen+  * ''printVDIFheader'' : A program to dump some basic info about VDIF packets, including extended VDIF header information, to the screen
   * ''printVDIFgaps'' : A program to look for missing VDIF packets   * ''printVDIFgaps'' : A program to look for missing VDIF packets
   * ''printVDIF'' : A program to dump some basic info about VDIF packets to the screen   * ''printVDIF'' : A program to dump some basic info about VDIF packets to the screen
Line 77: Line 78:
      
   * ''m5test'' : Reads through a baseband data file looking for missing or damaged frame headers   * ''m5test'' : Reads through a baseband data file looking for missing or damaged frame headers
-  * ''m5tsys'' : Extracts switched power from a baseband data file (rather, it extracts Pon and Poff for each sampled channel)+  * ''m5tsys'' : Extracts switched power from a baseband data file (it extracts Pon and Poff for each sampled channel).  The extracted values can be converted to system temperature (tsys) when combined with cal temperature data.
      
  
Line 87: Line 88:
 == Phasecal tools == == Phasecal tools ==
   * ''m5pcal'' : Extracts pulse cals from a baseband data file   * ''m5pcal'' : Extracts pulse cals from a baseband data file
-  * ''plotpcal'' : Versatile P-Cal tone plotting utility, with multiband delay estimation. +  * ''plotpcal'' : Versatile P-Cal tone plotting utility, with multiband delay estimation.  This is more or less unmaintained and is being superceded by ''plotpcal2''
-  * ''plotpcal2''?+  * ''plotpcal2''Faster, more capabile version of ''plotpcal''.
   * ''plotDiFXPCal.py'' : Fast P-Cal tone plotting utility, with multiband delay estimation within and accross bands, PDF export.   * ''plotDiFXPCal.py'' : Fast P-Cal tone plotting utility, with multiband delay estimation within and accross bands, PDF export.
  
Line 102: Line 103:
   * ''polswapDiFX.py'' : Swap polarization labels in DiFX .difx output file for specified station(s).   * ''polswapDiFX.py'' : Swap polarization labels in DiFX .difx output file for specified station(s).
   * ''difx2difx.py'' : Take DiFX output and un-zoom selected zoombands into new contiguous bands   * ''difx2difx.py'' : Take DiFX output and un-zoom selected zoombands into new contiguous bands
 +  * ''stripantennaDiFX.py'' : Make a copy of DiFX output, keeping or removing all visibilities on baselines to certain antennas. FIXME: document in user guide
    
 == DiFX Testing == == DiFX Testing ==
Line 119: Line 121:
   * ''mk5daemon'' : If invoked with -6 option will handle Mark6 operations e.g. module mounting on keyturn etc.   * ''mk5daemon'' : If invoked with -6 option will handle Mark6 operations e.g. module mounting on keyturn etc.
   * ''m6sg_mount'' : (Un)mount any inserted Mark6 modules   * ''m6sg_mount'' : (Un)mount any inserted Mark6 modules
 +  * ''scan_check'' : Examine a mark6 file (either sg fragments or fused-VDIF) and report issues
    
 == Mark5 Operations == == Mark5 Operations ==
Line 160: Line 163:
 == Libraries for developers == == Libraries for developers ==
  
- * Python module ''difxdb'' : ... +  * Python module ''difxdb'' : ... 
- * Python module ''difxfile'' :  ... +  * Python module ''difxfile'' :  ... 
- * Python module ''difxutil'' :  ... +  * Python module ''difxutil'' :  ... 
- * Python module ''mark5access'' :  ... +  * Python module ''mark5access'' :  ... 
- * C library ''mark5access'' : decode VDIF and older raw data formats+  * C library ''mark5access'' : decode VDIF and older raw data formats
  
 == Other == == Other ==
  
   * ''dedisperse_difx'' : FIXME: document in user guide   * ''dedisperse_difx'' : FIXME: document in user guide
difx/utils.txt · Last modified: 2019/09/12 11:52 by chrisphillips