-------------------------------------------------------------------------------
v2_4_3 (2018-03-16; DRL)

RY (2018-03-16)
Fix MaSTAR disp and predisp being declared as long integers

(2018-03-15; BAC)
Added new fault status generation for cases of frozen IDL

-------------------------------------------------------------------------------
v2_4_2 (2018-03-08; DRL)

DRL (2018-03-08)
Fix a fiber masking bug in wavelength tweakup to skylines.

-------------------------------------------------------------------------------
v2_4_1 (2018-03-08; DRL)

RY (2018-03-07)
Check for entirely-zero ivar for stars in mdrp_fluxcal.
Flag MaSTAR stars with low SNR.

-------------------------------------------------------------------------------
v2_4_0 (2018-03-05; DRL)

DRL (2018-03-02)
Change bright line ivar weighting in camera combine; instead of using
simple cuts using a SNR throttling to SNR=50 instead (only for weights
in bspline combination).

DRL (2018-03-01)
Add some additional ability to write out sdssprocced images using
/writefiles flag.

RY (2018-01-26)
Flag spectra based on visual inspection. The info is passed through bogey_mastar.par file in mangacore.

RY, DRL (2018-01-15)
MaStar: 
Propagate several DRP3QUAL bitmask to MASTAR_QUAL bitmask, moved BADHELIORV to MASTAR_QUAL. 
Flag flux calibration problem in MASTAR_QUAL according to blue/red throughput ratio, 
which are mostly due to heavy extinction in the disk. 
Propagate the plate-level bits (POORCAL and BADHELIORV) down to individual exposures, change
the per MJD quality flag to an AND product of the exposures, and the overal MSTRQUAl in the 
output header to an OR product of the exposueres.

RY (2018-01-11)
MaStar: take out the low order differences in the spectra among exposures before combining them together to form the spectrum 
for a given MJD; pixel mask propagated more meaningfully.

DRL (10-27-17)
Allow bolton_biassub to do row-by-row bias subtraction if the BIASRROW keyword
is set using hdrfix for a given camera.

-------------------------------------------------------------------------------
v2_3_1 (2017-10-10; DRL)

RY (2017-10-09)
Fix bug in mastar plotting routines causing a crash.

-------------------------------------------------------------------------------
v2_3_0 (2017-10-07; DRL)

BAC (2017-09-19)
Added loading of the DAPall file into the manga dapdb loading scripts

DRL (2017-09-19)
Switch flux calibration to BOSZ template.

DRL,RY (2017-09-19)
Merge back in the deredshift branch.
This splits out special mastar processing into mdrp_mastar from mdrp_reduceoneifu.
mdrp_mastar measures the stellar radial velocity in each exposure, averages it across
exposures, applies the rv shift to the mgFFrame data, and redoes the camera combination
using the new wavelength solution so that the mastar results contain the rest-frame
stellar spectra.
Additionally revise the skylines used for mastar wavelength adjustment to eliminate
two that cannnot be seen in bright sky conditions.

RY (2017-09-04)
Merge back in the smoothcal branch.
- Updated definitions of telluric regions and stellar absorption features
   in masking of spectra for parameter fitting and for bspline.
- Adopt high frequency bspline fitting in telluric regions but very low
  frequencey bspline fitting outside telluric regions.
- Changed the initial throughput curves in flux calibration which
    includes a fixed higher order (10 pixel) correction.

BAC (2017-08-25)
Added in new z column into drpall file
Switched runmanga to skip 3d stage reductions when nomini set
Added many debugging prints to log for pipeline runs

DRL,RY,YC (2017-08-21)
Merge back in the drljul17 branch.
Many changes to LSF handling:
- Create and save pre-pixellized and post-pixellized versions.
- Use gaussian comb measurements to deal with camera combination.
Sky subtraction changes:
- Fixed issue with negative ivar in sky model from bspline extrapolation
- Relax outlier rejection in sky fibers for mastar.
- Create qa images of sky subtracted frames
Flux calibration changes:
- Move to using flux cal templates on the SAS at MANGA_SPECTRO_TEMPLATES
- Add BOSZ model and larger Kurucz model
- Change pixel integration to match prior changes
Other:
- Changes to accomodate short-exposure X-shooter plate through mgCFrame
- Fix scattered light triggering for very bright mastar plates.
- Add handling for dead cameras; ignore them until mgCFrame, and then
use dummy files as placeholders for missing cameras.
- Lower FULLCLOUD criteria for mastar

BAC (2017-08-02)
Added nomini option into runmanga 

BAC (2017-07-19)
Added volume weights into drpall code

DRL (2017-06-01)
Revise fiber masking threshhold in sky subtraction to 49% from 50%

-------------------------------------------------------------------------------
v2_2_0 (2017-05-05; DRL)

DRL (2017-05-04)
Add matching to MANGA_SINGLE in ml_fixplateholes

BAC (2017-03-28)
Updated platelist to fill in ifu info on null rows and updated drpall
to remove null rows

BAC (2017-03-16)
Updating runmanga, platelist, and statuschecks to fix python errors which
relate to early attempts to write/access the final platelist file

DRL (2017-03-02)
Merge back into trunk the RY branch chksatu.
Mask saturated pixels in spectra.
Propagated more info to the final mastar spectra.
Add QA plot for the 3d stage of MaStar reduction.

DRL (2017-02-21)
Replace sort() with bsort() in many places to avoid reordering identical values.
Add expnum seed to random number generator in flux calibration.
Double precision in scattered light routine.

BAC (2017-02-12)
Bugfix dosMarkExposure to update the FITS logfile correctly
Updated MJD and plate filtering in runManga and plateList codes

DRL (2017-02-07)
Merge back into trunk the drldec2016 branch.  This overhauls AND/OR mask
combination system during camera combination to be much better.  Added
interpolation for LSF values over masked points.
Improves default wavelength coefficient 0 in the traceset for science frames,
using poly fit to difference between arc and science instead of just poly
fit to the science frame, which improves rate of failed wavelength
calibrations.  Improves fitvacset.pro
Improve rejection of bad sky fibers, tweak handling of ivar weights near
ultra-bright lines with a hack on fluxes
Improves wavelength zeropoint and LSF in the far blue by modifying the arclamp
line list to reject visibly poor quality lines.
Turns LSF cube and correlation matrices back on.

BAC (2017-02-01)
checking in standalone dosMakeCMM code to test and debug standalone issues
fixing bugs in DOS CMM code preventing DOS from svn adding

-------------------------------------------------------------------------------
v2_1_1 (2017-01-02; DRL)

DRL (2017-01-02)
Revert to platedesign v2_52, newer version requires further testing.

-------------------------------------------------------------------------------
v2_1_0 (2016-12-28; DRL)

DRL (2016-12-28)
Merge back into trunk the coma_v9 branch, which handles the Coma program nod-sky
frames gracefully, in addition to applying some different sky algorithms for
the Coma dark plates.

BAC (2016-12-14)
Updated DOS with CMM code that works

DRL (2016-12-08)
Turn off LSF cube and correlation matrices in 3d cubes.
This is a *temporary* tweak for DR14 for consistency with DR13 data model.

DRL (2016-10-07)
Modify some commented-out code in mdrp_ccpeaks and ml_ccadjustblocks to make
regenerating opfiles easier.

DRL (2016-09-27)
Check on exposure quality in ml_selectmanga

DRL (2016-09-12)
Update b2 gain in sdssproc.
Turn off crazy-quadrant bias routine in bolton_biassub after MJD 56895.

DRL (2016-08-18)
Change default tmp.ps plot behaviour in mdrp_eam to avoid collisions
in parallelized 3d code.

DRL (2016-08-05)
Flag MANYDEAD in DRP3QUAL if more than 10 fibers per ifu exposure
have NODATA set.  MANYDEAD for dark-time observations also
triggers CRITICAL bit in DRP3QUAL.

DRL (2016-07-13)
Include a DISP cube in LOGCUBE and LINCUBE.

RY (2016-07-12)
Merged back newtemplate branch which uses Munari flux calibration templates
and improves systematic calibration in the blue.

DRL (2016-07-11)
Include drill temperature in slitmaps, pass to mdrp_readdrillfiles

DRL (2016-06-13)
Pass temperatures to mdrp_readdrillfiles.

-------------------------------------------------------------------------------
v2_0_1 (2016-05-24; DRL)

DRL (2016-05-24)
Add checks to ml_importcmm to catch APOGEE-S plates.

-------------------------------------------------------------------------------
v2_0_0 (2016-05-24; DRL)

DRL (2016-05-20)
Retire VALIDFILE bit from all usage

DRL (2016-05-19)
Add mjdmax keyword to 3d pipeline.  It will now ignore all mjd > mjdmax
when creating the planfile, which will allow us to deal with new
checkins to mangacore by APO after an MJD cutoff for our reductions.

DRL (2016-05-09)
Make EAM ignore known foreground stars

DRL (2016-05-03)
Change mdrp_fitarcimage to use a slightly different line mask for final
fits; return that mask so that the v-groove delamination QA routine
in mdrp_calib doesn't get confused by bogus fits (should only be using
real fits).
Put defaults in for airmass and hour angle keywords in mgFrame to
handle fitsverify errors on daytime cals.

BAC (2016-05-01)
Bugfix in mdrp_quicksn2 on mangaredmed indexing

DRL (2016-04-29)
Change DOS extractions to apply superflat, and use 1.75 pixel
extraction radius.
Change DOS and DRP to put mangaredmed into the slitmap headers,
and use this value in calculating dereddened SN2.
Introduce NOGUIDER bit into DRP2QUAL- this is a fatal bit.

DRL (2016-04-21)
Change from covariance IDL-form sparse matrices
to DAP-form sparse correlation matrices.  GCORREL, RCORREL,
ICORREL, ZCORREL.

DRL (2016-04-19)
Incorporate covariance calculation into ml_griddata.pro
Cubes now contain extensions GCOVAR, RCOVAR, ICOVAR, ZCOVAR
with sparse matrix structures in the griz image slices.

DRL (2016-03-31)
Overhaul ml_mwrfits to make header checksums happier
(mwrfits likes to mess up formats by padding lines)

DRL (2016-03-18)
Change all RADESYSa to RADESYS

DRL (2016-03-14)
Fix major bug in psfparam creating reference PSF
(previously used psfparam of last exposure)

DRL (2016-03-08)
Fix MNGTRG1/2/3 in fits headers to correct MNGTARG1/2/3

DRL (2016-03-07)
Retool calculation of Poisson statistic in mdrp_skysubtract to match
Law+16 data paper.

BAC (2016-02-28)
Added in ml_importcmm; added CMM stuff into DOS-temp placeholder at the moment

DRL (2016-02-19)
Add a check in creating 3d planfile that there are no duplicated exposure
numbers in apocomplete.  If so, remove duplicates.

BAC (2016-02-19)
Added in lockfile mechanism for DOS updates and writes of the apocomplete files

DRL (2016-02-06)
Fix problem with fibermask not initializing properly and propagating values
from bad calibration files into good science frames.

DRL (2016-02-04)
Many changes to LSF handling.  Use post-pixellization measurements at the
skyline adjustment stage, and account for broadening at wavelength rectification.
Also provide LSF measurements in Angstroms.
Tweak wavelength curvature tolerance in arc and skyline routines so that it
doesn't fail on spec2 for 8796-57410

BAC (2106-02-02)
Updated the DOS loading sn2 values so it doesn't crash when wrong survey mode is present in headers.  Restructured code for better testing.

DRL (2016-01-29)
Update mdrp_drp3dhead and mdrp_drp1dhead to no longer use INDEF values for
all undefined values.  Instead use ml_nullval values for appropriate data type.

BAC (2016-01-29)
Removed file comparisons for plugmaps and plateHolesSorted files by DOS

BAC (2016-01-28)
Updating tests and fixes for platelist and runmanga for bright time plates

DRL (2016-01-22)
Modify mdrp_calib, mdrp_extract_object, mdrp_fitarcimage, mdrp_reduce, ml_qaplot_arcline
These use xdif_tset to look for cases of bad wavelength solution due to V-groove failure,
and flag things accordingly.
Fix bug where ml_makeslitmap call to ml_fixplateholes didn't verify tag existence before trying to change in slitmap.

DRL (2016-01-16)
Remove call to ml_growcosmic in mdrp_reduceoneifu that I forgot when moving cosmic growth
to 2d part of the pipeline on Nov 11 2015.

BAC (2015-12-17)
Tested platelist stack vs mastar generation

BAC (2015-12-16)
Fixed bug in ml_apolog_to_html for plate 10001.  Fixed plate10k naming issue with plateHolesSorted in DOS-python

DRL (2015-12-11)
Modify 3d code to create a multi-line mastar file; one line per mjd
instead of making multiple per-mjd files.

DRL (2015-12-07)
Add checksum to ml_mwrfits headers

BAC (2015-12-04)
Modified some DOS logging.  Removed backup count, added manual rollover on keyboard quit, added filename check on log initialization, changed rollover time to utc midnight

DRL (2015-12-02)
Do not overwrite 3d planfile if it already exists.  If only one ifu specified
via doifu, make logfile of the form plate-ifu.log instead of plate.log

BAC (2015-11-20)
Moved the DOS splog logs into a logs subdir and piped standard output and error from IDL to new log files for DOS

DRL (2015-11-11)
Move cosmic cleanup to 2d stage.

DRL (2015-11-05)
Fix residual cosmics in 3d stage.

DRL (2015-10-29)
Reintegrate brighttime branch into trunk.
This splits processing format of bright-time plates into a mastar/
directory instead of a stack/ directory and changes the file formats.

BAC (2015-10-29)
Added exit in mdrp_quicksn2 for apogee-lead plates to skip no platemags file warning

BAC (2015-10-27)
Switched platelist image generation from objra/dec to ifura/dec

BAC (2015-10-13)
Added /sci option input for 2d pipeline run in runManga
Changed platelist.fits to platelist-[version].fits in plateList code
Added checks for nan/inf in sample param load of cubes into mangadatadb

-------------------------------------------------------------------------------
v1_5_1 (2015-10-08; DRL)

DRL (2015-10-08)
Fix from RY to flux calibrate SKY extensions.
Fix from BC for objra/dec columns in platelist.

-------------------------------------------------------------------------------
v1_5_0 (2015-10-01; DRL)

BAC (2015-09-29)
Removed scira/dec columns from platelist/drpall

BAC (2015-09-28)
Updated mjdred and datered column types in platelist

DRL (2015-09-24)
Fix potential bug in number of breakpoints for scattered light routine.
Fix plotting bug in superflat.

BAC (2015-09-23)
Added in new versprim column into platelist and drpall codes

DRL (2015-09-22)
Overhaul preimaging structure.  Now uses svn product mangapreim.
Point to correct place, add VERSPRIM to FITS headers.

DRL (2015-09-22)
Refactor treatment of IFURA/DEC and OBJRA/DEC.

BAC (2015-09-21)
Removed ufwhm column from platelist and drpall

BAC (2015-09-18)
Changed dosUpdatePluggingStatus to test DOS/Totoro database calls. Separated the session calls out between DOS and Totoro.

DRL (2015-09-16)
Bring IFURA, IFUDEC, TRGTRA, TRGTDEC into cube/rss file headers.
Minor adjustment to comment label on physical units (flux -> intensity)
Add option to omega calculation to not use EAM results.

DRL (2015-09-11)
Revise handling of wavelength solutions and skyline shifts and
broadening calculation when there are missing IFUs.

DRL (2015-09-09)
Adjust Omega calculations to include EAM, refactor calculation order
in mdrp_reduceoneifu.  Add EAM_Omega0 to obsinfo.

BAC (2015-09-09)
Tweaked mjdrange input for runManga
Removed svn commits from DOS, dosWatch (doSvnUpkeep) and dosCheckExposureStatus - now DOS only adds files

DRL (2015-09-08)
Tweak skyline rejection for wavelength tweaking.
Reject exposures if quadavg flexure/focus correction is > 0.5 pixels.
Added full traceback info for DOS plate completeness check to Totoro

DRL (2015-08-31)
Major overhaul to SKYDISPSET calculation.  Science frames
now use dispersion (LSF) values from SKYDISPSET instead
of reference arc frames.

DRL (2015-08-27)
Change effective wavelengths for Omega calculation.  Now uses
shortest wavelength in MaNGA (u), pivot wavelengths of g,r,i,
and longest wavelength in MaNGA (z).  Remove UIMG and UPSF
extensions from data cubes.

DRL (2015-08-26)
Shrink guider psf using psffac derived from flux calibration module.
Propagate psffac into mgCFrame files, and into obsinfo.  Add warning
flag for bad psffac values.  Ignore DONOTUSE spaxels when creating broadband
images from MaNGA cubes.
Move to using HDUCLASS header keywords in 3d pipeline.

DRL (2015-08-21)
Shrink guider PSF when making reference PSF models; interpolate
fcpsf1d results.

DRL (2015-08-20)
Set LOWEXPTIME flag if an exposure is listed as greater than 20 minutes
too.  This is a little confusing, but such cases would generally be
where the timestamp failed and the exact reported time is in error, and
this saves making a new bit.

DRL (2015-08-10)
Adjusted bkptbin from 0.00012 to 0.000121 in combine1fiber.pro
This tiny shifts can make a major help in the bsplined
combined spectra in the far blue in some fibers.

BAC (2015-08-06)
Fixed bug in drpAll code with plateTargets table

DRL (2015-08-04)
Modify 2d plan creation warnings.
Message on errors in 3d plan creation with missing files.
Check targeting bits against targetfix files when creating obsinfo.
Allow specification of impact radius in foreground star file.

DRL (2015-07-27)
Change CTYPE WAVE-WAV to WAVE for linear format files.

DRL (2015-07-21)
Major revision to routine ml_mangatosdssimg.pro which creates mock
SDSS filter broadband images from the data cubes.  Previous algorithms
gave very bad flux normalization; now tested against preimaging to
within a few percent.

DRL (2015-07-17)
Revise multiple 3d files so that OBSINFO does not contain vector format
entries.  Change name of routine mdrp_calcomegaset to mdrp_omega (which
calculates Omega of an observed set) to distinguish it from
ml_calcomegaset (which calculates Omega for simulations).

RY (2015-07-16)
1. Implemented a more robust rejection of stars with bad PSF fit. This almost eliminated catastrophic deviations in the flux calibration. The calibration error is now a Gaussian distribution at every wavelength with little tails (<1% exposures beyond 3 sigma).
2. Put in an absolute calibration correction to account for the flux in the wings of the PSF that is missed by the double Gaussian model.
3. Updated transparency calculation.
4. The stellar model fit now use only absorption line regions for model determination, not the whole spectrum.
5. Limited the range of best fit PSF model to have FWHM within 0.75 -1 of the guider FWHM.
6. Added more stellar lines in the line list. The previous list only covers the original SDSS wavelength range.
7. Roughly correct for the throughput of the system before typing the star, using different throughput curve for the two spectrographs and do the correction separately for the two cameras.
8. A bug is fixed in the QA plotting to plot the actual best-fit model.

DRL (2015-07-15)
Implement FLUXEXT, ERREXT, MASKEXT, ERRTYPE keywords.
Remove XPOS and YPOS extensions from cubes.
Fix wavelength solution in header for LINEAR format 3d products.

DRL (2015-07-02)
Bug fix on missing LINEAR exposure detection.

DRL (2015-07-01)
Better failure catching in fiber tracing to deal with
negative trace values from first pass.
FULLCLOUD now set at 30%.
Deal with cases of only 1 exposure in mdrp_drp3dhead
Change handling of VARIABLELSF in cases of NODATA.

DRL (2015-06-30)
Fix long integer bug in ml_growmask
Sort IFUs in mdrp_reduce3d

DRL (2015-06-24)
Modified mdrp_reduceoneifu to now produce LINEAR format
cubes and RSS files.  Modified the SPECRES extension
to no longer be a smoothed fit to the median spectral
resolution.  Added SPECRESD extension which is the standard
deviation of the spectral resolution across fibers
from the average.  VARIABLELSF flag should now only occur
in very bad cases.
Fix major bug in combine1fiber.pro where the combined
mask was completely wrong from LINEAR format mgCFrame files.

BAC (2015-06-24)
Modified drpAll to handle new plateTargets columns,refactored row update code
Modified plateList to make all string columns length 100
Added new tests for drpAll

DRL (2015-06-22)
Modified ml_qaifuflat to do better zero-value rejection
Modified mdrp_eam to grow the bad pixel mask by 1 before trying
to match photometry against preimaging.  This helps in the cases where
cosmics aren't fully masked, and had previous been badly pulling
off the EAM fit in some bands.

DRL (2015-06-18)
Improve fiber tracing along detector using cross-correlation adjustment
routine ml_cctweak.pro

DRL (2015-06-15)
Added bogey rejection to 3d DRP using bogey.par reference file.
Cosmetic cleanup on mgCFrame files.
Tweak old opFibers on carts 1,2,3,4,6

DRL (2015-06-13)
Modified DOS to use pixelflat during sdssproc, use a maxdev of 0.5 in the
fiber traceset creation.  This is important to not crash on the match
trace between flat and science frames, esp for r2 camera.

DRL (2015-06-12)
Modified DOS to remove slithdr from the FITS header of various files.
Read it in from mangacore instead.  Include SLITFILE in flat and science
headers.

DRL (2015-06-09)
Added routine ml_ccadjustblocks.pro, which can be used to fine-tune
opFibers files after a cart rebuild.  New opFibers file for cart 1.

DRL (2015-06-08)
Changed Pstat calculation in red to use 8888 Angstroms.
Fixed masking problem in sky sub where fibers with >50%
of pixels rejected weren't being properly flagged in mask
or zeroed in flux and ivar.  Now uses flag MANYREJECTED.
Fix bug in number of breakpoints for DOS in mdrp_fitflatwidth
Fix bug in DOS not producing superflat plots.

DRL (2015-06-05)
Changed BADDEPTH flagging to 90% of SN2=20 (blue) and 36 (red)

DRL (2015-06-03)
Changed 2d and 3d header keyword RADECSYS -> RADESYSa
Changed 3d WCS keywords to match Greisen+06 FITS standard,
modified relevant CRVALi and CDi_i, removed DC-FLAG.
Add '0=S, 90=E' comment to AZ keyword in mgFrame

BAC (2015-06-02)
Began testing implementation for dosWatch; small overhaul of dosWatch to accommodate
Started with dosWatch.doSVNupkeep and dosWatch.copyPlugMap
Added more tests for checkSlitmap, checkPlateHoles, checkPlugMap, and reogranized dosWatch code

DRL (2015-05-27)
Change some unit values in 3d headers.
Angstroms --> Angstrom
degrees --> deg

BAC (2015-05-20)
Removed pdb imports from python code
Modified DOS to load calibration files into platedb.
Changed DOS scp of logfiles to combined/ to symlinks pointing to originals

-------------------------------------------------------------------------------
v1_4_0 (2015-05-17; DRL)

DRL (2015-05-17)
Major revisions to multiple codes to improve sky subtraction.  Changes include:
Weighting algorithm in camera combination (changes to combine1fiber)
Tweaks to weighting during fiber tracing
Modication to allow tilts to fiber widths within block, no longer use tracesets
Allows tilts to arcline LSF within blocks
Use extract_image for arc frames
Overhaul of scattered light routines, applying to calibration frames
Changes to sky scaling; use mean scaling per camera, no scaling for 2d subtraction
Additional changes to improve adherence to FITS format protocols, including
no longer putting slithdr in mgFrame files.  Now ml_mgframeread reads slithdr
information from mangacore.

BAC (2015-04-30)
Rewrote the raw data load in mangaDataDB
Reorganized the fault/done status checking, added additional checks to fix drp auto gen/update. testing...

BAC (2015-04-29)
Added more tweaks to automated runmanga, platelist, and drpall
Generalized the drpall update of platetargets files
Added in tweaks for automated cube loading into mangadatadb (still need to test this)

BAC (2015-04-23)
Finished implenting changes to dosMarkExposure
Added new python error catch for IOError
Added all3d keyword into runmanga

BAC (2015-04-22)
Updated dosMarkExposure to update fits log and dos calibration reductions

BAC (2015-04-17)
Added in plateifu keyword into platelist and drpall
Added platetyp and srvymode in platelist 3d, temp commented out drpall 2d platelist code

BAC (2015-04-16)
Updated dosMarkExposure to update the html log files
Modified regenRow in platelist to better handle 3d updates

BAC (2015-04-15)
Added try excepts so DOS exits gracefully on updatePluggingStatus when Totoro crashes
Expanded the search term for Python errors in runmanga status files, so we don't catch the general PLOTERROR

BAC (2015-04-14)
Added in new (idl) procedure to check for latest calibrations with excellent quality. Used in mdrp_aporeduce.
Added command-line (python) script for observers to mark exposures as bad or test quality.
Added extension check for platelist 3d.

DRL (2015-04-13)
Modify colorbar to al_colorbar to avoid IDL8 namespace issue.

-------------------------------------------------------------------------------
v1_3_3 (2015-04-10; DRL)

BAC (2015-04-08)
Added loading of cube ra, dec into mangadatadb
Added new constraints on the post-cal reminder for DOS - now alerts only for b1 camera, science exps, and non-APOGEE-lead

BAC (2015-04-07)
Added fault status checks for DRP python sections that run after DRP IDL sections; to catch Python crashes
Fixed bug with 2d platelist row regeneration for multiple plates on a given MJD
removed debug statement

DRL (2015-04-06)
Update treatment of inverse variance in mdrp_calcsky.pro to help fix pedestal
residuals in stacked spectra. (Still not great in red cameras though)

BAC (2015-03-31)
Added bug fix with a new line problem in runmanga 3d script files preventing row regeneration and drpall creation/update
Added some prints in regenRow

DRL (2015-03-31)
Add flagging mechanisms for foreground stars.

DRL (2015-03-27)
Tweak eBOSS data catching to only get 'science' frames

-------------------------------------------------------------------------------
v1_3_2 (2015-03-26; DRL)

DRL (2015-03-23)
Add /fold_case to flux calibration routine to catch sky fibers
on Coma plates

DRL (2015-03-23)
Add safety catch to ml_plotsn for second qa routine so that moment()
isn't called with too few elements.

DRL (2015-03-23)
Add PLATEIFU keyword to output 3d cube and RSS headers.
Modify ml_fixplateholes so that it adds the manga_target3 tag
to plateholes structure if it didn't exist before.

DRL (2015-03-22)
Make ml_getfibermags full version check for guide cam directory too.
Tweak sdssproc and calling routines so that only science frames use
the SN throttling option.

BAC (2015-03-19)
Fixed DOS svn commits.  Changed commit dir to all of mangaCore. Added additional svn adds for directories.
Added post-cal time check in DOS.  Updates html logfile with red warning message when time exceeds 1 hour past last flat.

BAC (2015-03-18)
Changed cartid in 3d platelist to string
Changed platelist keywords back to match headers
Added row regeneration to platelist for post-node finish
Fixed null image in platelist

DRL (2015-03-16)
Modify ml_selectmanga so that it also checks for cartid >= 6.

DRL (2015-03-13)
Modify mdrp_reduce so each science frame uses the arc/flat closest to it
in time (previous this WAS NOT true)

-------------------------------------------------------------------------------
v1_3_1 (2015-03-06; DRL)

DRL (2015-03-06)
Turn off cube creation for bright-time plates.  Cubes will be made, but
they'll be empty.

-------------------------------------------------------------------------------
v1_3_0 (2015-03-05; DRL)

DRL (2015-03-05)
Added more use of the srvymode keyword to change processing path
for APOGEE-led bright time plates (mostly to disable EAM and some
QA routines).

DRL (2015-03-03)
Upped rejection threshhold on combine1fiber to 5 sigma; 3 sigma was clipping
bright emission lines.

DRL (2015-03-02)
Retooled all maskbits to use MANGA_DRP2PIXMASK and MANGA_DRP3PIXMASK instead
of SPPIXMASK and MANGA_DRPPIXFLAG.  Turn on Renbin's new pixel rejection threshholds.
Add SNR throttling to bright objects by imposing an inverse variance floor
such that SNR is never reported as > 100.

BAC (2015-02-23)
Added apocomplete and headerfix dirs in mangacore to explicit svn upkeep in DOS

BAC (2015-02-17)
Moved platelist templates definitions into own method

BAC (2015-02-12)
Fixed columns types in platelist and drpall files, added correct NULL type values

BAC (2015-01-29)
Updated xmid and wavemid values in opLimits for MaNGA

BAC (2015-01-28)
Added fits header loading into mangaDataDB.

BAC (2015-01-27)
Bug fix to DRPall to handle cases where a 3d plate reduction exits before anything is done, and no platelist 3d exists
Updating relative links on DOS logfile output html page

-------------------------------------------------------------------------------
v1_2_0 (2015-01-26; DRL)

DRL (2015-01-26)
Checks for fiber-fiber throughput variations within an IFU
to set BADIFU.

DRL (2015-01-25)
Add in FULLCLOUD flags, move QA routines from fluxcal to reduce2d

DRL (2015-01-23)
Fix bug where EAM closes the splog file

DRL (2015-01-20)
Major rewrite of fiber tracing and wavelength calibration by DRL and BAC.
Now much more robust to missing ifus.

-------------------------------------------------------------------------------
v1_1_4 (2014-12-22; DRL)

DRL (2014-12-18)
Catch and deal with 'where' statement failures in EAM.

BAC (2014-12-16)
Added new columns into platelist 2d and error tables for easier apocompleteness parsing and error debugging.

DRL (2014-12-15)
Fix xterm bug in mdrp_eam that caused issues at Utah.

-------------------------------------------------------------------------------
v1_1_3 (2014-12-12; DRL)
Tag new version to fix some bugs and provide a reference using the EAM.

DRL (2014-12-12)
Updated various codes to use al_legend.pro instead of legend.pro
to avoid collision with native IDL 8 function.
Add SRVYMODE keyword to 3d planfiles as a hook to identify
bright-time plates.

DRL (2014-12-08)
Make running the EAM the default (change from /astweak to /noeam keywords).
Change module name from mdrp_tweakastrometry to mdrp_eam

DRL (2014-12-04)
Fix plot off page issue for SN2 and EAM plots.
Revise flagging to catch bad flux cal issues using EAM.
Revise obsinfo.EAM structure to include flux scaling
Turn on EAM fully.

DRL (2014-12-04)
Added check to slitmap creation to look for mapper errors putting
sky fibers in IFU holes.

DRL (2014-11-26)
Fixed bug where sky subtraction plots are being overwritten each exposure.

-------------------------------------------------------------------------------
v1_1_2 (2014-11-25; DRL)
Tag new version to fix bug in v1_1_1

DRL (2014-11-25)
Fixed x display bug in sky subtraction plots.

-------------------------------------------------------------------------------
v1_1_1 (2014-11-24; DRL)
Tag new version to reflect SN2 calculation changes.

BAC (2014-11-24)
Bug fix for drpall updating
Write permissions to generateImages
Bug fix for drpall html link in platelist html
Removed good exposures from mangacore header fix files, with bad quality
Changed DOS quickSN2 to use preimaging, removed /quick in ml_getfibermags

DRL (2014-11-24)
Change slope on SN2 vs magnitude plots.  Add creation of this plot to the DRP
and debug plot code for DRP use.

-------------------------------------------------------------------------------
v1_1_0 (2014-11-21; DRL)
Tag new version to encapsulate the many changes to date.  Additional
change to automation script by BAC.

DRL (2014-11-20)
With G. Blanc revise EAM with FIXROT ability.  Adjust input keywords.
EAM may run with /astweak, but currently doesn't affect output, just
does some calculations for information.

BAC (2014-11-17)
Added option to turn off fiber loading into mangaDOSdb
Simplified file locking code for writing plugmaps in DoS
Fixed bug in generateImages for platelist
Removed isManga inside dosPipe to allow APOGEE-lead calibs

DRL (2014-11-12)
Reject sets where the IFU dropped out in one or more exposures, fix bug
in BADSET flagging.

DRL (2014-11-09)
Fix astrometry in magnitude calculations to be robust against cases
where N is not up.  Add some keywords to output headers.

BAC (2014-11-07)
Added failsafe to DOS for case of plates with no platemags

DRL (2014-11-05)
Calculate omega for each set

DRL (2014-11-04)
Incorporate manga_target3 into slitmaps and FITS headers

BAC (2014-11-3)
Adding DRP all into runManga automation

DRL (2014-11-01)
Added auto-production of EAM quality control plots using the obsinfo structure
to track EAM results over all exposures.

DRL (2014-11-01)
Modify extended astrometry module to return parameter info, modify obsinfo
structure to accept set, setomega, and EAM parameters.  Crude hack to EAM
to fix all-zero issue on some exposures.

BAC (2014-10-30)
Updated drpall generation and update
Bug fixes to mdrp_getpeaks

DRL (2014-10-29)
Tweak astrometry routine to use fixed rng seed for determining
pseudo guiding locations.

BAC (2014-10-28)
mdrp_getpeaks fix when extra gap blocks found

BAC (2014-10-26)
Bug fix in DOS checkUnplugIFU for when no data exists in center of exposure
Replaced r1 gain values in quickProc
Tweaked DOS to ignore all Hartmann from dosStart stage onwards, DOS does not run

DRL (2014-10-25)
Updated sdssproc for new r1 ccd gain values.

BAC (2014-10-25)
Bug fix in DOS checkExposureStatus

BAC (2014-10-24)
Fixed DOS in dosLoadSN2Value to select one Observation if multiple found (fix for APOGEE)
Fixed DOS issue where missing fiber structure not passed from tracing routine to wave calib routine

BAC (2014-10-06)
Added dosCheckExposureStatus for DOS to get bad exposures from database and create/append header fix files

BAC (2014-10-03)
Modified runManga APO complete check to filter out non-science MJDs

DRL (2014-10-03)
Set default spaxel scale to 0.5 arcsec, flux units are per spaxel.

BAC (2014-09-25)
Set force to always on in mdrp_runmanga2d
Fixed bug in 1st block for mdrp_getpeaks
Tweaked cases with one block and one sky fiber missing

DRL (2014-09-23)
Added VARIABLELSF checking, DISP to output RSS.

DRL (2014-09-19)
Added drp2qual flagging to arcs and flats
Propagate seeing and transparency through 2d and 3d data products.

BAC (2014-09-18)
Added graceful exit to pipeline for plan files with no flats, arcs, or science
Added getModules method in manga_utils to retrieve Utah module version for manga
Fleshed out error.txt handling and regeneration for runManga
Bug fix on ml_readslitmap (igood->numgood)
Modified setStatusDone to accept a list of error files
Changed nexp in platelist to total expected based on mgPlan

BAC (2014-09-16)
Made tweak to getpeaks.pro to exit gracefully on non-failure modes
Changed HA calculation to new LST method in sdss_python
Moved Totoro DOS references to sdss_python

DRL (2014-09-17)
Squished bug in extended astrometry module.

DRL (2014-09-16)
Fixed some sky subtraction bugs, changed drp3qual flagging.

DRL (2014-09-15)
Changed to using tai2airmass where possible, some additional
FITS header names for airmass, hour angle, lst.

DRL (2014-09-12)
Migrated to using drp2qual and drp3qual instead of drpqual.
Requires updating to idlutils later than v5_5_16

BAC (2014-09-11)
Added svn in_use file for DOS to prevent multiple access
Split off svn adds to indiv files in DOS
Added error checking for done/fault status in platelist (setStatusDone)
Expanded platelist html to better showcase faults

DRL (2014-09-09)
Improve QA on importing plate drilling CMM data.

DRL (2014-09-09)
Fix coaddgimg.pro to not fault when first procced guider frame
is missing.

BAC (2014-09-08)
Added better standard output and error into runManga at Utah

DRL (2014-09-08)
Fix qaifuflat calling to use best arc, not first arc.

DRL (2014-09-08)
Improve file existence checking for flux calibration and camera
combination routines.

DRL (2014-09-08)
Removed tileid from FITS headers and slitmap headers (obsolete).
New manga_tileid is in plateTargets file.

DRL (2014-09-08)
Added check to ml_getfibermags that an IFU was actually plugged
in the slitmap before trying to get fiber mags for it.

BAC (2014-09-07)
Fixed hubWatch for DOS back to iNotify file monitoring

BAC (2014-09-04)
Fixed bug in mdrp_mgPlan2d to only write plan files into appropriate directories

DRL (2014-09-03)
Changed to do flux calibration by default (unless NOFLUXCAL is set)

BAC (2014-08-28)
Added fiber throughput QA to DOS in mdrp_quicktrace, mdrp_tracefibers

DRL (2014-08-15)
Added INSTRUME='MaNGA' keyword to 3d outputs.

DRL (2014-07-16)
Fixed 0/1 indexing error in ml_aper.pro that was throwing off
the aperture photometry on preimaging data.

DRL (2014-07-15)
Incorporated modifications for Guillermo Blanc's revised
extended astrometry module.

DRL (2014-07-14)
Revised 3d plan generation to use contents of apocomplete file.

DRL (2014-07-14)
Added calls to fix plateHolesSorted files using targetfix
files when creating slitmaps.

DRL (2014-07-14)
Removed manga_maskbits.par and all associated functions.
Replaced all calls to this with standard sdss functions
to call maskbits now in the idlutils product

BAC (2014-07-03)
Added tweak to mdrp_getpeaks to handle r2 bad column in new cart 1 cal data
Changed mangadatadb to mangadosdb
Updated DOS to access mangadosdb
Added new harness name table to mangadosdb, and restructured the tables slightly

DRL (2014-07-03)
Added a hack to allow use of the whitelight calibration
lamps (this is turned off by commenting out)

DRL (2014-07-03)
Added a call to hdrfix routines early in mdrp_runmanga2d
to catch errors in mapping names and plate ids.

DRL (2014-07-03)
Modified ml_mkopslits to accept keyword /tweakmotorpos

DRL (2014-07-03)
Remove header keywords from opSlits-sample since they were
colliding with read keywords when making a new opSlits file.

DRL (2014-07-03)
Modified output of ml_galinfo

BAC (2014-06-27)
Fixed bug in mdrp_quicktrace with slitmap input to tracefibers

BAC (2014-06-24)
Added cart 1 info into opFibers.par parameter file.

BAC (2014-06-19)
Fixed fibermask bug in mdrp_quicktrace
Added code to update the current file being processed for DoS

BAC (2014-06-10/19)
Fixes/Updates to runManga and plateList code for Utah automation

-------------------------------------------------------------------------------
v1_0_0 (2014-06-03)

Initial tag of the MaNGA DRP software for commissioning run data.