ProSoft is an interactive graphical data processing and extraction application for Satlantic sensors. It is highly configurable with optional batch mode operation and a rich user interface. Supported data products include:
- Diffuse attenuation coefficient
- Solar utilities
- Photosynthetically available radiation
- Pigment modeling
- Energy fluxes
- Water leaving radiance
- Reflectance data products
- Normalized water leaving radiance
- Water properties
For minimum system requirements, installation instructions, and new features, please refer to the release notes and manual.
ProSoft 7.7.19 provides a number of key improvements including support for ancillary SAS sensors, support for BETA_IRED and BETA_GREEN sensors to calculate backscattering, corrected backscattering coefficient units, robust handling of corrupt timer data, HyperSAS IR camera integration, interruptable processing, and more. For a detailed list of recent fixes and features, please refer to the release notes.
Prosoft Satlantic, LP Richmond Terminal-Pier 9, 3481 North Marginal Road Halifax, Nova Scotia B3K 5X8 CANADA phone: (902) 492-4780 fax: (902) 492-4781 email: firstname.lastname@example.org ProSoft updates can be obtained from www.satlantic.com ProSoft 7.7.19 Date: April 14, 2016 ** Defect * [PROSOFT-11] - Raw data frame truncated at EOF causes program to hang * [PROSOFT-16] - Prosoft - Correction for bad timer values only uses seconds from timetag2 ** Improvement * [PROSOFT-12] - Prosoft - Support BETA_IRED and BETA_GREEN sensors to calculate backscattering * [PROSOFT-13] - Prosoft - Add support for new Ancillary sensors for SAS ProSoft 7.7.18 Date: December 14, 2015 ** Defect * [PROSOFT-7] - The Altimeter Sensor is not processed to Level 2s * [PROSOFT-6] - Variable length frame not parsed correctly when first delimiter not immediately after header ProSoft 7.7.17 Date: October 1, 2013 ** Defect * [2006-131-405] - Prosoft - The instrument sensor data type AU is not supported * [2006-131-404] - Prosoft - Level 2s interpolation for STOR-X Plus Profiler with ancillary instruments fails * [2006-131-401] - Level 2s interpolation for SAS data does not use a scalar for interval * [2006-131-397] - The Deglitch Profiler Data processing fails when no Profiler instrument exists * [2006-131-384] - Level 2 processed dark frame optical sensor values are being extrapolated * [2006-131-379] - Shutter Dark correction for Ev is not supported. * [2006-131-366] - Level 2 timer correction function uses unconverted time stamp values ** Improvement * [2006-131-394] - Add check to reject corrupted fixed length binary frames ProSoft 7.7.16 Date: October 17, 2011 ** Defect * [2006-131-349] - Level 3a Radiance Wavelength Matching being performed on multispectral sensor data * [2006-131-342] - Level 2s interpolation of SAS optical data invalid when timer data is bad * [2006-131-341] - Consecutive frames with equal timer values cause corrupt time tags at level 2s * [2006-131-321] - The backscattering coefficients units are incorrect * [2006-131-318] - Level 3a data bins that contain NaN values must not be averaged * [2006-131-317] - Missing sensor data rate value causes level 2s processing to fail * [2006-131-314] - Offset between level 2s and level 3a binned radiance data * [2006-131-307] - The Instrument File Binary Signed data type is not supported ** Improvement * [2006-131-343] - User Manual Includes Incorrect Radiometer Distances for HyperPro * [2006-131-336] - Temperature sensor data for a SAS cannot be displayed in HDF data viewer * [2006-131-334] - Support IR Camera sensor integrated within HSAS system * [2006-131-304] - Make compatible with Windows 7 ProSoft 7.7.15 Date: August 31, 2009 ** Defect * [2006-131-293] - Extracting Level 4 HDF output for Chlorophyll Profile Estimate fails * [2006-131-295] - Negative values for sensors with BF or BD data type can not be converted * [2006-131-297] - Processing fails when consecutive frames have same timer value * [2006-131-298] - Level 2s reference data integration add time stamp values bug ** Improvement * [2006-131-111] - Prosoft - Abort processing command button ProSoft 7.7.14 Date: April 15, 2009 ** Defect * [2006-131-247] - Level 2s Data Integration can prevent sensor data from being plotted versus time. * [2006-131-268] - ASCII Data Extraction cannot format Timetag2 NaN values * [2006-131-275] - Level 2s processing fails for Profiler with 507 Ed and HOCR Ed * [2006-131-284] - HDF Data Viewer cannot display GPS data with no date sensor field * [2006-131-285] - A GPS TDF with multiple sensors of the same type causes Level 2s to fail. ** Improvement * [2006-131-271] - Automatic import of Instrument Context and Processing Parameters from previous version ProSoft 7.7.13 Date: January 30, 2009 ** Defect * [2006-131-266] - Rrs surface calculation with Es incorrect ProSoft 7.7.12 Date: October 7, 2008 ** Defect * [2006-131-253] - GPS data causes Input not a string error with HSAS Data * [2006-131-254] - SAS Level 2s processing failure caused by typo ProSoft 7.7.11 Date: August 22, 2008 ** Defect * [2006-131-217] - One Tilt Axis is not displayed in HDF viewer * [2006-131-218] - Level 2s processing loses optical sensor wavelength decimal places * [2006-131-225] - Time values sometimes can not be extracted from HDF files * [2006-131-234] - Profiler Instrument with no TIMER sensor prevents Level2 processing * [2006-131-238] - Access denied error on Vista platform ** Improvement * [2006-131-231] - Process Ed, Lu and Es data wrt time not working to level 2S * [2006-131-235] - Reference Ed data labels converted to Es data labels ProSoft 7.7.10 Date: November 5, 2007 ** Defect * [2006-131-119] - Proper output of Gordon 88 surface chlorophyll data * [2006-131-136] - Fix Par plotting of linear and log values * [2006-131-169] - Calculation of PAR can fail for SAS * [2006-131-173] - Prosoft 7.7.9 Parser creates time stamp recreation errors * [2006-131-174] - Prosoft 7.7.9 Ignores Hemisphere in SAS data * [2006-131-175] - SAS Level2s processing fails when DI7 (Es) configured as Reference * [2006-131-180] - Processing data for sensors defined as AI and AF in Calibration file fails * [2006-131-182] - SATTHS Sensor Missing in Level 2S SAS File * [2006-131-183] - File Parsing option can not be disabled once it is enabled. * [2006-131-185] - Ed(0+) formula in the prosoft user manual is incorrect. * [2006-131-187] - Use of HDF4 data format imposes limit on the number of data fields. * [2006-131-190] - Processing ECO-BB3 data to Level 2s causes fatal error. * [2006-131-191] - On Deck Pressure Tare not set correctly when it is not provided. * [2006-131-194] - ASCII Output Inconsistent with Wavelength Interpollation * [2006-131-196] - Manual Profile Editor does not always restrict data to downcast. * [2006-131-197] - Ls distance to Surface value is not being used to compute Level 4 radiance parameters. * [2006-131-204] - Extraction of HDF files from multiple Levels to .MAT not working * [2006-131-209] - HPROII in Surface Mode - Es sensor does not interpolate to 2nm only Ls * [2006-131-212] - Level 3a wavelength interpolation of 1nm limited by HDF data limit in Prosoft 7.7.10 * [2006-131-214] - Morel Pigment Profile calculation fails for upcast * [2006-404-32] - Manual Profile Editor does not always restrict data to downcast. * [2006-404-34] - Current Parameters drop-down field disappeared after delete perfomed. * [2006-404-38] - Level 4 Lwn/ES output data values has partial wavelength range * [2006-404-40] - Use Ls distance to Surface value to compute Level 4 radiance parameters. * [2006-404-44] - WaveLength matching not correct in Level3a or Level4 * [2006-404-46] - Calculations for Propagation to Surface function are not correct. ** Improvement * [2006-131-085] - Inclusion of derived profiler velocity into level 2 and 2s hdf files * [2006-131-115] - Update Morel pigment profile coefficients * [2006-131-120] - Wavelength data output reduction for Morel pigment profile * [2006-131-135] - Level 4 energy flux NaN filtering required * [2006-131-146] - Should provide absolute tilt in upper level products * [2006-131-170] - Plotted Surface Chlorophyll values not visible in 2-D graph * [2006-131-201] - Improve data table headers in ASCII output product * [2006-404-30] - Add Extraterrestrial Solar Spectrum option to parameters GUI * [2006-404-33] - Add Header Records for Instrument Config and Parameters File * [2006-404-35] - Add more Header Records to Level 2+ output files * [2006-404-36] - Add an Import button for Processing Parameters * [2006-404-39] - Add Extraterrestrial Irradiance values for Wavelengths used to calculate Lwn * [2006-404-41] - Add K Model data values to the Level 4 HDF output file * [2006-404-43] - Add calculation of Q Factor in Level4 for Surface Mode * [2006-404-45] - Add a message to indicate that processing at that level is complete. * [2006-404-50] - Move Pressure Tare and Water Medium from Parameters panel to Instrument panel ProSoft 7.7.9 Date: July 7, 2006 1. Removed obsolete LOG option from the AutoDark Correction processing parameter. 2. A TIMER sensor is now added to each instrument frame that does not provide it if the frame provides the DATETAG and TIMETAG2 sensors. 3. GPS instrument frames that are missing one or more sensor values are now removed so that Level 2s processing can be performed. 4. ProSoft now supports ingesting data values for sensors that are defined to be either the BF or BD data type. ProSoft 7.7.8 Date: January 4, 2006 1. Wavelength values from calibration files that are not increasing monotonically are now sorted into proper order in the level 2s hdf data product. This also covers wavelength values from two calibration files for the same sensor type which have the wavelength values intermixed. ProSoft 7.7.7 Date: November 2, 2005 1. GPS time values are now considered the most accurate time source. If sensor time values are too different from GPS time values the sensor time values are corrected to match the GPS time values. ProSoft 7.7.6 Date: September 15, 2005 1. Corrected level 3a data averaging with respect to time when the data logging rate is very slow as in less than 1 Hz. 2. For reference sensors Es and Ls, if only a single frame of data is available it is no longer averaged to produce surface values Es(0-) or Ls(0-). ProSoft 7.7.5 Date: July 25, 2005 1. Fixed index exceeds matrix dimesions caused by variables Eps_data, Kw_data and Chi_data in MorelPigemtnProfile.m which occurs during processing of both downcast and upcast data. 2. Reference optical variables when propogated to surface which contain only a single row vector are no longer averaged. This eliminates the incorrect averaging of a single row vector which produced a single value for the reference optical data instead of a single value for each wavelength. ProSoft 7.7.4 Date: June 10, 2005 1. Added more robust handling of corrupted data frames within the tdf frame parser function. 2. The tdf frame parser is now able to handle spurious errors in frame ending crlf combinations where lf is twice repeated. ProSoft 7.7.3 Date: May 20, 2005 1. TDF frames are now able to be parsed with most delimiter types including multiple byte delimiters. 2. Fixed bug preventing surface reflectances from being calculated for certain reference only sensor combinations. ProSoft 7.7.2 Date April 7, 2005 1. Changed calculation of %PAR as follows: Profiler/Reference: PAR(0+) surface value is calculated based on ES(0+) values and then used for calculation of Profiler %PAR relative to surface. Profiler Only: PAR(0+) surface value is calculated based on ED(0+) values and then used for calculation of Profiler %PAR relative to surface. ProSoft 7.7.1-RC9 Date: March 15, 2005 1. ProSoft can now process data which has been logged in a periodic mode such as the StorX TSRB instrument configuration. Periodic data logging is automatically detected immediately prior to level 1a data processing. 2. ProSoft now includes a utility which can parse large size raw files into smaller raw files numbered sequentially. This eliminates out of memory errors which occur when processing large files. 3. ProSoft now includes a dynamic file manager option which will save hdf files and raw files in seperate directories depending on file level. The option can be enabled/disaabled through the options gui. 4. Added a new options gui which controls the file size for the large file parser and also enables/disables the dynamic file management option. The gui will allow for future inclusion of ProSoft program options. 5. Eliminated the divide by zero warning issued during water leaving radiance processing. 6. Added datetag and timetag2 data values to the profiler photosynthetically available radiation and energy fluxes level 4 products. These values can now be used as the independent variable in the hdf viewer. 7. Added new Ascii menu to hold the ascii extraction menu commands. This is available for future inclusion of other specific ascii data products. 8. Fixed incorrect matching of wavelengths in the Morel Pigment Profile level 4 data product. 9. Timetag2 data values created from ascii data extraction are now formatted to a more user friendly format. 10. Added new command buttons to seperate level 2 and level 2s data processing. Users can now process level 2 files without automatically processing level 2s files. 11. Backscattering coefficients are now offered as a level 4 data product. Data includes total volume scattering, water volume scattering, particle volume scattering, particle backscattering coefficient and total backscattering coefficient. ProSoft 7.7.1-RC8 Date: February 7, 2005 1. Bug fix: index out of bounds error which occurs during water leaving radiance processing with wavelength interpolation set at 1nm. 2. Instrument calibration\tdf files are now saved within an instrument context directory. This directory is located at <ProSoft Install Path>\Instruments\ <Context Name>. The configuration file can also be found here. 3. Mat extracted files are now saved in their own directory called 'Mat Files' located in the same directory as the hdf files being extracted. 4. Users are now allowed to selectively add sip files to an instrument context. 5. Users can now add calibration\tdf files to an already existing instrument context file allowing for greater flexibility in editing these files. 6. Now able to combine different spectral types for the same sensor type as in Ed multispectral combined with Ed hyperspectral. 7. ProSoft remembers the last working directory used between ProSoft sessions. ProSoft 7.7 Date: October, 2004 1. Changed graphics renderer mode to zbuffer which renders 3-D graphs in much less time. 2. When graphing hdf file data, users are now able to select which independant variable to graph as well as the range of the dependant variable. 3. New graphical overlay option allows users to graph data from different dependant variables belonging to the same instrument group onto the same graph. 4. Any number of ECO Sensor IOP sensors can now be processed for an instrument. Any calibration file definition is acceptable for an ECO Sensor IOP. 5. Improved reliability of sensor distances from surface and pressure reference distances. 6. Sample Delay time correction has now been applied to timer values where appropriate at level 2 processing. 7. Transmissometer sensor has been added to Level2s and 3a data processing. 8. Added Reference Ef Ev and Ld optical sensors to Level 2s and 3a data processing. 9. Any kind of profiler can now be used in Reference mode. The mode is indicated in the configuration file by selecting Reference as the instrument type. 10. Improved dynamic data processing at Levels 2s and 3a. 11. All GPS telemetry definitions are now supported. 12. Added ability to process upcasts and downcasts within the same telemetry file. 13. ECO Series IOP sensors with fluorometer sensor can now process back- scattering coefficients as a Level 4 data product. 14. Added new tool that allows conversion of hdf files to Matlab binary files (*.mat) which can be imported directly into the Matlab workspace. ProSoft 7.6.1 Date: November 21, 2003 1. Added command line interface for ProSoft. 2. Improved error handling. 3. Adjusted pressure vector resolution to 0.01m for determining the starting depth when calculating interpolation vector. This allows for interpolation vector to extend to depths shallower than 0.1m (i.e. 0.01m -> 0.09m) ProSoft 7.6 Date: November 7, 2003 1. GPS sensor data integrated into profiler/reference configurations. GPRMC, GPGLL and GPGGA only are supported. 2. TSRB mode added for all profiler/reference configurations including HyperPro II. 3. Level 4 water properties data product enabled. Instrument must have a profiler with Temp and Cond senors. 4. Level 2s depth integration resolution is now adjustable to 0.01, 0.02, 0.05 and 0.10m through parameters settings. 5. Sas integration time interval is now derived on the interval of the optical sensor with the highest rate instead of the standard of 0.1sec. 6. Conducitivity sensor data included to level 3a. 7. Temp sensor data included to level 3a. 8. Fluor sensor data included to level 3a. 9. File batch processing sequence changed. Instead of processing all files together at one level (i.e. process all files at level 1a before processing all files at level 1b), each file is processed seperately from level 1a to selected level. 10. Calibration files can now be added or removed from configuration files that are created from sip files. 11. Imported configuration files can now be saved with their original file name by clicking on 'Save' in the configuration utility. 12. Reference only or TSRB mode data are now integrated onto the time interval derived from the Es sensor instead of the previous standard of 0.1 sec. 13. Added Reference Ev optical sensor to processing. ProSoft 7.5 Date: July 31, 2003 1. Added support for level 2s GPS integration for the following GPS formats $GPRMC, $GPGLL and $GPGGA. 2. SAS GPS data is now averaged at level 3a. 3. GPS data is not available for viewing below level 2s in the hdf viewer but can be extracted using the ascii data extractor. 4. Added support for ECO Series IOP instrument for new Hyperpro II instrument. 5. Faster ascii data extraction of files. 6. Fixed bugs preventing processing for HyperTSRB Level 4 data products. ProSoft 7.4 Date: March 24, 2003 1. Processing parameters have been incorporated into one file. Access to the file is made through the new processing parameters utility. 2. Processing parameters can be easily edited through the new parameters interface. All four levels of parameters are viewed and edited at once. 3. Processing parameters have been separated from the instrument context. The new 'Processing Context' consists of both the current instrument and current processing parameters. 4. HDF viewer now includes the ability to save the graph image as a file using the png graphic format. 5. Updated ProSoft main menu. Processing level commands have been moved to the main menu for easier access. Ascii data extractor and HDF graphical viewer are now accessible through the menu 'Tools'. 6. Instrument Context creation/edit utility now allows adding or removing calibration files from the instrument context. ProSoft 7.3 Date: February 18, 2003 1. New level 2s file is introduced for all instruments. The level 2s file shows the interpolated data just prior to averaging at Level 3a. 2. Introduction of 'Instrument Context' creation and loading for easy data processing and selection between different instruments. 3. Added processing support for Satlantic Satnet instruments. 4. Easier to use Ascii data extraction utility. 5. Updated ProSoft main menu interface. 6. Addition of completely revised HDF graphical viewer utility which makes it possible to graph all hdf files in 2-D or 3-D graphical views. 7. Updated and easier to use configuration file creation/edit utility. 8. Level 4 chlorophyll a profile estimates using Morel 98 model added. 9. Level 4 chlorophyll a surface estimates using SeaBAM OC2 model (Rrs) added. 10. Level 4 chlorophyll a surface estimates using Gordon 88 model (Lwn) added. 11. Level 4 Energy profile/surface fluxes calculation added. 12. Sas data can now be processed to level 3a. ProSoft 7.2.2 Date: October 17, 2002 1. Time data associated with telemetry frames at level 3a has been changed from the Matlab serial date format to the format used in timetag2 data (e.g.YYYYMMDDDHHMMSSmmm) where DDD is the number of days since January 1 of that year. This enables time resolution down to milliseconds and reduces Level 3a processing time by up to 50%, this is especially true for deep profiles. 2. Timetag2 data appended to telemetry is no longer needed. In the absence of timetag2 data Prosoft uses the start time and rate to estimate the time for each frame in the data stream. 3. Data tables containing more than 256 columns (e.g. hyperspectral data interpolated onto 1nm intervals) when exported to ascii files are printed to a maximum of 256 columns then wrapped to the next line. This allows all the data to be imported to Excel spreadsheets without losing data beyond the 256th column. ProSoft 7.2.1 Date: September 6, 2002 1. Averaging of level 3a data near surface levels have been adjusted to match data processed with Prosoft ver 6.3d. 2. SAS processing is now only supported to Level 2 and will be supported to level 3 in release Prosoft 7.2.3. 3. Fixed bug preventing Level 1b calibration of certain types of Spmr+Smsr and Ocean Colour Profilers from calibrating reference data using CAL dark current correction. 4. Added the ability to save time data into ASCII files from Level 3a and Level 4. 5. Hyperspectral profilers and references can now be interpolated onto constant wavelength intervals. ProSoft 7.2 Date: July 26, 2002 1. ProSoft 7.2.0 now provides data processing up to Level 4 for certain instrument classes. 2. ProSoft 7.2.0 supports the following instruments to Level 4, all hyperspectral and multispectral profilers and/or references. SAS instruments are supported up to level 3. TSRB and TACCS are supported to level 2. ProSoft 7.1 Date: 2001 1. As previously, data processing starts from RAW level 1 file. From now on, all files above Level 1 are HDF files i.e. there will be no files with the extensions PRO, REF, BIN etc. 2. Data and metadata can be inspected and extracted into ASCII text files by means of HDF Inspector now, which is an integral part of ProSoft. 3. All data that follows Satlantic Instrument File Standard can be processed now. 4. For profiler data processing, LOG and PRO type dark correction has been removed from Level2 processing, and will be introduced again at processing Level 3. Note: This has not been added yet at level 3. 5. As a first step of shutter dark current correction, calibration darks are applied to 'light' and 'dark' frames. As a result Level1B files are produced. Next, shutter darks are interpolated to fit number of frames of 'light' optical data. Finally shutter darks are subtracted from 'light' optical data. As a result of subtraction, calibration darks are automatically cancelled out. As a result Level2B files are produced. Previously shutter dark correction was done also in two steps, with the difference that at the first step no dark corrections were performed (NUL correction); the second step was similar to the one described above.
What are SIP files?
Files that are delivered with Satlantic and third party equipment to describe the sensors data output and calibration coefficients come in two types. Calibration files or *.cal files and telemetry definition format files or *.tdf files. In some cases, systems are created that network many sensors together and their combined data is provided in one serial output.
The simplest example is a HOCR sensor that generates both light and dark frames. A more complex example is a HPROII profiling system that may contain as many as 5 sensors and 7 individual calibration and tdf files. These files must be used to both collect and process the data.
This can become quite confusing to keep track of all these files so Satlantic developed SIP files. All CAL and TDF files required for a system are zipped using winzip and the extension changed from *.ZIP to *.SIP. The file name includes the system description (usually the network master serial number) and the creation date. This SIP file can then be used in place of individual files to collect and process data.