mbm_makedatalistSection: MB-System 5.0 (1)
Updated: 21 September 2017
NAMEmbm_makedatalist - Macro to generate a datalist of the swath files in a specified directory.
SYNOPSISmbm_makedatalist [-Fformat -Idirectory -Odatalist -P -Ssuffix -T -H -V]
DESCRIPTIONMbm_makedatalist is a macro to generate an MB-System datalist file referencing all identifiable swath files in the specified target directory.
Datalists are fundamental structures in MB-System workflows because they allow programs to operate on sets of swath data files. Datalist files are text lists of swath data files and their format ids with each file entry taking up a single line. These lists may contain references to other datalists, making them recursive. Datalists may also contain comments and parsing directives that, for example, determine whether parsing returns references to raw or processed data files. See the MB-System manual page for details on the format and structure of datalists.
This macro is used to easily construct a datalist referencing swath files in a directory, often as part of setting up the MB-System processing environment for a new seafloor mapping dataset. By default, mbm_makedatalist tests all of the filenames in the local directory for adherence to the MB-System swath file naming convention (see the mbsystem manual page for details), and makes an output datalist including all of the files that can be recognized as swath data. This can include files with suffixes such as ".mb88", that are recognized as format 88 (Reson s7k) files, and files with recognized vendor format suffixes, such as "_raw.all" or ".all" for old and recent Kongsberg multibeam data, respectively. The suffix of the files to be considered can be specified with the -Ssuffix option; under most circumstances this is the best approach as it prevents mbm_makedatalist from including files that are not intended for inclusion by the user yet satisfy one of the many recognized naming conventions. By default, mbm_makedatalist infers the format id of included files using the naming conventions. The format id can be specified using the -Fformat option.
MB-System differentiates between raw and processed files by inserting the letter "p" into the processed file name immediately before the filename suffix. For instance, for Reson 7k data the raw files will have file suffix of *.mb88, and the processed files generated by mbprocess will end with *p.mb88. When using mbm_makedatalist to generate a datalist by specifying a suffix, processed files can be excluded from the datalist by also specifying the -P option. Thus it is possible to generate a datalist of raw files in a directory containing both raw and processed file.
The output datalist will be placed in the current working directory. The output datalist is named datalist.mb-1 by default, but can be specified with the -O option. If no target directory is specified with the -I option, then the current working directory is used. In order for swath files to be recognized and included in the datalist, they must conform to the MB-System swath file naming convention (see the mbsystem manual page for details).
Most seafloor mapping sonars and datalogging packages produce original swath data files with names constructed so that standard directory listings are in time order. However, Kongsberg multibeam data filenames usually start with a survey file number that restarts at 0001 whenever datalogging is stopped and restarted. Consequently, when data from multiple instances of logging are present in a single directory, the simple listing of files will not in general be in time order. If the file suffix is declared to be ".all" or ".ALL" using the -S option, then mbm_makedatalist will attempt to sort the swath files into time order before generating the final datalist. This behavior can be disabled by specifying the -T option.
MB-SYSTEM AUTHORSHIPDavid W. Caress
Monterey Bay Aquarium Research Institute
Dale N. Chayes
Center for Coastal and Ocean Mapping
University of New Hampshire
Christian do Santos Ferreira
MARUM - Center for Marine Environmental Sciences
University of Bremen
Last Updated: 21 September 2017