Live File Processor Agent Example – HOBO

<< Click to Display Table of Contents >>

Navigation:  Live > Agents > File Agents > File Processor > Examples >

Live File Processor Agent Example – HOBO

Add the HOBO settings below to the ST_CONFIG table using the Live File Processor widget:

 

Settings

 

OBJECT_TYPE

OBJECT_VALUE

STRING_VALUE

Description

Default

dateTimeFormats

en-AU

This is a default (for all processors, unless overridden by a specific processor) setting.

 

The en-AU culture info contains all of the English (Australia) date and time formats, including d/M/y H:m:s.

HOBO

dateTimeColumnHeaderRegex

^Date Time

DT_LOGGER_DATUM.DATUM_UTC_DT; column header text starts with Date Time.

HOBO

delimiters

 ,

The fields are separated by tabs and/or commas.

HOBO

folderWatcherPath

C:\EarthSoft\Live\HOBO


HOBO

headerLinesRegex

Date Time

Header line contains Date Time.

HOBO

ignoreColumnHeadersRegex

^#$

Do not add series or datum for columns whose header text is #.

HOBO

loggerCodeHeaderLinesRegex
Groups

Plot Title:(?'a'[^&quot;\t,]*)

DT_LOGGER.LOGGER_CODE

HOBO

seriesNameColumnHeaderRegex
Groups

^(((?'a'.*?),.*)|(?'b'.*))$

DT_LOGGER_SERIES.SERIES_NAME

(e.g., 'Temp, °F (...)' => 'Temp')

HOBO

seriesUnitColumnHeaderRegex
Groups

(,.*units.*LBL:(?'a'.*?)\))|(,(?'b'.*?)\()

DT_LOGGER_SERIES.SERIES_UNIT

(e.g., 'Temp, °F (...)' => '°F', or

'Rainfall, units (... LBL: mm)' => 'mm')

HOBO

utcOffsetHeaderLinesRegex
Groups

Date Time,\s*GMT(?'a'[^&quot;\t,]*)

DT_LOGGER.UTC_OFFSET_HRS; Date Time, + zero or more whitespace characters + GMT + named group value + double-quote or tab or comma.

 

 

The following examples are processed according to the settings configured above:

Example File 1

 

 

"Plot Title: A-123"

"#","Date Time, GMT+10:00","Temp, °C (LGR S/N: 10954911, SEN S/N: 10954911)"

1,03/10/18 08:03:07,21.473

2,03/10/18 08:04:07,21.760

3,03/10/18 08:05:07,21.760

 

 

1.Title line: This line contains the DT_LOGGER.LOGGER_CODE field (A-123).

2.Header row:

a.The # column is ignored.

b.The line that contains Date Time is the header line, and contains the DT_LOGGER_DATUM.DATUM_UTC_DT column.

c.The DT_LOGGER.UTC_OFFSET_HRS value is set in the header line (GMT+10:00)

d.The other column headers contain the DT_LOGGER_SERIES.SERIES_NAME value (Rainfall) and DT_LOGGER_SERIES.SERIES_UNIT value (mm)

3.Data rows:  the remaining rows contain the DT_LOGGER_DATUM.DATUM_VALUE(s).

 

Example File 2

 

The units (mm) are inside the parentheses.

 

"Plot Title: A-123"

"#","Date Time, GMT+10:00","Rainfall, units (LGR S/N: 10954911, SEN S/N: 10954911, LBL: mm)"

1,03/10/18 08:03:07,0.0

2,03/10/18 10:10:52,0.5

3,03/10/18 10:10:53,1.0

 

 

Example File 3

 

The fields are separated by tabs instead of commas.

 

Note: For this example, dateTimeFormats cannot be en-AU; it should be local or en-US.  Add the "dateTimeFormats" ST_CONFIG. OBJECT_VALUE setting as an additional line in the ST_CONFIG table, with a ST_CONFIG.STRING_VALUE of "en-us"

Plot Title: B-456                                                

#        "Date Time, GMT-05:00"        "Temp, °F (LGR S/N: 20186732, SEN S/N: 20186732)"        Coupler Detached (LGR S/N: 20186732)        Coupler Attached (LGR S/N: 20186732)        Host Connected (LGR S/N: 20186732)        End Of File (LGR S/N: 20186732)

1        11/29/2017 10:56        68.913                                

2        11/29/2017 10:56                Logged                        

3        11/29/2017 11:11        69.942