Live NOAA NCDC Agent

<< Click to Display Table of Contents >>

Navigation:  Live > Agents > Web API Agents > Web API Open Data >

Live NOAA NCDC Agent

The National Oceanic and Atmospheric Administration (NOAA) National Climatic Data Center (NCDC) Agent is a data loading agent available in EQuIS Live used for obtaining weather data from the NOAA NCDC FTP site (ftp://ftp.ncdc.noaa.gov/pub/data/noaa).

 

Note: Due to the deprecation of FTP support by browsers such as Chrome, Firefox, and Microsoft Edge, users may need to access the resources at the provided FTP URLs via an FTP client (WinSCP, etc.).

 

Adding Station(s)

 

Before using the NOAA NCDC Agent, add one or more stations to the DT_LOGGER table:

1.Execute the equis.get_ids stored procedure to get a new LOGGER_ID, or add the station (DT_LOGGER row) in EQuIS Professional.

2.Set LIVE_DATA_SOURCE to NOAA-NCDC.

3.Set LOGGER_CODE to a station ID. A station ID can be searched for in the NOAA-NCDC station list at ftp://ftp.ncdc.noaa.gov/pub/data/noaa/isd-history.csv.

For example, 724940-23234 (USAF = 724940, WBAN = 23234, separated by a dash) for the San Francisco International Airport. (You can find the country abbreviations at ftp://ftp.ncdc.noaa.gov/pub/data/noaa/country-list.txt).

4.Set STATUS_FLAG to 'A' to activate the logger.

 

 

Loading Data

 

The NOAA NCDC Agent or Historical Data Loader can be run as a scheduled EQuIS Information Agent (EIA), at the desired frequency, to automatically load data as often as needed.

 

The NOAA NCDC Agent or Historical Data Loader can also be run in EQuIS Professional or Enterprise (using the EZView widget) to load the data manually, without having to schedule an EIA.

 

The NOAA NCDC Agent will load data for all loggers with LIVE_DATA_SOURCE set to NOAA-NCDC. When the report is run initially, the agent will retrieve values from a logger's site (DT_LOGGER.LOGGER_CODE) for the past one month. If data has been previously loaded for that logger, the agent will request data from the logger's most recent date (in DT_LOGGER_DATUM.DATUM_UTC_DT) until today's date.

 

The NOAA NCDC Historical Data Loader allows the user to select the loggers and date range, and has the following input parameters:

Logger(s) Select the stations for which to load data. If no stations are selected, the agent will load data for all NOAA NCDC stations.

Date Range – Select a date range; choose from recent, period, or start and end dates. The recent option works the same way as the NOAA NCDC Agent. If the period option is selected, a period must be specified in ISO-8601 duration format. If the start and end dates option is selected, start and end dates must be specified.

Update existing values? – Check this box to update existing EQuIS Live data values.

 

Note: The NOAA NCDC Agent or Historical Data Loader gets the weather data from files like ftp://ftp.ncdc.noaa.gov/pub/data/noaa/2020/724940-23234-2020.gz. (This file can be unzipped and opened in a text editor.) ftp://ftp.ncdc.noaa.gov/pub/data/noaa/isd-format-document.docx contains information for how to read the data in this file.

 

The NOAA NCDC Agent or Historical Data Loader adds a DT_LOGGER_SERIES row for each of the following series. However, some of the stations may not have one or more of the series listed below, in which case those series will not be added.

 

SERIES_NAME

SERIES_UNIT

Description

isd-format-document.docx

Air Temperature

degrees Celsius

The temperature of the air.

Mandatory Data Section, position 88-92.

Atmospheric Pressure

hectopascals

The air pressure relative to Mean Sea Level (MSL).

Mandatory Data Section, position 100-104.

Atmospheric Pressure, Altimeter

hectopascals

The pressure value to which an aircraft altimeter is set so that it will indicate the altitude relative to mean sea level of an aircraft on the ground at the location for which the value was determined.

Additional Data Section, identifier MA1.

Atmospheric Pressure, Station

hectopascals

The atmospheric pressure at the observation point.

Additional Data Section, identifier MA1.

Hourly Precipitation

May be different for different stations
(e.g., IN)

The hourly precipitation values and units are obtained from the 'summary of day' info.
 
e.g., ... HOURLY INCREMENTAL PRECIPITATION VALUES (IN):.00 0.00 0.00 0.00 T    T    0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 ...


Wind Direction

angular degrees

The angle, measured in a clockwise direction, between true north and the direction from which the wind is blowing.

Mandatory Data Section, position 61-63.

Wind Speed

m/s

The rate of horizontal travel of air past a fixed point.

Mandatory Data Section, position 66-69.

 

A series can then be activated or deactivated, by setting its STATUS_FLAG = "A" or "R", to start or stop (respectively) obtaining data for it. A series' SERIES_DESC may be changed, but not the SERIES_NAME or SERIES_UNIT; they uniquely identify the series.