GCOOS Web Accessible Folder

To facilitate data access, GCOOS maintains a Web Accessble Folder (WAF) for all of its holdings. The WAF (http://data.gcoos.org/data/waf) is structured as shown in the left.

WAF Structure SHA384
 

Each data folder contains a SHA384 hash file (SHA384SUM) that can be used for any collision-resistant application. SHA384SUM can be used to validate downloaded files, check if a file was modified, or if there are new files added to the folder.

 

csv_by_observation
 

This folder contains two subfolders, 'complete' and 'ldn.' GCOOS also reports data from federal sources such as buoys maintained by the National Data Buoy Center (NDBC), National Ocean Service (NOS), National Estuarine Research Reserve System (NERRS), and Everglades National Park (ENP). The Sensor Observation Service (SOS) endpoint from NDBC at http://sdf.ndbc.noaa.gov/sos/, and SOS endpoint of teh Center for Operational Oceanographic Products and Services (CO-OPS) at http://opendap.co-ops.nos.noaa.gov/ioos-dif-sos/, remains to be the authoritative sources of these data.

Data collected from federal assets , and that from non-federal sources (i.e. from Local Data Nodes or LDN) are included the 'complete' folder. Data that are collated only from GCOOS partners in the Gulf region, are in the 'ldn' folder.

The data files are summarized by observation, and segregated by year. GCOOS started its operation in July of 2008. New platforms and capacity were increased throughout the years of operation, providing the community with more data as the capacity improved. All files in these folders follows the following syntax:

'gcoos_'+<variable>+"_"+<year>+"_"+<month>+".csv"

All file are suffixed with '.csv' to indicate the data format, i.e. Comma Separate Values. The files in these folders have a corresponding ISO 19115 Parts 1 (https://geo-ide.noaa.gov/wiki/index.php?title=Category:ISO_19115) and 2 (https://geo-ide.noaa.gov/wiki/index.php?title=ISO_19115-2_(Geographic_Information_%E2%80%93_Metadata_Part_2)), a recommended presentation of ISO 19139 standard (https://geo-ide.noaa.gov/wiki/index.php?title=Category:ISO_19139). -2 metadata file using the same filenaming syntax as above but suffixed with '.xml' to indicate data format.

 

csv_by_platform
 

This folder contain files, summarized by platform or stations. Data from federal assets are summurized in the 'federal' folder and further seggregated by year. Data from GCOOS Local Data Nodes (LDN) are in the 'ldn' folders.

Atmospheric observations are in the 'atm' folder and oceanographic observations in the 'ocn' folder. The following are the variables classified as 'atmospheric':

1. air_pressure (mbar)
2. air_temperature (Celsius)
3. dew_point_temperature (Celsius)
4. relative_humidity (%)
5. wind_speed (m s-1)
6. wind_speed_of_gust (m s-1)
7. wind_to_direction (degrees_true)

The oceanopgraphic variables, arranged according the date, time and depth from where the observation was observed:

1. sea_water_speed (cm s-1)
2. direction_of_sea_water_velocity (degrees_true)
3. upward_sea_water_velocity (cm s-1)
4. eastward_sea_water_velocity (cm s-1)
5. northward_sea_water_velocity (cm s-1)
6. mass_concentration_of_chlorophyll_in_sea_water (ug L-1)
7. mole_concentration_of_dissolved_molecular_oxygen_in_sea_water (ug L-1)
8. sea_surface_height_above_sea_level (m)
9. sea_water_practical_salinity (PSU),
10. sea_water_temperature (Celsius)
11. sea_water_turbidity (NTU)

The monthly summaries have a corresponding *.hdr file that contains header records for the file. The following are the contents of the HDR file:

1. period in YYYY-MM format
2. the station URN suffice
3. station URL
4. station description
5. naming authority
6. name given by naming authority
7. instruments used
8. description of instrumnets
9. station latitude
10. station longitude
11. number of data records in the corresponding CSV file

nc_by_platform
 

This folder contains the netCDF4 (classic) equivalent of the files in 'csv_by_platform' folder. It also have the same directory structure. The netCDF4 files are in compliance to IOOS standard, based on the NCEI recommendations at https://sites.google.com/a/noaa.gov/ncei-ioos-archive/cookbook?pli=1#TOC-Providing-Data-Integrity and in compliance with the NODC Profile Orthogonal specification at http://www.nodc.noaa.gov/data/formats/netcdf/v1.1/profileOrthogonal.cdl

The Python script used to generate the netCDF files are in the GCOOS GitHub folder (https://github.com/GCOOS/csv2nc).