Node on Operational Data Services

National Meteorological and Hydrological Services (NMHSs) in the Pacific Islands use and archive climate, ocean and hydrology data from locally owned and
managed observation networks or partner and CROPs managed networks. Climate, ocean and hydrology data are quality checked and archived in local or
regional climate databases. This webpage provides information on metadata and data availability, parameters available and databases used in the region.

Important links & functions – Operational Data Services

Functions	Activities	Criteria
Operational Data Services, to support operational LRF and climate monitoring	Provide climate database and archiving services, at the request of NMHSs	Products: national databases with metadata, accessible to the NMHS in question (backup service, development site, etc). Elements: as determined by the NMHS Update: at the request of the NMHS	Mandatory Functions Bureau of Meteorology Climate Data for the Environment (CliDE) supports data management in 15 Pacific Island countries and Timor Leste. The Pacific Island countries are Palau, FSM, RMI, PNG, Solomon Islands, Vanuatu, Fiji, Tonga, Samoa, Niue, Tokelau, Cook Islands, Nauru, Kiribati and Tuvalu. CliDE instances have also been made available to SPC, University of the South Pacific and SPREP. CliDE is currently funded by Australian and New Zealand Aid funded COSPPac. Most countries use CliDE-in-the-Cloud which involves CliDE being delivered via Amazon Web Services (AWS). The remaining countries use CliDE via a COSPPac funded and maintained server set-up within the NMHS. Server CliDE data is backed-up to AWS daily. CliDE software is updated as required. Access to CliDE is restricted to the respective NMHS or CROP agencies. CliDE allows NMHSs to archive metadata, upper air, tide gauge and surface meteorological observations. Data can be archived at 1-min to monthly timescales. CliDE contains keyentry forms which look like the Pacific NMHS field books. Bulk manual ingestion and automated ingestion of automated data is also possible. CliDE contains 'Stage-1' quality control which involves data being checked for outliers on entry to the database. The default thresholds are based on WMO-No.8 (Volume 1 – Measurement of Meteorological Variables). NMHSs can set and use national thresholds where available. Semi-automated 'Stage-2' quality control which runs overnight is based on the Bureau of Meteorology Quality Management System. A range of basic products in the form of a range of data exports, graphs, tables, data views are available to users. User-training in the use of CliDE is provided as project funds permit. At least one user training workshop is provided per year on a regional or national scale. For more information on CliDE and for CliDE support email: CliDE_Support@bom.gov.au Bureau of Meteorology Climate Data Online archives historical data and metadata for Willis, Norfolk and the Lord Howe Islands in the western and subtropical south Pacific NIWA National Climate Database archives historical climate data and metadata for Vanuatu, Solomon Islands, PNG, Fiji, Tonga, Niue, Samoa, Tokelau, Cook Islands, Kiribati, Tuvalu, Pitcairn Islands, and Raoul Island via New Zealand's National Climate Database. Additionally, NIWA hosts collection and storage of near real-time hydro-meteorological and coastal data from Vanuatu, Solomon Islands, PNG, Fiji, Tonga, Niue, Samoa, Cook Islands, Kiribati, and Tuvalu NHMS’s using the NEON IP telemetry system, that provides automated integration with the CliDE database and use in CliDEsc, a web-based content management system and product generator library developed by NIWA in consultation with Pacific NHMS’s and the Australian Bureau of Meteorology. Access to NHMS country data archived or hosted by NIWA via any means listed above is restricted (except for Raoul and Pitcairn Islands) while metadata is unrestricted. Access is granted based on approval from the respective Pacific NMHS. NOAA's Climate Data Online provides free access to the US National Centers for Environmental Information (NCEI) archive of global historical weather and climate data in addition to station history information. This includes data for the US State of Hawaii, Wake Island, Northern Mariana Islands, Guam, Palau, FSM, RMI and American Samoa. These data include quality controlled daily, monthly, seasonal, and yearly measurements of temperature, precipitation, wind, and degree days as well as radar data and 30-year Climate Normals. NOAA's Integrated Surface Database is a global database that consists of hourly and synoptic surface observations compiled from numerous sources including US State of Hawaii, Wake Island, Northern Mariana Islands, Guam, Palau, FSM, RMI and American Samoa into a single common ASCII format and common data model. ISD integrates data from more than 100 original data sources, including numerous data formats that were key-entered from paper forms during the 1950s–1970s time frame. ISD includes numerous parameters such as wind speed and direction, wind gust, temperature, dew point, cloud data, sea level pressure, altimeter setting, station pressure, present weather, visibility, precipitation amounts for various time periods, snow depth, and various other elements as observed by each station. Météo-France Portal provides climate data for French Polynesia, New Caledonia and Wallis & Futuna. It includes basic in-situ quality-controlled data, as well as synthetic data obtained by statistical processing (averages, standard deviations, records, accumulations, daily / monthly / annual summary), generally in the form of tables in text format. This website provides adjusted and homogenized climate data for many climatological stations in French Polynesia and New Caledonia These data were created for use in climate change studies. This portal gives also access to spatialized data, i.e., climate data extrapolated over a set of regularly spaced points. These are not directly observed values but reconstructed by algorithms based on direct measurements and numerical models. Please contact Météo-France local offices for further enquiry or any assistance for non-French speakers. Météo-France Climate Archive preserves the memory of the French climate. The Climate Archive holds paper meteorological records collected by the French national meteorological services from the 19th century onwards. These archives observations for French Polynesia, New Caledonia and Wallis & Futuna. Records include terrestrial and upper air data. Catalogues and imaged documents are available on the new Météo-France website http://archives-climat.fr Please contact Météo-France local offices for further enquiry or any assistance for non-French speakers. Highly Recommended Functions Bureau of Meteorology Southern Hemisphere Tropical Cyclone Data Portal and Western North Pacific Tropical Cyclone Data Portal improve knowledge of past tropical cyclone activity in the Pacific Islands by archiving quality controlled and plotting tracks of cyclones from 1969. Meteorologists and stakeholders can use this tool to analyse the tracks of historical tropical cyclones and relate them to the impact on lives and infrastructure recorded on the ground. NIWA Tideda Time Dependent Data database is available for archiving and analysing timeseries data. It is currently the primary hydrological database in Vanuatu, Solomon Islands, PNG, Fiji, Samoa, and Cook Islands and can also store other environmental variables. The collection and storage of near real-time hydrological data from , Solomon Islands, PNG, Fiji, Samoa, and Cook Islands NHS’s uses the NEON IP telemetry system, that provides automated integration with the Tideda hydrological data base and with CliDEsc, a web-based content management system and product generator library developed by NIWA in consultation with Pacific NHMS’s and the Australian Bureau of Meteorology. SPREP Traditional Knowledge Database initially developed by The Bureau of Meteorology then transitioned to SPREP is funded via multiple projects (COSPPac, VanKIRAP, WMO CREWS and UNEP CIS-Pac5). It provides the Solomon Islands, Vanuatu, Tonga, Niue and Samoa with a central register to manage and store their climate-related traditional knowledge records. The TK database stores information such as: biological indicators (i.e. plants and animals), physical indicators (e.g. clouds, winds, astronomical), details about interviews (e.g. who was interviewed, by whom, when and where), changes in the indicators, expected outcomes (e.g. drought, heavy rain), time-series data about the observations of the indicators, verification data from seasonal forecasts and related files (e.g. photos, audio, video, documents). Bureau of Meteorology Real Time Data Display provides pre-quality controlled near time tide gauge observations for the above locations. Historical quality controlled hourly and monthly tide gauge data are available via The Bureau of Meteorology Pacific Sea Level and Geodetic Monitoring Project website. The above data is also available via the SPC Pacific Ocean Portal which also presents the data in graphical format. The Bureau of Meteorology and Pacific Community (SPC) maintain 13 permanent tide gauge facilities in FSM, RMI, PNG, Solomon Islands, Vanuatu, Fiji (2), Tonga, Niue, Samoa, Cook Islands, Nauru, Kiribati, and Tuvalu. The project is funded by COSPPac. Tide gauge facilities monitor sea level, water temperature, wind, air temperature and barometric pressure. In addition to its system of tide gauge facilities, Geoscience Australia maintain a network of earth monitoring stations for geodetic observations. The earth monitoring installations provide Global Navigation Satellite System (GNSS) measurements to allow absolute determination of the vertical height of the tide gauges that measure sea level. University of Hawaii Sea Level Center (UHSLC) operate and/or maintain 16 tide gauges in Palau, FSM, NMI, Kiribati, Palmyra Atoll, Cook Islands, French Polynesia, Johnston Atoll and Hawaii. The UHSLC offers tide gauge data with two levels of quality-control (QC), where more rigorous QC requires more effort and a greater time-lag. Fast Delivery (FD) data are released within 1-2 months of data collection and receive only basic QC focused on large level shifts and obvious outliers. FD data are replaced in the data stream by RQD (see below) as the latter becomes available. Research Quality Data (RQD) receive thorough QC and are considered to be the final science-ready data set. This final QC process is time-consuming, and as a result, the RQD are released 1-2 years after data is received from the data originators by the UHSLC. NOAA's National Ocean Service Tide Gauge and Water Temperature Data NOAA's National Ocean Service has five tide gauges (Apra Harbor Guam, Pago Bay Guam, Wake Island, Kwajalein, Pago Pago American Samoa)
	Develop quality controlled regional climate datasets, gridded where applicable	Products: regional, quality controlled climate datasets, gridded where applicable, following CCl guidance on QA/QC procedures Elements: Mean, Max and Min Temperature, and Precipitation, at a minimum Temporal resolution: daily Update: monthly	Mandatory Functions: Quality controlled mean, maximum and minimum air temperature and precipitation at a daily timescale updated at least once a month is available via CliDE, The Bureau of Meteorology Climate Data Online, NIWA DataHub, NOAA Climate Data Online, NOAA ISD and Météo-France's Climate Archives. Highly Recommended Functions: Quality controlled tropical cyclone data is available via The Bureau of Meteorology Southern Hemisphere Tropical Cyclone Data Portal and Western North Pacific Tropical Cyclone Portal. Quality controlled sea level and ocean temperature is available via the Bureau of Meteorology PSLGM website, SPC Pacific Ocean Portal and UHSLC Sea Level Center website.

Functions

Activities

Criteria

Operational Data Services, to support operational LRF and climate monitoring

Provide climate database and archiving services, at the request of NMHSs

Products: national databases with metadata, accessible to the NMHS in question (backup service, development site, etc). Elements: as determined by the NMHS Update: at the request of the NMHS

Mandatory Functions

Bureau of Meteorology Climate Data for the Environment (CliDE) supports data management in 15 Pacific Island countries and Timor Leste. The Pacific Island countries are Palau, FSM, RMI, PNG, Solomon Islands, Vanuatu, Fiji, Tonga, Samoa, Niue, Tokelau, Cook Islands, Nauru, Kiribati and Tuvalu. CliDE instances have also been made available to SPC, University of the South Pacific and SPREP. CliDE is currently funded by Australian and New Zealand Aid funded COSPPac. Most countries use CliDE-in-the-Cloud which involves CliDE being delivered via Amazon Web Services (AWS). The remaining countries use CliDE via a COSPPac funded and maintained server set-up within the NMHS. Server CliDE data is backed-up to AWS daily. CliDE software is updated as required. Access to CliDE is restricted to the respective NMHS or CROP agencies.

CliDE allows NMHSs to archive metadata, upper air, tide gauge and surface meteorological observations. Data can be archived at 1-min to monthly timescales. CliDE contains keyentry forms which look like the Pacific NMHS field books. Bulk manual ingestion and automated ingestion of automated data is also possible. CliDE contains 'Stage-1' quality control which involves data being checked for outliers on entry to the database. The default thresholds are based on WMO-No.8 (Volume 1 – Measurement of Meteorological Variables). NMHSs can set and use national thresholds where available. Semi-automated 'Stage-2' quality control which runs overnight is based on the Bureau of Meteorology Quality Management System. A range of basic products in the form of a range of data exports, graphs, tables, data views are available to users. User-training in the use of CliDE is provided as project funds permit. At least one user training workshop is provided per year on a regional or national scale. For more information on CliDE and for CliDE support email: CliDE_Support@bom.gov.au

Bureau of Meteorology Climate Data Online archives historical data and metadata for Willis, Norfolk and the Lord Howe Islands in the western and subtropical south Pacific

NIWA National Climate Database archives historical climate data and metadata for Vanuatu, Solomon Islands, PNG, Fiji, Tonga, Niue, Samoa, Tokelau, Cook Islands, Kiribati, Tuvalu, Pitcairn Islands, and Raoul Island via New Zealand's National Climate Database.

Additionally, NIWA hosts collection and storage of near real-time hydro-meteorological and coastal data from Vanuatu, Solomon Islands, PNG, Fiji, Tonga, Niue, Samoa, Cook Islands, Kiribati, and Tuvalu NHMS’s using the NEON IP telemetry system, that provides automated integration with the CliDE database and use in CliDEsc, a web-based content management system and product generator library developed by NIWA in consultation with Pacific NHMS’s and the Australian Bureau of Meteorology.

Access to NHMS country data archived or hosted by NIWA via any means listed above is restricted (except for Raoul and Pitcairn Islands) while metadata is unrestricted. Access is granted based on approval from the respective Pacific NMHS.

NOAA's Climate Data Online provides free access to the US National Centers for Environmental Information (NCEI) archive of global historical weather and climate data in addition to station history information. This includes data for the US State of Hawaii, Wake Island, Northern Mariana Islands, Guam, Palau, FSM, RMI and American Samoa. These data include quality controlled daily, monthly, seasonal, and yearly measurements of temperature, precipitation, wind, and degree days as well as radar data and 30-year Climate Normals.

NOAA's Integrated Surface Database is a global database that consists of hourly and synoptic surface observations compiled from numerous sources including US State of Hawaii, Wake Island, Northern Mariana Islands, Guam, Palau, FSM, RMI and American Samoa into a single common ASCII format and common data model. ISD integrates data from more than 100 original data sources, including numerous data formats that were key-entered from paper forms during the 1950s–1970s time frame. ISD includes numerous parameters such as wind speed and direction, wind gust, temperature, dew point, cloud data, sea level pressure, altimeter setting, station pressure, present weather, visibility, precipitation amounts for various time periods, snow depth, and various other elements as observed by each station.

Météo-France Portal provides climate data for French Polynesia, New Caledonia and Wallis & Futuna. It includes basic in-situ quality-controlled data, as well as synthetic data obtained by statistical processing (averages, standard deviations, records, accumulations, daily / monthly / annual summary), generally in the form of tables in text format. This website provides adjusted and homogenized climate data for many climatological stations in French Polynesia and New Caledonia These data were created for use in climate change studies. This portal gives also access to spatialized data, i.e., climate data extrapolated over a set of regularly spaced points. These are not directly observed values but reconstructed by algorithms based on direct measurements and numerical models. Please contact Météo-France local offices for further enquiry or any assistance for non-French speakers.

Météo-France Climate Archive preserves the memory of the French climate. The Climate Archive holds paper meteorological records collected by the French national meteorological services from the 19th century onwards. These archives observations for French Polynesia, New Caledonia and Wallis & Futuna. Records include terrestrial and upper air data. Catalogues and imaged documents are available on the new Météo-France website http://archives-climat.fr Please contact Météo-France local offices for further enquiry or any assistance for non-French speakers.

Highly Recommended Functions

Bureau of Meteorology Southern Hemisphere Tropical Cyclone Data Portal and Western North Pacific Tropical Cyclone Data Portal improve knowledge of past tropical cyclone activity in the Pacific Islands by archiving quality controlled and plotting tracks of cyclones from 1969. Meteorologists and stakeholders can use this tool to analyse the tracks of historical tropical cyclones and relate them to the impact on lives and infrastructure recorded on the ground.

NIWA Tideda Time Dependent Data database is available for archiving and analysing timeseries data. It is currently the primary hydrological database in Vanuatu, Solomon Islands, PNG, Fiji, Samoa, and Cook Islands and can also store other environmental variables.

The collection and storage of near real-time hydrological data from , Solomon Islands, PNG, Fiji, Samoa, and Cook Islands NHS’s uses the NEON IP telemetry system, that provides automated integration with the Tideda hydrological data base and with CliDEsc, a web-based content management system and product generator library developed by NIWA in consultation with Pacific NHMS’s and the Australian Bureau of Meteorology.

SPREP Traditional Knowledge Database initially developed by The Bureau of Meteorology then transitioned to SPREP is funded via multiple projects (COSPPac, VanKIRAP, WMO CREWS and UNEP CIS-Pac5). It provides the Solomon Islands, Vanuatu, Tonga, Niue and Samoa with a central register to manage and store their climate-related traditional knowledge records. The TK database stores information such as: biological indicators (i.e. plants and animals), physical indicators (e.g. clouds, winds, astronomical), details about interviews (e.g. who was interviewed, by whom, when and where), changes in the indicators, expected outcomes (e.g. drought, heavy rain), time-series data about the observations of the indicators, verification data from seasonal forecasts and related files (e.g. photos, audio, video, documents).

Bureau of Meteorology Real Time Data Display provides pre-quality controlled near time tide gauge observations for the above locations. Historical quality controlled hourly and monthly tide gauge data are available via The Bureau of Meteorology Pacific Sea Level and Geodetic Monitoring Project website. The above data is also available via the SPC Pacific Ocean Portal which also presents the data in graphical format.

The Bureau of Meteorology and Pacific Community (SPC) maintain 13 permanent tide gauge facilities in FSM, RMI, PNG, Solomon Islands, Vanuatu, Fiji (2), Tonga, Niue, Samoa, Cook Islands, Nauru, Kiribati, and Tuvalu. The project is funded by COSPPac. Tide gauge facilities monitor sea level, water temperature, wind, air temperature and barometric pressure. In addition to its system of tide gauge facilities, Geoscience Australia maintain a network of earth monitoring stations for geodetic observations. The earth monitoring installations provide Global Navigation Satellite System (GNSS) measurements to allow absolute determination of the vertical height of the tide gauges that measure sea level.

University of Hawaii Sea Level Center (UHSLC) operate and/or maintain 16 tide gauges in Palau, FSM, NMI, Kiribati, Palmyra Atoll, Cook Islands, French Polynesia, Johnston Atoll and Hawaii. The UHSLC offers tide gauge data with two levels of quality-control (QC), where more rigorous QC requires more effort and a greater time-lag. Fast Delivery (FD) data are released within 1-2 months of data collection and receive only basic QC focused on large level shifts and obvious outliers. FD data are replaced in the data stream by RQD (see below) as the latter becomes available. Research Quality Data (RQD) receive thorough QC and are considered to be the final science-ready data set. This final QC process is time-consuming, and as a result, the RQD are released 1-2 years after data is received from the data originators by the UHSLC.

NOAA's National Ocean Service Tide Gauge and Water Temperature Data NOAA's National Ocean Service has five tide gauges (Apra Harbor Guam, Pago Bay Guam, Wake Island, Kwajalein, Pago Pago American Samoa)

Develop quality controlled regional climate datasets, gridded where applicable

Products: regional, quality controlled climate datasets, gridded where applicable, following CCl guidance on QA/QC procedures Elements: Mean, Max and Min Temperature, and Precipitation, at a minimum Temporal resolution: daily Update: monthly

Mandatory Functions:

Quality controlled mean, maximum and minimum air temperature and precipitation at a daily timescale updated at least once a month is available via CliDE, The Bureau of Meteorology Climate Data Online, NIWA DataHub, NOAA Climate Data Online, NOAA ISD and Météo-France's Climate Archives.

Highly Recommended Functions:

Quality controlled tropical cyclone data is available via The Bureau of Meteorology Southern Hemisphere Tropical Cyclone Data Portal and Western North Pacific Tropical Cyclone Portal.

Quality controlled sea level and ocean temperature is available via the Bureau of Meteorology PSLGM website, SPC Pacific Ocean Portal and UHSLC Sea Level Center website.