Large-Scale Operational Data Matchup Service for Multiple Platform Types
Principal Investigator: Nga Chung, NASA’s Jet Propulsion Laboratory
Initial experience with and development of the Distributed Oceanographic Match-Up Service (DOMS) were achieved through NASA's Advanced Information Systems Technology (AIST) Program funding and subsequently as a component of the OceanWorks platform. These capabilities will be significantly advanced and generalized to make DOMS suitable as a user operational service at NASA's Physical Oceanography Distributed Active Archive Center (PO.DAAC).
Currently, DOMS consists of four distributed data nodes (one for satellite data at PO.DAAC and three for in situ data observations at the National Center for Atmospheric Research (NCAR), Florida State University, and PO.DAAC), a suite of APIs supporting user queries to retrieve matched datasets and data subsets, and an interactive web-based matchup tool that provides satellite-to-in situ data matching for sea surface temperature, seawater salinity, and ocean wind vector data.
This project will update the DOMS architecture to leverage cloud-native services. The target advancements proposed, and necessary to make DOMS a highly impactful tool for data-intensive research, include
- In situ observation matchups with Level 2 (L2) satellite swath data,
- Support of L2 satellite-to-satellite matches,
- Development of a job queueing and processing system to govern cloud-based computation and data handling of delayed mode, large requests,
- Refinements to an exploratory web application that supports small matching requests and defining user workflows,
- Enhancements to the existing APIs to accommodate the new functionality and improve interoperable services,
- Collection of detailed usage metrics to enhance end-user services; and
- Demonstration of efficient on-boarding of new datasets and in situ data providers.
Although specific data sets will be used to test and fully demonstrate the system, a flexible and modular design that will easily accommodate current and future data assets will be maintained and made adaptable to new technologies. Coordination between the non-NASA partners and PO.DAAC will further enrich the in situ data resources to include, in near-real-time, new measurement platforms (e.g., Saildrone), and to accommodate the deployment of new in situ data nodes (e.g., World Ocean Database).
Expanding DOMS to support L2 satellite-to-in situ and satellite-to-satellite data matching will create a service that utilizes NASA’s Earth Science data and enables applied scientific research and development to fulfill NASA’s Earth Science mission. These enhancements will support several NASA oceanography-related projects and science team activities with an ongoing need for a generalized match service capability.
The in situ data nodes currently supported by DOMS are the International Comprehensive Ocean-Atmosphere Dataset (ICOADS, hosted at NCAR), the Shipboard Automated Meteorological and Oceanographic System (SAMOS, hosted at FSU), and the Salinity Processes in the Upper Ocean Regional Studies (SPURS-1 and 2, hosted at PO.DAAC). A Saildrone in situ data node will be onboarded for the purposes of exercising near real-time matchup use cases.
Page Last Updated: Sep 24, 2020 at 10:58 AM EDT