1. Collaborate
  2. Adding New Data to EOSDIS
  3. Earth Science Data Systems Level of Service Model

Earth Science Data Systems Level of Service Model

Overview

Data archived at NASA’s Earth Science Data Systems (ESDS) data repositories are provided long-term, high-quality data stewardship that includes more services than just data archival and distribution.

However, each individual data product cannot and likely should not have all the same services applied. The typical goal is to apply the appropriate amount of services to a data product to optimize data usability and access while also balancing the resources, time, and effort required from both the data provider and the data repository.

The Level of Service model is designed to bring consistency to service determinations for data across all NASA ESDS data repositories and to improve communication of the data archival roles and responsibilities, making it easier for data producers and data users to know what to expect with respect to data stewardship of a given data product.

The term "Level of Service" refers to the quantity and types of services applied to data during archival and preservation. Services include the activities related to data ingest, storage, documentation, distribution, assurance of usability and discovery, user support, outreach, and preservation.

The process of determining what services to provide a data product has previously been carried out independently at each of NASA's Distributed Active Archive Centers (DAACs). Therefore, data producers interacting with different data repositories may not have received the same services for similar data products. This has led to data producer confusion and frustration and highlighted the need for creating a common model. The primary goals of the Level of Service Model are to:

  • Provide a framework for clearly communicating information about data stewardship at NASA ESDS data repositories.
  • Use consistent terminology so that data producers interacting with multiple data repositories can understand the process no matter which data repository they interact with.
  • Present clear definitions and service level descriptions so that all data producers and users can understand how services are assigned and have realistic expectations of data repository effort.
  • List ESDS common data stewardship requirements by service level. Data repository-specific services are not included in the model and would need to be specified separately. 
  • Improve enterprise-wide transparency, efficiency, and cost-effectiveness of the data stewardship process.

How is Service Level Assigned?

Service levels are assigned based on an assessment of the best investment of NASA resources to maximize the overall science value of NASA-funded data. The data processing level and data product category assigned by NASA provide a framework for determining the appropriate level of service. However, science needs, data age, and level of effort may drive increases or decreases in assigned service level. Level of effort, and thus the practicality of specific services, can be greatly affected by the comprehensiveness and clarity of the supplied documentation and metadata, as well as the degree to which the data follow current NASA data standards. Documentation, metadata, and standards compliance may also allow a data center to provide selected services from higher levels at little to no additional cost.

NASA's data processing level identifies the nature of the data, from raw instrument data (Level 0) to gridded variable data products (Level 3) to model output (Level 4).

There are six NASA data product categories:

  • Science Mission Products
  • NASA-funded Data Products
  • Facility Created Products
  • NASA Research Community Products
  • NASA Applied Science Products
  • Non-NASA Research Community Products

More information about the data product categories can be found in the Level of Service model document (PDF).

The Level of Service Determination table below identifies which of three service levels (basic, standard, or comprehensive) generally apply to data of a given processing level and data category. The second table shows service level descriptions. Although a near real-time (NRT) data product may have a comprehensive service level designation due to its product category and processing level, it may not obtain all comprehensive level services as some may not apply and others may not be realistic.

Table 1. Typical Level of Service Determinations

Chart showing data Product categories with rows showing data processing levels.

Service Level Guide for Data Producers

The intent of the ESDS Level of Service model is to describe the services to be provided for a given data product, as opposed to suggesting how those services will be implemented. This leaves room for data repository personnel to determine the best way for them to meet the assigned service level. Each data repository has unique capabilities and services that are designed to meet the needs for their particular data producer and user communities. These capabilities may allow the repository to offer services not specifically listed here and/or offer selected additional services beyond those that are required.

The Level of Service model covers services in six categories, including Ingest, Check, and Archive; Distribution and Access; Documentation; Discoverability and Usability; User Support and Outreach; and Preservation. The requirements directly relevant to data producers (in the categories of Data, Documentation, and User Support and Outreach) are summarized in Table 2. These lists demonstrate what you can expect a DAAC to do with respect to your data product as far as handling data, documenting data, and supporting data into the future.

The basic level requirements are designed to provide a minimal level of data stewardship that makes the data findable and accessible. Even at the basic level there is a high bar on data requirements that ensures appropriate data stewardship. The additional requirements for standard and comprehensive services build on these baseline requirements, increasing the quality of data care and support. Particularly for the comprehensive service level, not all services are appropriate (or even possible) for any given data product, but data producers can expect that the data repository will provide as many of these as are appropriate and reasonably feasible. 

These requirements apply only to upcoming/future datasets at this time. Requirements for already published and supported data have not yet been determined.

Table 2. Service Level Descriptions

Service Basic Services Standard Services

*Includes all Basic Services, plus:
Comprehensive Services
*Includes all Basic and Standard Services, plus additional services that may include:
Data
  • Assist data provider with data download or delivery using standard methods
  • Verify file size, file number, file access
  • Check file name, file structure, and file description for consistency and accuracy
  • Confirm accurate data transfers using checksums, as needed
  • Provide Digital Object Identifier (DOI) that resolves to a data product information page (also called a “landing page”)
  • Make data available on a public server in a reasonable time frame
  • Confirm data are accessible via search services and from a data product landing page link
  • Ensure that the data, related documentation, and related software are preserved and remain available (even given system failures and technology evolution)
  • Provide metrics to NASA Earth Science Data and Information System (ESDIS)
  • Check file format for standard compliance and aid with adjustment if needed
  • Publish more complete metadata, as needed
  • Check data for incomplete or inaccurate values and work with data producer to improve
  • Make data available to common subsetting and reformatting tools and machine services, such as OPeNDAP, and verify usability of data in such tools
  • Publish data browse images from producer or create with producer assistance, as appropriate
  • Develop code for near real-time distribution, if appropriate
  • Publish data to cloud server for cloud analysis and use, if available
  • Provide advanced search capabilities through Earthdata Search
  • Provide data transfer checksums to users
  • Provide data format translation to serve a broader community
  • Provide specialized services to subset, reproject, reformat, or resample data
  • Add metadata to data, as needed, to increase data discovery and use
  • Develop analysis/decision-ready data products more suitable to a broad community
  • Add data to NASA GIBS/Worldview and other enterprise-wide tools
  • Provide additional specialized data access or use tools
  • Make near-real time data available in NASA Land, Atmosphere Near real-time Capability for EOS (LANCE)
  • Provide data producer with data usage metrics
  • Transition data formats, as needed, to evolve with tool capabilities and standards
Documentation
  • Verify and publish basic, accurate metadata (includes geospatial, temporal, and science variable information)
  • Provide citation and DOI-resolvable landing page content
  • Produce a simple user guide containing data summary and links to external documentation
  • Provide permanent access to preservation information
  • Provide a more detailed user guide, including methodology and data accuracy sections
  • Assign more detailed metadata (services and variable metadata) in standard format
  • Review any data producer-provided documentation for clarity
  • Provide users with algorithm description documents and processing software, as needed
  • Add data validation publication links to the metadata as they become available over time
  • Develop additional descriptive or informational materials applicable to more user communities to increase data use
  • Develop data recipes or provide well-documented open source software to demonstrate use of the data
  • Add links on the landing page or data product information page that direct users to new data quality publications highlighting scientific findings regarding data
  • Increase linkages to internal/external web pages or documents that may improve data access
  • Publicly provide all preservation documentation in an organized manner
User Support and Outreach
  • Provide users assistance with data access and basic data use questions
  • Announce data publication via web
  • Maintain website information for as long as data are archived
  • Broadly announce data publication to reach more user communities
  • Provide data users with assistance and direction to FAQs or user forums, as needed
  • Assist users with machine services and other analysis tools
  • Communicate data quality to data users and assist users with appropriate use
  • Highlight data use on web page or in articles
  • Provide users with assistance for complex problems and direct users to experts, as needed
  • Highlight data in various outreach materials
  • Highlight data in NASA materials, at conferences, in NASA presentations, and in webinars
  • Develop higher-level visualization tools for targeted user communities
  • Provide subscription services to inform users of data product changes or new versions
  • Interact with and support science teams during and after mission or investigation

Page Last Updated: Oct 4, 2021 at 4:03 PM EDT