MERRA/AS and Climate Analytics-as-a-Service (CAaaS)
information technology and software
MERRA/AS and Climate Analytics-as-a-Service (CAaaS) (GSC-TOPS-53)
Ease of access to over 400 climate variables for any location on the earth
Overview
The Modern Era-Retrospective Analysis for Research and Applications (MERRA) integrates data from a variety of satellite systems with numerical models to produce a temporally and spatially consistent synthesis of climate variables that are not easily observed. MERRA provides global coverage. The MERRA time period covers the modern era of remotely sensed data, from 1979 to the present.
The breadth of MERRA variableswhich include atmosphere, ocean, and land surface productsmakes MERRA ideal for investigating climate variability and for use in an expanding array of applications areas, such as national disasters, civil engineering, ecological forecasting, health and air quality, water resources, and agriculture. However, these data sets are hundreds of terabytes in size, growing to petabytes in size over the coming years. Despite their utility, it is often difficult to use this important information.
The Technology
NASA Goddard Space Flight Center now offers a new capability for meeting this Big Data challenge: MERRA Analytic Services (MERRA/AS). MERRA/AS combines the power of high-performance computing, storage-side analytics, and web APIs to dramatically improve customer access to MERRA data. It represents NASAs first effort to provide Climate Analytics-as-a-Service.
Retrospective analyses (or reanalyses) such as MERRA have long been important to scientists doing climate change research. MERRA is produced by NASAs Global Modeling and Assimilation Office (GMAO), which is a component of the Earth Sciences Division in Goddards Sciences and Exploration Directorate. GMAOs research and development activities aim to maximize the impact of satellite observations in climate, weather, atmospheric, and land prediction using global models and data assimilation. These products are becoming increasingly important to application areas beyond traditional climate science.
MERRA/AS provides a new cloud-based approach to storing and accessing the MERRA dataset. By combining high-performance computing, MapReduce analytics, and NASAs Climate Data Services API (CDS API), MERRA/AS moves much of the work traditionally done on the client side to the server side, close to the data and close to large compute power. This reduces the need for large data transfers and provides a platform to support complex server-side data analysesit enables Climate Analytics-as-a-Service.
MERRA/AS currently implements a set of commonly used operations (such as avg, min, and max) over all the MERRA variables. Of particular interest to many applications is a core collection of about two dozen MERRA land variables (such as humidity, precipitation, evaporation, and temperature). Using the RESTful services of the Climate Data Services API, it is now easy to extract basic historical climatology information about places and time spans of interest anywhere in the world. Since the CDS API is extensible, the community can participate in MERRA/ASs development by contributing new and more complex analytics to the MERRA/AS service.
MERRA/AS demonstrates the power of CAaaS and advances NASAs ability to connect data, science, computational resources, and expertise to the many customers and applications it serves.
Benefits
- Reduces the need for large data transfers
- Provides a comprehensive set of climate variables
- Provides one stop shopping for historic climate data
- Provides significant time savings in data gathering
- Enables easy API-based application development
- Enables customization through an extensible API
- Enables fast data subsetting and basic operations
- Provides a platform for complex data analytics
Applications
- Energy
- Insurance
- Agriculture
- Urban planning
- Water management
- Ecological forecasting
- Resource management
Technology Details
information technology and software
GSC-TOPS-53
GSC-17116-1
GSC-17117-1
GSC-17115-1
GSC-17118-1
GSC-16594-1
GSC-17966-2
GSC-17967-2
GSC-17971-2
GSC-17973-2
Schnase, J., Duffy, D., Tamkin, G., Nadeau, D., Thompson, J., Grieg, C., . . . Webster, W. (2014). MERRA Analytic Services: Meeting the Big Data challenges of climate science through cloud-enabled Climate Analytics-as-a-Service. Computers, Environment and Urban Systems.
Similar Results
Space Weather Database Of Notifications, Knowledge, Information (DONKI)
The Space Weather DONKI builds a catalog of past, present, ongoing, and expected Space Weather events. The catalog contains both forecaster logs and notifications. DONKI version 2.0 of has a comprehensive web-service API access for users to obtain space weather events stored in the database. The database consists of a backend and a web application. The database uses a framework that allows modularization of code and promotes code reuse.
DONKI is the first application to allow space weather scientists to store all space weather events in one centralized data center. The comprehensive database provides search capability to support scientists allowing them to look into linkages, relationships, and cause-and-effects between space weather activities.
Direction of Arrival Estimation Signal of Opportunity Receiver
The Direction of Arrival Estimation Signal of Opportunity Receiver is a transceiver technology for small satellite and CubeSat platforms that enables maximization of antenna gain in a specific direction to receive desired signals and suppress signals from other directions. The receive is a four-channel transceiver system to be operating in a LEO orbit for receiving direct as well as reflected signal (signals reflected from the ground) of a communication satellite. An adaptive array processing is implemented to steer the receiver beam towards the GEO satellites as well as steer the antenna beam towards the ground. When the beam is steered towards the ground the receiver provides attenuation for the direct signal incident from the GEO satellite, thus isolating the reflected signal from the strong direct signal.
Usually a simple pair of cross dipoles are used for receiving signals transmitted by communication satellites. One pair is used to receive direct signals and another pair is used receive reflected signals. These dipoles are ideally supposed to receive only the reflected signals from the ground. However, because of close proximity and strong coupling to each other through their mutual coupling and because of their broad beam patterns, these dipole antennas receive signals reflected from other targets, as well as the direct transmitted signal. Since the strength of direct signals will be above the strength of reflected signals, reflected signals typically are completely masked by the strong direct signals. The Direction of Arrival Estimation Signal of Opportunity Receiver maximizes antenna gain in a desired direction to maximize desired signal and suppress unwanted signals.
Kodiak 3D Lidar
NASA Goddard Space Flight Center has developed a 3D lidar system that consists of microelectromechanical systems (MEMS) beam steering, high performance reconfigurable computing, and an in-depth understanding of systems level integration. Kodiak combines a 3D MEMS scanning lidar with a long range narrow FOV telescope to produce a flexible and capable space flight ranging system. Also included is SpaceCube-level processing power to host a variety of algorithms enabling sensing and 6 degrees of freedom.
Flight Awareness Collaboration Tool (FACT)
The Flight Awareness Collaboration Tool (FACT) user interface is a quad design with four areas. The Primary Map View shows the US with several traffic and weather overlays. The Surface Map View displays the selected airport with information on runway conditions and other factors. The Information View has specific data from various sources about the area of interest. This view also has a built-in algorithm that predicts the impact of the forecast winter weather on airport capacity. The Communication View supports messaging within the geographically-dispersed team that is using FACT. When an airport is selected in the Primary Map View, the information presented in the Surface Map and Information Views is focused on that choice.
FACT is a web-based application using Node.js and MongoDB. It receives Java messages from the Federal Aviation Administration System Wide Information Management (SWIM) data repository. Data acquired from web pages and SWIM are tailored for FACTs Information View area. FACT is designed to reside on an existing workstation monitor to be put into use as needed.
Miniaturized Laser Heterodyne Radiometer
This instrument uses a variation of laser heterodyne radiometer (LHR) to measure the concentration of trace gases in the atmosphere by measuring their absorption of sunlight in the infrared. Each absorption signal is mixed with laser light (the local oscillator) at a near-by frequency in a fast photoreceiver. The resulting beat signal is sensitive to changes in absorption, and located at an easier-to-process RF frequency. By separating the signal into a RF filter bank, trace gas concentrations can be found as a function of altitude.
