ESnet6 Investment Supports Next Generation Exascale Earth System Model

Scientists at Oak Ridge, Argonne, and Lawrence Livermore National Laboratories are collaborating on the next generation of integrated Earth climate models using Exascale Computing Project computers and simulation models. The Earth System Grid Federation program is building vast simulation models using data collected about our planet at all levels, from space to far below the surface. Predictions from these models are vital to our understanding of climate, ocean, and other complex systems that make life possible. Read more about this and ESnet’s role in this important international science conversation in a new phys.org article from Oak Ridge National Laboratory.

Visualization from the Earth System Model, one component of the Earth System Grid Federation program. ESnet provides the data connectivity necessary to stitch teams and computers at different labs together. Credit: LLNL, U.S. Dept. of Energy

The ESnet6 Unveiling Ceremony is 4 days away!  Come celebrate our new network and the great science we support, like the Earth System Grid Federation. Join us from 9 a.m. – 12 a.m., 11 October on https://streaming.lbl.gov.

Berkeley Lab and ESnet Document Flow, Performance of 56 Terabytes Climate Data Transfer

Visualization by Prabhat (Berkeley Lab).
The simulated storms seen in this visualization are generated from the finite volume version of NCAR’s Community Atmosphere Model. Visualization by Prabhat (Berkeley Lab).

In a recent paper entitled “An Assessment of Data Transfer Performance for Large‐Scale Climate Data Analysis and Recommendations for the Data Infrastructure for CMIP6,” experts from Lawrence Berkeley National Laboratory (Berkeley Lab) and ESnet (the Energy Sciences Network, document the data transfer workflow, data performance, and other aspects of transferring approximately 56 terabytes of climate model output data for further analysis.

The data, required for tracking and characterizing extratropical storms, needed to be moved from the distributed Coupled Model Intercomparison Project (CMIP5) archive to the National Energy Research Supercomputing Center (NERSC) at Berkeley Lab.

The authors found that there is significant room for improvement in the data transfer capabilities currently in place for CMIP5, both in terms of workflow mechanics and in data transfer performance. In particular, the paper notes that performance improvements of at least an order of magnitude are within technical reach using current best practices.

To illustrate this, the authors used Globus to transfer the same raw data set between NERSC and Argonne Leadership Computing Facility (ALCF) at Argonne National Lab.

Read the Globus story: https://www.globus.org/user-story-lbl-and-esnet
Read the paper: https://arxiv.org/abs/1709.09575

Register Now for Workshop on Improving Climate Data Management

Registration is now open for the Focused Technical Workshop on Improving Data Mobility & Management for International Climate Science to be held July 14 – 16 in Boulder, Colo. The workshop is part of a series sponsored by ESnet and Internet2 and is co-sponsored by Indiana University, the National Center for Atmospheric Research (NCAR) and the National Oceanic and Atmospheric Administration (NOAA).

The workshop, hosted by NOAA, brings together network experts with scientists in the domain of international climate sciences to discuss their most pressing network-related issues and requirements. The format is designed to encourage lively, interactive discussions with the goal of developing a set of tangible next steps for supporting this data-intensive science community.

Workshop registration is limited to 100 participants. For registration information, go to: http://events.internet2.edu/2014/ftw-climate/register.cfm. For more information about the

workshop, go to: http://events.internet2.edu/2014/ftw-climate/index.cfm