Under Budget and Ahead of Schedule, ESnet6 Project Receives Final CD-4 Approval

The Department of Energy’s Office of Project Assessment recently issued its final CD-4 Review Report on the Energy Sciences Network (ESnet)’s ESnet6 upgrade project. The review, held on July 12 – 13, 2022, and conducted at the request of Barbara Helland, Associate Director of Science for Advanced Scientific Computing Research (ASCR), assessed the project’s readiness to proceed to the approval of project completion. The project completed all threshold key performance parameters (KPPs) six months ahead of the early finish date, two years ahead of the CD-4 Level 1 milestone date, and well under budget. The committee assessed that the project was ready to proceed to CD-4 approval, which was achieved on July 29, 2022. The Final Closeout report and Lessons Learned are being submitted next week within the specified 90-day window.

“I want to congratulate the entire ESnet organization especially the ESnet6 project director, Kate Mace, and the project team,” said Inder Monga, executive director of ESnet. “When the team set out to deliver on a project scope as vast as the ESnet6 launch, we did not imagine a global pandemic would interrupt the process. Despite that, the team delivered the entire project ahead of the deadline and, even with supply-chain issues, managed to complete the scope below the projected budget. Most of the team attended the ESnet6 Unveiling Event on October 11 and heard their accomplishments praised by the lab directorate as well as congresspeople and DOE staff.”

The committee commended the project team for their “unique and innovative approach” in completing the project objectives and complimented ESnet for their agility in following through with the project scope while dealing with the difficult environment generated by the COVID-19 pandemic. The report stated that COVID-19 restrictions, limitations, and supply-chain issues presented “no significant impact” on the project’s critical path. The report also identified the distributed nature of operations and ESnet’s support for a remote workforce as an “invaluable” approach and a best practice to be shared beyond the DOE complex.

The final reports required for the official Project Closeout will be submitted to DOE this week. The ESnet team has continued to keep up the pace as they work toward additional enhancements to the ESnet6 Facility. “The #ESnet6Week festivities the week of October 9 energized the team. Not only were the project accomplishments celebrated at the ESnet6 Unveiling event, but the team also heard firsthand about the impact the project has already had on scientific discovery,” said Kathryn Mace, the ESnet6 project director, and Network Engineering group lead. “Hearing about the expansion of scientific collaborations made easier with the ESnet6 network and automated operations provided the team with newfound motivation to keep moving full speed ahead. ESnet6 sets the foundation for global scientific innovation over the next 10 years.”

The ESnet6 project team, DOE staff, IPR Committee, and members of the Berkeley Lab directorate during the final CD-4 IPR closeout session.

ESnet6 Investment Supports Next Generation Exascale Earth System Model

Scientists at Oak Ridge, Argonne, and Lawrence Livermore National Laboratories are collaborating on the next generation of integrated Earth climate models using Exascale Computing Project computers and simulation models. The Earth System Grid Federation program is building vast simulation models using data collected about our planet at all levels, from space to far below the surface. Predictions from these models are vital to our understanding of climate, ocean, and other complex systems that make life possible. Read more about this and ESnet’s role in this important international science conversation in a new phys.org article from Oak Ridge National Laboratory.

Visualization from the Earth System Model, one component of the Earth System Grid Federation program. ESnet provides the data connectivity necessary to stitch teams and computers at different labs together. Credit: LLNL, U.S. Dept. of Energy

The ESnet6 Unveiling Ceremony is 4 days away!  Come celebrate our new network and the great science we support, like the Earth System Grid Federation. Join us from 9 a.m. – 12 a.m., 11 October on https://streaming.lbl.gov.

Why We Designed and Deployed ESnet6: It is All About the Science!

We’re just a few days away from the ESnet6 unveiling and Confab22!

Here’s a great video interview with Ann Almgren, Senior Scientist in CCSE and the Department Head of the Applied Mathematics Department in the Applied Mathematics and Computational Research Division at Berkeley Lab. In it she discusses her research into wind power generation/distribution, and how she will use ESnet6.

Ann Almgren, Berkeley Lab

To watch the unveiling of ESnet6 and learn more about Ann’s research, join us 11 October from 900AM – 12 PM PT at streaming.lbl.gov!

ESnet6 Unveiling in Seven Days!

On October 11, 2022, we will welcome the newest generation of our high-performance scientific network, ESnet6, at an unveiling ceremony hosted by Berkeley Lab.

ESnet6 marks a new era of our high-performance network supporting the needs of scientists. We’re able to handle massive flows of data in a reliable, nimble way, and we can specifically configure our setup to match the needs of individual experiments. The upgrade ensures that ESnet is ready to support the future of science today, including the significant increase in the amount of data produced by scientific experiments and the increasingly complex needs of scientists and the way they interact with our network. 

Come watch the ESnet6 unveiling ceremony 9AM -12 PM PT, October 11, at streaming.lbl.gov!

ESnet team to give multiple talks about networking, automation, and QUANT-NET at NORDUnet Conference and GEANT’s SIG-NGN meeting

The 31st NORDUnet Conference will take place in Reykjavik, Iceland from September 13-15, 2022. 

ESnet staff will also be in attendance at the Special Interest Group on Next Generation Networking (SIG-NGN) on September 12, 2022, the day before the NORDUnet Conference.

Here’s where you can find ESnet team’s talks during these events: 

Monday, September 12, 2022: SIG-NGN

The next generation NREN lightning talks 
09:05 – 10:30am GMT

The lightning talks will feature two presentations from ESnet: 

  • ESnet Effort to Build Upon the NML and MRML – John MacAuley
  • LHC Next Generation Requirements Gathering – Eli Dart

Future network architectures. Technological change to support data moving / data planes 
11:00am – 12:30pm GMT

This session will start with 10-minute presentations, including two by ESnet staff:

  • ESnet7 – Chin Guok
  • Underlay Packet Inspection, Making Traffic Engineering Decisions at L2 – Yatish Kumar

These talks will be followed by a panel discussion. 



How do we stitch and share our L1-L3+ networks to introduce better and new services
12:00pm – 3:30pm GMT

This session includes a series of short talks, including:

  • Real Time Data Processing Requirements – Yatish Kumar

Yatish Kumar will also host a discussion on future networking technologies from =2:00pm – 3:20pm GMT


Tuesday, September 13, 2022: NORDUnet Conference

The ESnet6 Approach to Network Orchestration and Automation
11:00am – 12:30pm GMT | Track 1 / Room: Silfurberg B

Speaker: Scott Richmond

Abstract: Network Orchestration is a defining factor in next generation networks, enabling operators to deliver more consistent and reliable services. ESnet has leveraged a combination of internally developed tools, open source software, and commercial software to orchestrate and automate network configuration deployment. This approach has enabled rapid deployment of new network services, as well as ensuring that configuration standards are well enforced when deploying network services.

During this talk, we will provide a brief history of automation at ESnet, dive into what our goals were for orchestration and automation in the ESnet6 project, and describe the technology and process that we used to meet those goals. Finally, we will discuss the hurdles encountered and lessons we learned along the way while developing this tooling.

Eli Dart was part of the technical program committee and is the chair for the HPC session, taking place in Track 2 / Room: Rima from 2:00 – 3:30 pm GMT. 


Wednesday, September 14, 2022: NORDUnet Conference

Experimenting with Teleportation Based Physical Layer for the Network: QUANT-NET
1:30pm – 3:00pm GMT | Track 1 / Room: Silfurberg B

Speaker: Inder Monga

Abstract: QUANT-NET takes an application-centric and systems-based approach to building a Quantum Internet testbed. The main thrust of this effort is to build a three-node distributed quantum computing testbed between two sites, Lawrence Berkeley National Lab and the University of California Berkeley (UCB) connected with an entanglement swapping substrate over optical fiber and managed by a quantum network protocol stack. We will implement the most basic building block of distributed quantum computing by teleporting a controlled-NOT gate between two nodes. This approach will enable research, prototyping, measurement and testing of the entire quantum network stack from physical layer to the application. The talk will describe our proposed testbed and progress.


Chris Cummings Speaks About Service Orchestration at Networking Field Day

ESnet’s Chris Cummings from our Orchestration and Core Data team was asked to present at the industry event “Networking Field Day: Service Provider”. 

Networking Field Day (NFD) is a unique event in which industry professionals are invited to join a panel of delegates who are presented with new products and offerings from networking vendors. These presentations then follow an open format where delegates can ask questions of the vendors and understand more about the products being discussed. 

For this particular instance of NFD, Chris was invited as a community member to present on how ESnet has built service orchestration and intent-based networking tooling, which allows us to abstract our service offerings from the technical implementation details that compose them. This is a topic that has a lot of mystique and buzz-words surrounding it in the networking industry, but this presentation contains concrete examples and demonstrations of the software that ESnet uses daily. 

The talk Chris gave explored ESnet’s approach to building a service orchestration software suite. He also gave a few demonstrations of the software in action. This presentation is not an exhaustive explanation of how to build your own intent-based networking environment, but rather an example and overview of a real-world stack that is being used in a production network today and the principles behind it. 

Watch Chris’s presentation here: https://techfieldday.com/appearance/a-real-world-approach-to-intent-based-networking-and-service-orchestration/

3Q with Juan Antunez, ESnet’s new Network Operations Engineer!

Before joining ESnet as a network operations engineer, Juan Antunez was an infrastructure engineer at Lowe’s. He brings seven years of experience in IT help desk support (customer support) and holds a Bachelor of Business Administration in Management Information Systems from the University of Houston-Downtown. Outside of work, he enjoys playing soccer with his seven-year-old daughter and traveling. 

Juan Antunez smiling into the camera
Juan Antunez

Question 1: What brought you to ESnet? 

After working for many years in the aerospace and retail industries, I’ve decided to join ESnet, which has a significant footprint supporting scientific research and development. The opportunity to contribute to the Department of Energy’s large-scale scientific research is exciting and fulfilling. I’m thrilled about joining, and I’m looking forward to continuing my career development!

Question 2: What is the most exciting thing going on in your field right now? 

I would say that Automation is something that many organizations are integrating into their network to avoid daily repetitive tasks that take time away from the workforce. It also helps prevent zero-day attacks with automation and response.

Question 3: What book, movie, or podcast would you recommend? 

I highly recommend The Art of Networking Engineering podcast to anyone interested in listening to other network engineers speak of their real-life experiences in the industry.  Also, Darknet Diaries is another fascinating podcast; you get to listen to and learn about what’s happening in the cybersecurity world. 

3Q with David Oh – ESnet’s new Network Operations Engineer!

Before joining ESnet, David Oh was a Senior Data Center Engineer at XR Trading. He lives in the Los Angeles area with his wife and his dog, a Havanese, poodle, and super mutt mix. Before moving to LA, he liked to spend his time working on his BMW E46 M3, not necessarily because he wanted to, but more often because he had to (15-year-old BMWs WILL break down on a near-weekly basis).

A photo of David Oh
David Oh

What brought you to ESnet?

I was working on cutting edge infrastructure in the trading world. I helped make things go faster so the company could flourish. After learning how ESnet supports research and development labs all over the world, I was excited at the prospect of helping science and humanity flourish.

What is the most exciting thing going on in your field right now?

I feel like automation is being used in amazing and creative ways to make tedious and mundane tasks in the networking world easier to accomplish.

What book, movie, or podcast would you recommend?

I enjoy listening to the Art of Network Engineering and, of course, the occasional crime mystery podcasts!

Watch our latest video: Serving Conversations That Matter

Title card from the Serving Conversations That Matter video

ESnet exists to support research into some of the most important questions of our time. The traffic that travels over our network on a daily basis contains data from tens of thousands of researchers – data that could lead to the next major discovery or scientific breakthrough.

In our latest video, learn about just a few of the revolutionary research collaborations we support, and the questions they’re working to answer.

The my.es.net portal has been updated!

Last week, we updated the my.es.net portal to better communicate the quantities of data that traverse the network on a daily basis!

The portal now shows larger dynamic traffic ranges between 0 and 800+ Gbps on the map – the previous portal’s visualizations maxed out at 80 Gbps.

The new color scheme is also color blind-friendly and works in grayscale!

Check it out for yourself here