Nobel Prize Lesson: Distinguish the Improbable from the Impossible

Saul Perlmutter was woken at 3 am yesterday by a reporter asking how he felt about winning the Nobel Prize. Any confusion was cleared up a few minutes later when the Nobel Committee in Sweden called. Perlmutter, an astrophysicist who holds a joint appointment at Berkeley Lab and UC Berkeley, and his colleagues Brian Schmidt and Adam Reiss received the 2011 Nobel Prize in Physics for their work in the 1990s in using supernovae to measure the accelerating expansion of the universe. They found, independently, improbable evidence that the universe was expanding at ever faster speeds.

In the process they uncovered other mysteries. The universe is made up of only about 5 percent visible (or baryonic) matter. The remaining 25 percent of the universe is dark matter, and 75 percent of the universe is made up of dark energy. Perlmutter described dark energy as making space more bouncy and elastic. It appears as “a negative pressure—we see it in the equations.” Nobody is certain of the relationship between dark matter and dark energy; scientists are looking for a theoretical concept that will solve them both at the same time.

In yesterday’s press conference at Berkeley Lab, Perlmutter said that the award “recognizes what it is possible to do when whole communities of science come together.” He went on to say, “when you are driven to learn things about the world, you find yourself inventing new things.”

Of course, that is what ESnet is all about—the ESnet network links scientists so they can efficiently exchange data, collaborate, and discover new things about the world. ESnet’s Bill Johnston recalls the early days of data transfer. “Saul started out doing observations at Chabot and Hamilton. He wrote the images on Tektronix cartridge tape and ferried them around in his car.  When his tape reader at LBL broke, we would help him out. In the graphics lab that Harvard Holmes and I ran, we had several Tek tape readers. That must have been [the] late 1970s.”

And then there’s Daniel Schectman, a hard-core materials scientist at the Technion-Israel’s Institute of Technology, who today was awarded the Nobel Prize in Chemistry for discovering a new state of matter called quasi-crystals, where atoms make a structured pattern that never repeats.  While on sabbatical at NIST in 1982, Schectman was working at the electron microscope, imaging a sample of aluminum and maganese. He made a measurement that seemed to be a mistake– the symmetry of its five-fold crystal structure violated the laws of physics. It is possible to get an identical pattern from structures with 3,4,6 and 8 sides, just like square floor tiles can be repeated in an identical pattern, no matter how you rotate them. But Schectman knew it was theoretically impossible to tile a space in five-fold rotational symmetry.

A former student who took his class in electron beam crystallography at the Technion recalls that Schectman showed the class the research notebook that he kept at NIST. Beside the measurement of the anomalous sample, Schectman scribbled in Hebrew, “there is no creature like that.” Schectman persisted through years of caustic opposition from his peers (Linus Pauling, a two time Nobel-winner, was particularly hostile), to verify his results—he was even asked to leave his research group. The original paper he attempted to publish in the Journal of Applied Physics in 1984 was immediately rejected, but he later published another paper with collaborators that rocked the field of crystallography.

It turns out that to tile a space and achieve five-fold symmetry uses not a single tile, but two—one distorted, a concept called Penrose tiling. But at the time, Schectman was unfamiliar with Roger Penrose’s work; it was an idea that only pure mathematicians played with–it wasn’t even applied mathematics. On an atomic level, quasi-crystals resemble aperiodic mosaics, such as those found in the medieval Islamic mosaics of the Alhambra Palace in Spain and the Darb-i Imam Shrine in Iran.

Schectman’s discovery caused a paradigm shift in chemistry, the Swedish Academy of Sciences said. But exotic quasi-crystals, since they don’t scratch easily, are now appearing in our everyday lives in the non-stick coatings on razor blades, drill-bits, and pots and pans.

Schectman and Perlmutter both stood on the shoulders of people who came before them, and relied on their communities to test and verify their results.  The pace of scope of modern day science is making international collaboration not a luxury, but a necessity. Although individual persistence and courage drive many new discoveries, they still take place in the context of a global community of scientists.  ESnet and other research and education networks make this community possible, by allowing scientists to share datasets and knowledge and to work together towards even greater discoveries.

“Science is a method, not a finished project; we don’t know where it will lead in the future,” Perlmutter summed up. And networks are forging the way.

ESnet is going directly to the “light” source

Over the past few years, ESnet staff has worked to engage researchers across a variety of disciplines to ensure our services meet their needs. As a part of this ongoing effort, I will be leading a session titled “The Energy Sciences Network: Moving Data, Advancing Science” on October 4th at the Advanced Light Source User Meeting being held at Berkeley Lab. I hope to involve ALS users in a discussion around ways to use the ESnet network to more efficiently exchange and transfer their scientific data. The talk will also review some common problems encountered in the transfer of large scientific data sets, as well as highlight solutions showcasing how research groups have worked with ESnet to effectively use the network to expedite their data sharing and analysis.

ALS has a number of different experiments that can benefit from ESnet’s capabilities in different ways. Computing-intensive disciplines such as protein crystallography, X-ray microdiffraction, and other fields that utilize the ALS are experiencing unprecedented growth in data production. This is straining traditional methods of data distribution and analysis. As a matter of fact, within the next five years, we expect that many ALS user groups will experience an increase in data production of up to a factor of 1000, which will far exceed traditional digital media distribution capabilities. Without better ways of distributing data, scientific productivity could be significantly impeded.

In recent months, ESnet has developed new tools and software innovations as part of our goal of making our network and services more accessible to our users.  If you would like to get tips on how to use ESnet focused on your particular scientific discipline, or just have general questions, please contact us at info@es.net.

–Eli Dart

Transfer lots of data, effortlessly. Here’s how. Tune in to webcast Sept 8th.

Got a lot of data to move around? Say, more than 100 Gigabytes? ESnet recommends that you attend this webcast on how to use Globus Online, one of ESnet’s recommended file transfer services.  The webcast (https://www.globusonline.org/esnet-webcast-09-08-11/) will show you how to move data as you need it without having to become an IT expert, learn a new command vocabulary or install software.

ESnet provides the high-bandwidth, reliable connections that link scientists at national laboratories to universities and other research institutions so they can more effectively collaborate. We provide the infrastructure, but after listening to our customers, we are taking the next step and recommending the tools to make our network easier to use. As part of this effort, we are introducing our users to services like Globus Online that will help you to move data faster and more reliably.

Globus Online (https://www.globusonline.org/) is a fast, reliable file transfer service that simplifies the process of secure data movement. This free service automates the activity of managing file transfers, whether between computing facilities or from a facility to your local machine. Users can fire-and-forget their request and Globus Online will manage the entire operation – monitoring performance, retrying failed transfers, recovering from faults automatically whenever possible, and reporting status. Globus Online makes it a trivial thing to move big data around, to whatever location needed, without spending lots of time figuring out the right commands or dealing with complicated systems. Simply sign up, specify your endpoints (where the file is now (source) and where you are moving it (destination) authenticating as necessary on the servers, and then click to transfer. Once the endpoint you need is configured into Globus Online, it really is that simple – try it out for yourself!  (https://www.globusonline.org/SignUp)

In this session, the Globus Online project lead Steve Tuecke will cover all the basics of usage, including command line interface and using Globus Connect to make your own server or laptop an endpoint. I will be there to provide the ESnet perspective. We will answer your questions and also provide any constructive feedback. To get the most out of the session, sign up and try the service beforehand so you know what you are looking for and are ready to ask the right questions.

For more information, see https://www.globusonline.org/esnet-webcast-09-08-11/ or contact info@globusonline.org.

Brian Tierney, ESnet

100 Gbps ANI Prototype Network is Just the Beginning

After much work and planning, we proudly introduce you to our new scientific network-to-be.  Berkeley Lab just announced the signing of an agreement to begin construction of a 100 gigabits per second (Gbps) prototype network, part of the Lab’s Advanced Networking Initiative funded by the American Recovery and Reinvestment Act (ARRA).  Under the terms of the deal, Internet2 and its industry partners will construct the network under ESnet’s direction.

Coming Soon: ANI 100 Gpbs Prototype Network, First Step Towards Nationwide 100 Gbps Network

While our ANI network testbed is already open for business (mark your calendar –the next call for research proposals is October 1st) in a matter of months researchers can conduct experiments on the 100 Gbps prototype network. This network will link the three supercomputing facilities at national laboratories – the National Energy Research Scientific Computing Center (NERSC), Oak Ridge Leadership Computing Facility (OLCF), and Argonne Leadership Computing Facility (ALCF) to MANLAN – the Manhattan Landing international exchange point.

But more is yet to come; the ANI prototype network will also be framework for ESnet to obtain concrete network energy use data for research into “green networking” – a priority here at ESnet.  Also part of the agreement, Berkeley Lab negotiated access to a nation-wide pair of dark fiber for 20 years which will be immediately available to network researchers and industry to experiment with new protocols and disruptive technologies.  Stay tuned to our blog to follow construction of the network and the exciting happenings at ESnet.

The 100 Gbps prototype network is just the beginning.  Berkeley Lab and ESnet will leverage the experience gained deploying the prototype network to extend these capabilities to the national labs and facilities ESnet currently serves, and connect DOE scientists to university collaborators around the world.  When moved to production status, the new network will increase the information carrying capacity of ESnet’s current 10 Gbps network by several orders of magnitude.  One terabyte of data, which takes approximately 13 minutes to transfer on ESnet’s present 10 Gbps network, will be delivered in under a minute on the 100 Gbps network.

What we hope you will get out of this

While our network currently meets the capacity needs of its users, we see new challenges on the horizon.  On behalf of the DOE Office of Science, we regularly survey scientists about their projected needs in order to better target services for our users. Demand on ESnet’s network has grown by a factor of 10 every 47 months since 1990.  Over the last year, we have seen a rise in ESnet network traffic by 70 percent – most of that data traffic coming from the Large Hadron Collider at CERN but with genomics and climate data also picking up steam.

Just as investments in national infrastructure built the Interstate Highway System that sped the delivery of goods and opened up commerce in the United States, high-speed networks will speed the scientific discovery that will drive this nation’s economy in the future.  New, large-scale instruments are in the offing, and we anticipate a growing tide of data in various disciplines as scientists work to understand our climate, develop clean fuels, and investigate the basic nature of matter.  High-speed networks like this one will have a huge impact on an increasing number of disciplines, as more scientists collaborate in global teams and depend on remote supercomputers to model and solve complex problems.

How to be really thrifty with $62 million.

This is a challenging time when budgets are under severe pressure, both for government and the research and education community.  We believe that by pooling resources and expertise we can help curb the costs of scientific research.  By working closely with Internet2 to build this prototype network, we are leveraging our ARRA award and their funding for synergistic effect and getting more return on investment for the taxpayer.

We strongly believe this new 100Gbps network infrastructure will allow us to better support data-intensive science by providing more capacity at lower cost, lower energy consumption, and lower carbon emissions per bit.  And that makes us feel good about what we do.

I.T. in-depth at DUSEL

This guest blog is contributed by Warren Matthews, Cyber-Infrastructure Chief Engineer at the Deep Underground Science and Engineering Lab (DUSEL).
 

Guest Blogger: Warren Matthews, DUSEL

The Deep Underground Science and Engineering Laboratory (DUSEL) is a research lab being constructed in the former Homestake gold mine in Lead, South Dakota, now resurrected to mine data about the earth, new life forms, and the universe itself. When finished, DUSEL will explore fundamental questions in particle physics, nuclear physics and astrophysics. Biologists will study life in extreme environments. Geologists will study the structure of the earth’s crust. Early science programs have already begun to explore some of these questions. In addition, DUSEL education programs are underway to inspire students to pursue careers in science, technology, engineering, and mathematics. This interdisciplinary collaboration of scientists and engineers is led by the University of California at Berkeley and the South Dakota School of Mines and Technology.

 

I am the cyberinfrastructure chief engineer for DUSEL. As such, my concern is the research environment and advanced services that will be needed to accomplish our scientific goals. To enable future discoveries, scientists will need to capture, analyze, and exchange their data. We will have to deploy and perhaps even develop new technologies to provide the scientists with the technical and logistical support for their research. We expect that the unique research opportunities and instrumentation that will be established at DUSEL will draw scientific teams from all over the world to South Dakota, so high-speed national and International network connectivity will also critical.

National laboratories have made many important contributions in the development of IT and networking technology.  I’m very pleased that DUSEL is the newest member of the ESnet community and I have no doubt that we’ll be leveraging their expertise.  In conversations with numerous colleagues at other labs it has become apparent that although DUSEL is starting with a clean slate and there are no legacy systems to support, we still have common issues and some difficult decisions to consider. All the labs have the challenges of meeting the needs of both large and small scientific collaborations. We all feel the budget crunch and are streamlining our support infrastructure. We are all wondering how we can optimize our use of the Cloud.

Delving into underground research

At DUSEL we have our own particular challenges, starting with an extreme underground environment. On the surface, the Black Hills of South Dakota may be freezing, but the further you go down in the mine, the hotter it gets. Rock temperatures at the 4850′ level, where the mid-level campus is under construction, are around 70F (21〫C) and humidity is around 88%. At the 7400′ level, where the deep-level campus is planned, temperatures hover around 120F (50〫C). The high levels of temperature and humidity have a significant impact on computer equipment.  We’ll figure out our challenges as we go, depending on shared expertise. After all, national labs were created to focus effort and move forward knowledge where no one university could marshal the resources required. Our goal is to provide a platform where science, technology, and innovation are able to flourish.

We anticipate technology partnerships with the many experiments are going underground at DUSEL. Currently we are expanding IPv6 and deploying perfSONAR. We are leveraging HD video conferencing. We are worrying about identity management and cyber security. We are establishing the requirements for dynamic network provisioning.  And at the same time we’re wondering what other technologies will emerge in the next 20 or 30 years and what will be required to dig for new discoveries. You can keep track of our progress here at the Sanford Laboratory Youtube Channel.

–Warren Matthews

Harnessing bugs for new drugs and potential jet fuel

D. radiodurans is impervious to ionizing radiation; can clean up mercury and toluene contamination

The high speed networking that ESnet provides supports an incredibly varied range of scientific projects. The express purpose of DOE national labs is to conduct research in the national interest. Much is basic research, exploring fundamental issue in physics, energy, cosmology, and climate science. However the study of microbial evolution is one intriguing area that is already changing our lives with everything from new medicines to potential fuels.

Microbes are single-cell organisms that live in colonies and can be found in nearly every corner of our planet, in places ranging from insects’ intestines to some of the most toxic chemical environments. The site for the most detailed information on the genetic makeup of these organisms only lives in one place – at the DOE’s Joint Genome Institute – and is accessed via ESnet.  The Integrated Microbial Genomes (IMG) Data Management System provides the genetic makeup of thousands of microbes and tools for analyzing the functional capability of microbial communities based on their metagenome DNA sequence. Understanding these tiny organisms can provide new insights into a wide range of important problems, but in order to study the microbes, scientists need reliable access to the genomic data.

Microbes such as bacteria are responsible for a number of diseases, such as plague, tuberculosis and anthrax, while microbes known as protozoa cause diseases such as malaria, sleeping sickness and toxoplasmosis. On the plus side, microbes also live helpfully in human digestive systems, helping to digest carbohydrates and synthesize certain vitamins.

Where the wild things are

Famously, taq polymerase, an enzyme isolated from the bacterium Thermus aquaticus found in a hot spring at Yellowstone National Park in 1965, became the basis for PCR, the technique for amplifying short strands of DNA that has revolutionized biologic and genetic research. While some scientists examine exotic microbes like Deinococcus radiodurans, the most radiation-resistant organism known (and the darling of exobiologists, found as a contaminant of irradiated canned meat in 1956) for clues to how life began on earth and could evolve on other planets, your laundry detergent probably contains enzymes developed from bacteria that evolved in hot, alkaline conditions.

In the private sector, microbes are genetically modified to develop innovative drugs as well as industrial products. In an example close to home, a few years back, LBNL’s Joint BioEnergy Institute director Jay Keasling used microbial evolution techniques to synthesize artemisinic acid, a precursor to artemisinin, an anti-malarial compound. Artemisinin is derived from Artemisia annua or wormwood, a plant known to Chinese medicine for centuries. Keasling made a steady supply that could be manufactured extremely cheaply and at large volumes, so accessible to people in developing countries.

Keasling’s next project is to use microbes as potential energy sources by turning them into factories to produce sugars. Certain microbes living in termite guts are essential for digesting the wood fibers eaten by the insect. While this can be bad news for homeowners, the chemical capabilities of the “bugs” in these bugs are being studied as for their potential in converting wood and other plant matter into new energy sources. Successfully producing fuel using plant waste instead of food crops like corn, could improve our country’s future energy options.  To be sure, there still are prosaic bars to overcome, such as chemical separation and processing in volumes high enough to meet our insatiable demand for transport fuels. Other scientists at DOE national labs such as NREL and a host of private companies, some right across San Francisco Bay from our headquarters at ESnet, are investigating how to make gasoline and jet fuel from microorganisms. Genetic analysis is the essential first step in growing hardworking bacteria with the desired qualities.

Another promising microbial application is environmental cleanup. One form of bacteria found almost 2 miles underground in a South African gold mine lives in total darkness, 140 degrees Fahrenheit – and no oxygen. The organism gets its energy not from the sun but from hydrogen and sulfate produced by the radioactive decay of uranium. By understanding how life can thrive in such an apparently toxic setting, scientists may get new insight into using microbes to clean up environmental contamination.

Currently, the IMG database contains complete genomes for 4,879 microbes, with another 1,569 in draft form. Of the total, 1,107 are bacteria and 2,536 are viruses. The information, containing data for more than 20 million genes, is provided freely to interested researchers.

ESnet gives CISCO Nerd Lunch talk, learns televangelism is harder than it seems

As science transitions from lab-oriented to a distributed computational and data-intensive activity, the research and education (R&E) networking community is tracking the growing data needs of scientists. Huge instruments like the Large Hadron Collider are being planned and built. These projects require global-scale collaborations and contributions from thousands of scientists, and as the data deluge from the instruments grows, even more scientists are interested in analyzing it for the next breakthrough discovery. Suffice it to say that even though worldwide video consumption on the Internet is driving a similar increase in commercial bandwidth, the scale, characteristics, and requirements of scientific data traffic is quite different.

And this is why ESnet got invited to Cisco Systems’ headquarters last week to talk about how we how we handle data as part of their regular Nerd Lunch talk series. What I found interesting although not surprising, was that with Cisco being a big evangelist of telepresence, more employees attended the talk from their desks than in person.  This was a first for me and I came away with a new appreciation for the challenges of collaborating across distances.

From a speaker’s perspective, the lesson learnt by me was to brush up my acting skills. My usual preparations are to rehearse the difficult transitions and  focus on remembering the few important points to make on every slide. When presenting, that slide presentation portion of my brain goes on auto-pilot, while my focus turns towards evaluating the impact on the audience. When speaking at a podium one can observe when someone in the audience opens a notebook to jot down a thought, when their attention drifts to email on the laptop in front of them, or when a puzzled look appears on the face of someone as they try to figure out the impact of the point I’m trying to make. But these visual cues go missing with a largely webcast audience, making it harder to know when to stop driving home a point or when to explain the point further to the audience.  In the future, I’ll have to be better at keeping the talk interesting without the usual clues from my audience.

Maybe the next innovation in virtual-reality telepresence is just waiting to happen?

Notwithstanding the challenges of presenting to a remote audience, enabling remote collaboration is extremely important to ESnet. Audio, video and web collaboration is a key service offered by us to the DOE labs. ESnet employees use video extensively in our day-to-day operations. The “ESnet watercooler”, a 24×7 open video bridge, is used internally by our distributed workforce to discuss technical issues, as well as, to have ad-hoc meetings on topics of interest. As science goes increasingly global, scientists are also using this important ESnet service for their collaborations.

With my brief stint in front of a stage now over, it is back to ESnet and then on to the 100G invited panel/talk at IEEE ANTS conference in Mumbai. Wishing all of you a very Happy New Year!

Inder Monga

Why this spiking network traffic?

ESnet November 2010 Traffic

Last month was the first in which the ESnet network crossed a major threshold – over 10 petabytes of traffic! Traffic volume was 40% higher than the prior month and 10 times higher than just a little over 4 years ago. But what’s behind this dramatic increase in network utilization?  Could it be the extreme loads ESnet circuits carried for SC10, we wondered?

Breaking down the ESnet traffic highlighted a few things.  Turns out it wasn’t all that demonstration traffic sent across thousands of miles to the Supercomputing Conference in New Orleans (151.99 TB delivered), since that accounted for only slightly more than 1% of November’s ESnet-borne traffic.  We observed for the first time significant volumes of genomics data traversing the network as the Joint Genome Institute sent over 1 petabyte of data to NERSC. JGI alone accounted for about 10% of last month’s traffic volume. And as we’ve seen since it went live in March, the Large Hadron Collider continues to churn out massive datasets as it increases its luminosity, which ESnet delivers to researchers across the US.

Summary of Total ESnet Traffic, Nov. 2010

Total Bytes Delivered: 10.748 PB
Total Bytes OSCARS Delivered: 5.870 PB
Pecentage of OSCARS Delivered: 54.72%

What is is really going on is quite prosaic, but to us, exciting. We can follow the progress of distributed scientific projects such as the LHC  by tracking the proliferation of our network traffic, as the month-to-month traffic volume on ESnet correlates to the day-to-day conduct of science. Currently, Fermi and Brookhaven LHC data continue to dominate the volume of network traffic, but as we see, production and sharing of large data sets by the genomics community is picking up steam. What the stats are predicting: as science continues to become more data-intensive, the role of the network will become ever more important.


Depicting the early universe closer to home at SC10

Rick Wagner in front of the early universe

It’s Wednesday at 10 a.m. in the SCSD booth, and Rick Wagner is testing simulations of cosmic matter and gases streamed in from Argonne National Lab. Wagner about to run a real time volume-rendering application at Argonne. The application renders data in real time, which will stream the results across a wide area (from Argonne to New Orleans) and display it on the tiled screen in the SDSC booth. To do so, SDSC is using OSCARS, ESnet’s on-demand reservation software to schedule data movement on demand.

Aside from the sheer technical feat of rendering data in real time and streaming massive amounts of it across long distances, on-demand data scheduling enables scientists to be more versatile–easily working with the data as needed. For Wagner and his collaborators, improvements in data streaming are all about new capabilities. “We’ve never had this functionality,” said Wagner. “We want to be able to compare the data sets side by side.”

Wagner will next add in variables such as radiation, to the images depicting gasses and matter from the early moments of the universe. This kind of demo illustrates what ESnet is all about. It is our mission to link scientists to collaborators and their data. But we are always striving for improvements in functionality, so that our end users will be more effective in their research.

Autumn means SC10

Jon Dugan blogs about ESnet at SC10

By autumn most folks are thinking about the holidays, but for me, fall is filled with thoughts of something different.  Since 1998, I’ve had the privilege of working with the SCinet committee of Supercomputing, a.k.a. the International Conference for High Performance Computing, Networking, Storage, and Analysis, if you are not into the whole brevity thing. SCinet is the team of people that builds the local area and wide area network for the Supercomputing conference.

This year’s conference, SC10 is in New Orleans, LA, from November 13 until November 19.  Planning for each year’s show starts a few years ahead of time. Not long after one year’s show ends, the serious planning for the next year’s SCinet begins. It’s a cycle that I’ve been through many times now, and it’s a bit like an old friend at this point.  Most of the time we enjoy each other’s company immensely but when things get stressful, we can really irritate each other.

SCinet is a pretty amazing network.  After a year of planning, there are three weeks of concentrated effort to set it up. It’s operational for about one week and it takes about two days to tear down.  This year we will have 270 Gbps of wide area network connectivity with dedicated circuits to ESnet, Internet2, NLR, and NOAA.  We will deliver over 200 network connections to the various booths on the show floor.

As amazing as the network is, the people who build it are even more amazing. They are drawn from universities, national laboratories, network equipment vendors and nationwide research and education networks.  It’s not just Americans; there are people from several different countries with strong showings from the Netherlands and Germany most years.  Many of these folks are leaders in their areas of expertise and all of them are bright, capable people.  Each of them has given up a fair bit of their own time to participate (while most have some sponsorship from their employers, it’s not unheard of for people to take vacation time to participate).

Why would people give up many evenings and weekends every fall to be a part of SCinet?  Because it’s an amazing opportunity to learn about the state of the art in computer networking and to expand your professional network as welll. I consider myself extremely fortunate to work with each of the people that make up SCinet.

So what is ESnet doing for with SCinet this year?  Glad you asked.  First off, we are bringing three 10G circuits to the show floor.  As of Friday, October 29th all three were up and operational.  One of these circuits will be used for general IP traffic, but the other two will be used to carry dynamic circuits managed by the OSCARS IDC software.

These circuits will provide substantial support for various demonstrations by exhibitors, connecting scientific and computational resources at labs and universities to the booths on the show floor.

Finally, ESnet has four people who are volunteering in various capacities within SCinet. Evangelos Chaniotakis and myself will be working with the routing team. The routing team provides IP, IPv6, IP multicast service, manages the wide area peerings, manages wide area layer 2 circuits, configures the interfaces that face the booths on the show floor and works closely with several other teams to provide a highly scalable and reliable network. John Christman is working with the fiber team, building the optical fiber infrastructure to support SCinet (all booth connections are delivered over optical fiber, which allows booths to be connected to the network using the highest-speed interfaces available.) Brian Tierney will be working with the SCinet measurement team collecting network telemetry, and using it to provide useful and meaningful visualizations of what’s happening inside SCinet as well as providing tools and hosts to allow making active network measurement such as Iperf, nuttcp, and OWAMP. The measurement data is also made accessible using the perfSONAR suite of tools. They’re also using the SNMP polling software I wrote for ESnet called ESxSNMP.


Important spots to visit:

If you are coming to SC10 this year, be sure to come by the SCinet NOC in booth 3351.  I’d be happy to meet anyone who’s read this; feel free to ask for me at the SCinet help desk at the same booth. LBNL (ESnet’s parent organization) is located in booth 2448.  Finally, I am hosting a Bird’s of a Feather (BOF) session on network measurement during the show, the details are here.

And check out the other ESnet demos: You can download a map of ESnet at SC10: SC 2010_floormapFL

LBNL Booth 2448, ESnet roundtable discussions

Inder Monga, Advanced Network Technologies Group, ESnet, will lead a roundtable discussion on: On-demand Secure Circuits and Advance Reservation System (OSCARS), 1-2 p.m., Wednesday, Nov. 17

Many of the demos at SC10 are being carried by OSCARS virtual circuits developed by ESnet with DOE support. OSCARS enables networks to reserve and schedule virtual circuits that provide bandwidth and service guarantees to support large-scale science collaborations. In the first quarter of 2011, ESnet expects to unveil OSCARS 0.6, which will offer vastly expanded capabilities, such as a modular architecture allowing for easy plug and play of the various functional modules and a flexible path computation engine (PCE) workflow architecture. Adoption of OSCARS has been accelerating as 2010 has seen deployments at Internet2 and other domestic and international research and education networks.  Since last year, ESnet saw a 30% increase in the use of virtual circuits. OSCARS virtual circuits now carry over 50% of ESnet’s monthly production traffic.  Increased use of virtual circuits was a major factor enabling ESnet to easily handle a nearly 300% rise in traffic from June 2009 to May 2010.

Brian Tierney, Advanced Network Technologies Group, ESnet, will lead a roundtable discussion on: ARRA-funded Advanced Networking Initiative (ANI) Testbed, 2- 3 p.m. Wednesday, Nov. 17

The research and education community’s needs for managing and transferring data are exploding in scope and complexity. In 2009 the DOE Office of Science awarded ESnet $62 million in Recovery Act funds to create the Advanced Networking Initiative (ANI). This next-generation, 100 Gbps network will connect DOE’s largest unclassified supercomputers. ANI is also establishing a high performance, reconfigurable network testbed for researchers to experiment with advanced networking concepts and protocols. ESnet has now opened the testbed to researchers. A variety of experiments pushing the boundaries of current network technology are underway. Another round of proposals are in the offing. The testbed will be moving from Lawrence Berkeley National Laboratory to ESnet’s dark fiber ring at Long Island (LIMAN: Long Island Metropolitan Area Network) in January 2011 and eventually the 100 Gbps national prototype network ESnet is building to accelerate deployment of 100 Gbps technologies and provide a platform for the DOE experimental facilities at Oak Ridge National Laboratory and the Magellan resources at at the National Energy Research Scientific Computing Center (NERSC)  and Argonne National Laboratory.

–Jon Dugan