Communications of the ACM
Esnet's Petascale Dtn Project Speeds Up Data Transfers Between Leading Hpc Centers
Operations staff monitor the network in the ESnet/National Energy Research Scientific Computing Center control room.
Credit: Marilyn Chung / Berkeley Lab
The U.S. Department of Energy (DoE) runs the Energy Sciences Network (ESnet) that connects three of the world's leading supercomputers. Over the past two years, ESnet researchers have been working with staff at DoE labs to fine tune the specifically tailored systems called data transfer nodes (DTNs) that move data in and out of the National Energy Research Scientific Computing Center at Lawrence Berkeley National Laboratory.
The effort, called the Petascale DTN project, aims to achieve regular disk-to-disk, end-to-end transfer rates of one petabyte a week between major facilities, which is equivalent to achievable throughput rates of about 15 Gbps on real-world science datasets.
"[High-performance computing] facilities are central to many collaborations, and they are becoming more important to more scientists as data rates and volumes increase," says ESnet's Eli Dart. "The ability to move data in and out of HPC facilities at scale is critical to the success of an ever-growing set of projects."
From Lawrence Berkeley National Laboratory
View Full Article
Abstracts Copyright © 2017 Information Inc., Bethesda, Maryland, USA
No entries found