Communications of the ACM
UT Austin Announced Fastest Academic Supercomputer in the World
The Frontera supercomputer at the Texas Advanced Computing Center.
Credit: TACC
The Texas Advanced Computing Center (TACC) at The University of Texas at Austin has launched Frontera, the fastest supercomputer at any university and the fifth most powerful system in the world. TACC is also home to Stampede2, the second fastest supercomputer at any American university. The launch of Frontera solidifies UT Austin among the world's academic leaders in this realm.
Joined by representatives from the U.S. National Science Foundation — which funded the system with a $60 million award — UT Austin, and technology partners Dell Technologies, Intel, Mellanox Technologies, DataDirect Networks, Nvidia, IBM, CoolIT, and Green Revolution Cooling, TACC inaugurated a new era of academic supercomputing with a resource that will help the United States' top researchers explore science at the largest scale and make the next generation of discoveries.
"Scientific challenges demand computing and data at the largest and most complex scales possible. That's what Frontera is all about," says Jim Kurose, assistant director for Computer and Information Science and Engineering at NSF. "Frontera's leadership-class computing capability will support the most computationally challenging science applications that U.S. scientists are working on today."
Frontera has been supporting science applications since June and has already enabled more than three dozen teams to conduct research on a range of topics from black hole physics to climate modeling to drug design, employing simulation, data analysis, and artificial intelligence at a scale not previously possible.
First announced in August 2018, Frontera was built in early 2019, and earned the #5 spot on the twice-annual TOP500 list in June, achieving 23.5 PetaFLOPS (23.5 thousand million million floating-point operations per second) on the high-performance LINPACK benchmark, a measure of the system's computing power.
Olexandr Isayev, a chemist from the University of North Carolina, used Frontera to run more than three million atomic force field calculations in less than 24 hours — a major achievement in high-speed quantum computation. The calculations are part of an effort to train an artificial intelligence system that can predict the likely characteristics of new drug compounds and identify compounds with the ability to target specific cells.
"It's a great machine, especially for quantum mechanics applications," Isayev says. "We're really looking forward to running large-scale calculations that were not possible before."
Ganesh Balasubramanian, an assistant professor of Mechanical Engineering and Mechanics at Lehigh University, has been using Frontera to study the dynamics of organic photovoltaic materials and model manufacturing conditions.
"The lightning speed at which Frontera performs computations is very beneficial," says Balasubramanian, who during the early user period experienced a five-time speed-up in his simulations of solar material manufacturing. "Overall, the entire pace of computational research will be increased by the arrival of Frontera."
Manuela Campanelli, an astrophysicist at the Rochester Institute of Technology, has been using Frontera to perform the longest simulations ever of the merger of neutron stars, including for the 2017 event detected by the Laser Interferometer Gravitational-Wave Observatory, the Europe-based Virgo detector, and 70 ground- and space-based observatories.
"Frontera is an amazing system because it gives us a very large number of computer nodes that we can use to solve very complex problems," Campanelli says. "These types of resources are unavailable on most university campuses, so we really need to have Frontera in order to be able to do the simulation we do."
Frontera combines Dell EMC PowerEdge servers with 8,008 compute nodes, each of which contains two 2nd generation Intel Xeon scalable processors, totaling more than 16,000 processors and nearly half a million cores, connected by a 200 gigabit per second HDR Mellanox InfiniBand high-speed network.
The system incorporates innovative flash storage from DataDirect Networks and novel cooling systems from CoolIT, Cooltera, and Green Revolution Cooling (GRC), and employs several emerging technologies at unprecedented scale, including high-powered, high-clock rate versions of the latest Intel Xeon processors, Intel Deep Learning Boost, Intel Optane memory, and several kinds of liquid cooling.
In August, Frontera added two new subsystems to provide additional performance and to explore alternate computational architectures for the future. A 360 Nvidia Quadro RTX 5000 graphics processing unit (GPU) system submerged in liquid coolant racks developed by GRC will explore more efficient ways to cool future systems, as well as explore single-precision optimized computing. An IBM POWER9-hosted system with 448 Nvidia V100 GPUs will provide additional performance, and provide the top-performing GPU architecture with tight coupling to the processor and memory subsystems. These additional systems will accelerate artificial intelligence, machine learning, and molecular dynamics research for Frontera researchers in areas ranging from cancer treatment to biophysics.
In the coming months, Frontera will integrate with cloud providers Microsoft, Google, and Amazon to provide researchers access to emerging computing technologies and long-term storage.
Frontera will operate for at least five years and will support hundreds of research projects and thousands of researchers in nearly every field of science over its lifetime. It is expected to have a major impact on:Natural hazards modeling — predicting the trajectory and intensity of storms, and helping to design infrastructure that can withstand the strongest disasters;
- Genomics, including precision agriculture to feed the world's growing population;
- Energy research, from fusion to solar power to cleaner coal;
- Astrophysics, including multi-messenger astronomy and gravitational wave modeling; and,
- Materials sciences, using a combination of modeling and deep learning to accelerate the development of new molecules for medicine and engineering.
Projects will be selected through a competitive application process and researchers will need to show that they require a computer at the scale of Frontera to solve their problems.
Faculty at the Oden Institute for Computational Engineering and Sciences at UT Austin are leading the world-class Frontera science applications and technology team, with partners from the California Institute of Technology, Cornell University, Georgia Institute of Technology, Ohio State University, Princeton University, Stanford University, Texas A&M University, the University of Chicago, the University of Utah, and the University of California, Davis.
Frontera will serve as a powerful instrument for the largest and most computationally demanding users in the United States, and as a training ground for the next-generation of scientists.
"Academic researchers have never had a tool this powerful to solve the problems that matter to them," says Dan Stanzione, TACC executive director. "We are proud to launch Frontera — a new, national resource for science that will power the discoveries of the future."
The Frontera computing project at the Texas Advanced Computing Center is made possible by National Science Foundation award OAC-1818253: Computation for the Endless Frontier.
No entries found