Top Ranking Linux Supercomputer at NCSA Delivers Groundbreaking Parallel I/O Using the Lustre File System from Cluster File Systems, Inc.
released 11.18.03
PHOENIX
Tungsten, the top ranking Linux cluster recently installed at the National Center for Supercomputing Applications (NCSA) at the University of Illinois at Urbana-Champaign, has achieved 11.1 Gigabytes per second (GB/s) of I/O throughput. This complements the cluster's 9.8 teraflops of computational capability, which was recently reported on the November 2003 Top500 Supercomputer Sites list. This performance level was reached using the Lustre file system for simultaneous writes to individual files from 104 clients across 120 terabytes of DataDirect storage.
"High-end applications in science and engineering are increasingly data intensive, and are requiring significantly more I/O capability than we have had available in the past. As clusters grow and applications become more data-oriented, the I/O capability is a much more significant component of the system," said Rob Pennington, head of NCSA's Computing and Data Management Directorate. "We expect the new cluster with the Lustre file system to fulfill a real need for the applications, which is good news for the scientists."
"NCSA is known for its leadership in high-performance computing, and we are very pleased to support their effort to develop a balanced general purpose supercomputing architecture," said Phil Schwan, Chief Executive Officer, Cluster File Systems, Inc. "Lustre, with its scalable object-based architecture and intelligent protocols and serialization, is ideally suited to the task of delivering dramatic increases in I/O throughput to meet the needs of our customers."
NCSA's Tungsten cluster was designed to provide the large-scale computational and I/O capabilities that are necessary to continue the advance of breakthrough scientific research. Tungsten, with more than 1,450 dual-processor Dell PowerEdge 1750 servers running Red Hat Linux, employs the Lustre file system across a 104 node I/O sub-cluster with more than 120 terabytes of DataDirect storage. Tungsten is ranked fourth on the latest Top 500 supercomputers list and is the most powerful Linux cluster on the list.
"DataDirect Networks is very excited to have delivered and installed tens of teraflops and hundreds of terabytes of SwiftCluster-based storage networking to our valued HPC customers since the beginning of the year", said Alex Bouzari, CEO, DataDirect Networks. "DataDirect's SwiftCluster architecture, optimized for the Lustre file system, achieves its goal of delivering highly scalable data processing with very low latency."
The Tungsten cluster will provide a boost in productivity for the researchers who use NCSA computing facilities to investigate many of science's most important questionsthe large-scale structure of the universe, the properties of stars, the flow of fluids through channels, the dynamics of biological systems, the design of engineering structures, and the nature of matter itself.
NCSA (National Center for Supercomputing Applications) is a national high-performance computing center that develops and deploys cutting-edge computing, networking and information technologies. Located at the University of Illinois at Urbana-Champaign, NCSA is funded by the National Science Foundation. Additional support comes from the state of Illinois, the University of Illinois, private sector partners and other federal agencies. For more information, see http://www.ncsa.uiuc.edu/.
Founded in 2001, Cluster File Systems, Inc. (CFS) has quickly established itself as a leader in high-performance, scalable cluster file system technology. Extensive experience, innovative insights, and proven engineering have enabled CFS to dramatically surpass the scalability limits of modern computing. The company’s premier object-based cluster file system—Lustrecurrently powers clusters with thousands of clients and hundreds of terabytes of data, delivering groundbreaking parallel I/O and metadata throughput on some of the world's largest Linux-based supercomputers. CFS provides technical support, training, and engineering services for Lustre and is actively working with storage and cluster vendors to develop the next generation of intelligent storage devices. Lustre is Open Source software developed and maintained by CFS under the GNU General Public License. For more information, see http://www.clusterfs.com/.