IBM open sources high-performance file system

IBM is opening up the source code to its high-performance General Parallel File System to third-party vendors. The move will mean the software can be run on other's hardware.

In the past, the file system, designed to provide high-speed file access to distributed supercomputing applications, ran only on IBM hardware. But IBM decided to broaden platform support in the name of openness and flexibility.

"As the popularity of Linux-based computing clustering grows, so does the need for simplified and highly performing file management software that is able to function across many hardware platforms," said VP of Deep Computing at IBM, David Turek.

Linux Networx, which builds Linux supercomputers, is the first hardware vendor to license GPFS. It will integrate GPFS into its LS Series of Linux Supersystems.

GPFS can support hundreds of terabytes of storage within a single file system, creating a virtual pool of data out of multiple physical servers and storage nodes. It is extremely scalable and can support huge files associated with applications such as computational fluid dynamics, crash analysis and structural engineering.

GPFS runs on AIX and Linux clusters, but only now can support mixed hardware environments.

"Now that GPFS is available on multiple vendors' systems, NERSC [National Energy Research Scientific Computing Center] was able to implement a global file system across mixed architectures, enabling our users to be much more productive," said NERSC general manager and head of High Performance Computing at Lawrence Berkeley National Laboratory, Bill Kramer.

IBM is licensing GPFS source code to third-party vendors, which can then adapt GPFS to other platforms and share their work with other licensees. Big Blue is also creating a community-developed environment for GPFS in the hopes of promoting innovation.

It’s a tack systems vendors are taking more often as they look to the open-source model of development to help improve technology and drive business.