Lustre

Xyratex Contributes Xperior Automated Test Platform for Lustre® to Open Source Community

Putting Lustre to the test!When we embarked on the development of our ClusterStor™ solutions, our goal was to raise the bar in terms of the stability of Lustre based systems. As part of this challenge we recognized that we needed a new approach to testing Lustre® itself to provide a solid foundation for our systems. ClusterStor is a fully integrated scale-out Lustre file system solution that required extensive testing scenarios to ensure the highest level of uptime, performance and stability.

Xyratex Presenting at LAD‘12

This week, on September 24 and 25, the EOFS and OpenSFS are holding the second European Lustre Workshop, now called the Lustre Administrators and Developers Workshop (LAD) . Last year, this workshop was very well attended in its first iteration and this year will provide another great opportunity for global Lustre(R) brethren, from developers to administrators to solution providers, to meet and hear the latest in best practices, developments, as well as interact on real world applications of Lustre.

HPC Data Storage – Through the Lens of The Cluster Administrator (Part II)

Actually, the trouble didn't start immediately: both arrays were stable for a few weeks, lulling us into a false sense of security.   Filesystem usage was initially  light, since as I mentioned before, this was the early days of the organization and there were relatively few users of the cluster and storage.  Further, the early users tended to be more sophisticated about their resource usage (I'll talk more about this in the future) and were therefore easier on the array.  This light early usage masked some fundamental design flaws, but you can always count on Lustre to reveal any shortcomi

Leading Analyst says ClusterStor™ Facilitates "out-of-box" rapid deployment

I spoke with hundreds of Lustre® file system users last week at the International Supercomputing Conference (ISC) in Hamburg Germany and the universal response was wide open eyes and joy when hearing ClusterStor 6000 deployment is a snap – it only requires physical installation and simple setup steps.  ISC attendees agreed that their past deployment experiences have been painful.

Introducing ClusterStor™ 6000

Tired of your compute cluster waiting on file system I/O? Are you interested in seeing high performance data storage that will make your HPC environment scream? Well today, we just announced our latest edition to the ClusterStor series of products and it is the ultimate in HPC data storage. ClusterStor 6000 can deliver huge performance at massive scale in a lot less space, power and cooling than any other storage system. So what?…well despite their claims most other HPC storage systems are all bark and no bite.

Live from HPCS - Canada

Hello from Vancouver! I am here at the High Performance Computing Symposium as part of BCNET & HPCS 2012 which is Canada’s premier HPC forum.  The three day Symposium looks to be an exciting one with close to 500 high profile delegates from various disciplines within the research and HPC communities.  

Storage Performance: Block vs. File System

File system performance is often a major component of overall HPC system performance, and is heavily dependent on the nature of the application(s) generating the load. To achieve optimal performance, the underlying file system configuration must be balanced to match the application characteristics. Hence the basis for Lustre. However, regardless of the style of file system (such as UFS, NTFS, ZFS, or any of the parallel file systems used today), the underlying disk structure dictates the performance capabilities of these file systems.

Xyratex Releases Lustre Migrator Tool

In our continued commitment and support of the Lustre® community, we have announced and released, in mid-October, a Lustre migrator tool that is available for use, licensed under the GPL 2.0, to the entire Lustre community. The Xyratex migrator tool converts Lustre file system MDS on-disk data structures from version 1.8 format to version 2.x native format and has been favorably tested against the latest Lustre community release version 2.1.

Why Lustre?

Lustre is not the only scalable parallel file system in the HPC world but, during it’s 10 year lifespan, it still dominates in eight out of the top ten HPC systems in the world and is in more than 70% of the Top500.  Lustre is open source so it is not tied to a single vendor and has strong support in the community. One of the main reasons for Lustre’s dominance is its inherent scaling and the impressive roadmap for future performance scaling. 

Benefits of Parallel File Systems for HPC Performance

When architecting HPC storage solutions, there are really two options to look at:  a network file system (NFS) solution or a parallel file system. 

Pages