High-Performance Computing with Object Storage

The size of HPC data sets is exploding. With Swarm Object Storage, manage thousands of tenants and billions of files while simplifying access

hpc-for-use-cases
hpc-for-use-cases

Our thoughts turn to High-Performance Computing (HPC) as we plan our return to Denver for the 31st anniversary of the Supercomputing Conference (SC19). The conference focus is on high-performance computing (HPC), networking, storage and analysis.

Recovering Data with Swarm Object Storage

Whether you are predicting an eclipse or the path of a hurricane or you are gathering information for scientific research such as that supported by the UK STFC Scientific Computing Department’s JASMIN cluster, it’s no secret that the volume of data in HPC data sets is exploding. To complicate matters further, data often needs to be shared with students, employees and researchers across various departments, locations and applications.

So what happens if you don’t have the right storage in place?

Lack of the right storage can lead to both poor performance and tedious manual management of infrastructure and data access that put research and business objectives at risk.

How to Store and Manage HPC data

Best-of-breed object-based storage such as Caringo Swarm is being used across the globe to store and manage HPC data. With Swarm, you can:

  • Enable NFS and S3 access to the same data sets
  • Easily manage thousands of tenants and billions of files
  • Simplify sharing and access to data internally and externally

And, you can do it all while still providing read throughput performance equivalent to parallel file systems.

Swarm HPC Multi-Tenant Workflow

Swarm Object Storage HPC Tier 2 Active Archive Workflow

Learn More About Object Storage for HPC

Caringo Sr. Consultant John Bell and VP Marketing Adrian “AJ” Herrera will present Object Storage Solutions for High-Performance Computing on our next Tech Tuesday educational webinar on BrightTALK. You can watch live on October 22 at 11am PT/2pm ET or on demand after the event.

Register Now

Caringo Swarm object storage for HPC data sets

In a Hurry?

Sometimes, you need to fast-track your research and decision making. That’s why we offer consultations and custom demos to qualified organizations with our expert Storage Engineers as well as a free Swarm Developer Edition so you can dig in and see how Swarm works. Email us at info@Caringo.com if you have any questions.

Sarah Cook
Sarah Cook

About The Author

Sarah Cook is Caringo's Director of Marketing and brings deep expertise in Technical and Marketing Communications and Product Marketing. Sarah has worked for some of the biggest names in technology including Dell and Cisco. Sarah has a B.A. in English Composition with a minor in Music from the University of North Texas.


More From Author