Using World-Class Metadata with Object Storage

The world demands universal and instant access to any dataset, particularly in digital video workflows. Caringo uses world-class metadata with Swarm object storage to meet that demand.

Metadata Storage Tag Cloud
Metadata Storage Tag Cloud

Having beat the metadata drums for more than a decade, it’s tempting to look back and bask in the greatness of how right we were

—and how right we still are.

The Power of Metadata in Object StorageHowever, when we set this course for our object storage product development at Caringo, metadata was thought to be a tangential and unnecessary feature to many in the storage and IT industry.

Let’s just say that the software for this feature didn’t write itself and it took the continuous dedication of our team over a long span of time, but we knew the benefit of it would be invaluable for those implementing our object storage.

What Is Metadata and What Does Metadata Do?

Jason Scott perhaps said it best, “Metadata is a love note to the future.” Metadata is data that describes data. So it doesn’t ‘do’ anything by itself. But it does enable the best decisions in the future. To that end, we guarantee the integrity of the metadata and service requests for the metadata without having to read the object itself. Metadata is then indexed for millisecond access, even with billions of objects. (Watch the Power of Metadata in Object Storage video for more information.)

Metadata Storage Tag CloudWhy Use Metadata for Object Storage?

Now, the world demands the universal and near instantaneous access to the right set of data for the right requests and the right jobs. This is particularly true when it comes to digital video workflows, as our VP of Marketing Adrian “AJ” Herrera pointed out in a recent blog. With Caringo Swarm Object Storage, we meet that demand through a field-proven, world-class object metadata service delivered on the Elastic stack.

Dynamic Sets of Data on Object Storage

Beyond the retention and search services, we’ve added the power to define and operate on dynamic sets, which we call collections. Think of a smart folder on your email client that can show you all the emails that currently match a set of conditions. Then, add the power to perform actions on sets and you have a force multiplier at scale. (Watch Searchable Metadata & Collections video for more information.)

What About File Access to Data via NFSv4?

As much as we love object-based storage, we know that there are still plenty of cases where the right tool is file access. File level access over the network is provided by SwarmNFS as it serves access to buckets, as well as to collections, providing a dynamic and continuously updating view of the cluster.


Learn MoreUsing Metadata with Object Storage

As data sets have continued to grow from Terabytes to Petabytes and from thousands to billions of files, the benefits that metadata delivers (such as locating the right data quickly and delivering content efficiently to users) have become critical for business success. Join me as I dive into our world-class metadata features and usage in our next Tech Tuesday webinar, February 26 at 11am PT/2pm ET.

Register Now

You can bring your questions to the webinar for our live Q&A, or feel free to send them to us in advance at info@caringo.com.

Ryan Meek
Ryan Meek

About The Author

After studies in Economics and Computer Science at University of Texas, Ryan focused on software development in early stage companies in Austin. Ryan currently is Caringo's Principal Solution Architect, after working in a variety of roles from software developer and technical sales to product management. In his free time, he plays tennis and Go as much as he possibly can.


More From Author