Having beat the metadata drums for more than a decade, it’s tempting to look back and bask in the greatness of how right we were
—and how right we still are.
Let’s just say that the software for this feature didn’t write itself and it took the continuous dedication of our team over a long span of time, but we knew the benefit of it would be invaluable for those implementing our object storage.
What Is Metadata and What Does Metadata Do?
Jason Scott perhaps said it best, Metadata is data that describes data. So it doesn’t ‘do’ anything by itself. But it does enable the best decisions in the future. To that end, we guarantee the integrity of the metadata and service requests for the metadata without having to read the object itself. Metadata is then indexed for millisecond access, even with billions of objects. (Watch the Power of Metadata in Object Storage video for more information.)
Now, the world demands the universal and near instantaneous access to the right set of data for the right requests and the right jobs. This is particularly true when it comes to digital video workflows, as our VP of Marketing Adrian “AJ” Herrera pointed out in a recent blog. With Caringo Swarm Object Storage, we meet that demand through a field-proven, world-class object metadata service delivered on the Elastic stack.
Dynamic Sets of Data on Object Storage
Beyond the retention and search services, we’ve added the power to define and operate on dynamic sets, which we call collections. Think of a smart folder on your email client that can show you all the emails that currently match a set of conditions. Then, add the power to perform actions on sets and you have a force multiplier at scale. (Watch Searchable Metadata & Collections video for more information.)
What About File Access to Data via NFSv4?
As much as we love object-based storage, we know that there are still plenty of cases where the right tool is file access. File level access over the network is provided by SwarmNFS as it serves access to buckets, as well as to collections, providing a dynamic and continuously updating view of the cluster.
As data sets have continued to grow from Terabytes to Petabytes and from thousands to billions of files, the benefits that metadata delivers (such as locating the right data quickly and delivering content efficiently to users) have become critical for business success. Join me as I dive into our world-class metadata features and usage in our next Tech Tuesday webinar, February 26 at 11am PT/2pm ET.
You can bring your questions to the webinar for our live Q&A, or feel free to send them to us in advance at firstname.lastname@example.org.
Abstract: This whitepaper presents the results from recent benchmarking of Caringo Swarm object storage on a multi-Terabit converged Ethernet Software-Defined Storage Super Data Cluster deployed by the UK Science and Technology Facilities Council’s (STFC) Scientific … More Details »