Petabyte Hard Drive Storage

SOLVED MAGAZINE

Explore Scality's new online magazine where you will find all the latest articles and news.

Software is Eating the Storage World. It’s Happening Here and Now – with Scality.

The ones who own data will win. That’s what defines the exploding “Information Age”. What does it mean to the Storage industry? Well, it opens the Petabyte era, which not only pushes the limits but challenges the fundamentals of Storage.

The storage eco-system has been relying on proprietary appliance designs for ages. Amid other mounting evidence, what the 75 cloud-scale customers of Scality attest to, is that the times they are a-changin.’

Yes, it’s true: service providers and large enterprises in multiple verticals put mission-critical data on petabyte-scale systems powered by the Scality RING software running on industry-standard software. Today.

Scality adoption is strong with communications services providers (cable and telco providers like Comcast in the USA, Orange in Europe, or 2 of the 3 largest telcos in Japan), cloud service providers (global companies like Dailymotion or Phoenix in the UK), data-hungry enterprise verticals like media & entertainment, global enterprises (for instance, one of the largest worldwide industrial groups is now utilizing the RING to cloud services dedicated to the Internet of Things), and lastly, government bodies (like the French Ministry of Defense or Los Alamos National Labs in the US).

Welcome to a new reality, where the rationale for storage appliances is gone.

Fundamentally, appliances were born not only from suppliers’ desire to establish a captive business model, but also from the challenge of extracting performance from raw hard disks. Twenty years ago, there was no real alternative, but to develop specialized operating systems (OSes) to be able to combine multiple disks and deliver the expected system-level performance, especially in throughput. Some storage players developed true IP in these proprietary OSes, and it made sense, e.g. in SANs.

But these design constraints are now gone, as central processing units (CPUs) became much more affordable, and Linux became the robust OS many developers rely on. In the Petabyte Era, there is no need for a proprietary OS if you need typical scale-out network-attached storage (NAS) performance (or less, obviously). I’m referring to something like gigabyte (GB) level throughput in and out of your storage system, which satisfies something like 80% of today’s storage needs.

A software such as the RING is runs in “user land”, meaning that it’s nothing but an application running on x86/Linux. So we don’t need any hardware/software certification testing effort. This means that we don’t run lengthy compatibility tests which restrict choice and delay the availability of hardware innovation at a whole system level. One of the RING’s value propositions is “Hardware Freedom:” customers have total freedom to pick the hardware of choice. Indeed, we have customers running the Ring on HP, Dell, Cisco, Supermicro, Seagate, SGI and even some ODM servers. Around the globe. It’s their choice.

The Petabyte Era is driving new requirements.

The first businesses which were confronted with the requirements that are now commonplace in the Petabyte Era were the web giants; companies like Amazon, Facebook, Google, etc. And the conditions they required were: 1) total freedom to mix and match hardware platform as their infrastructure growth is exponential, and can’t be limited by hardware lock-in, 2) performance at scale, and 3) total reliability to support their always-on services, while self-healing in case of hardware failures (disk fails are inevitable; and this will continue happening).

How did they respond to such challenges? Without available off-the-shelf solutions, they developed in-house object stores.

In the Petabyte Era that we are currently in, these requirements are now high on the agenda of dozens of thousands of service providers and large enterprise around the globe, specifically the ones who decided to keep operating their own datacenter. While their requirements don’t differ from the needs of the web giants, what does differ is that they don’t all have the engineering muscle to develop their own storage software layer. And even if they attempted to, the workload would undoubtedly eventually distract them from their core business.

But that’s where experience and the Scality RING come into play. We took the best practices and lessons learned, and provide service providers and enterprises (among others) with the Scality RING: a productized version of the web giants’ secret sauce. We give them access to the same benefits of hardware freedom, performance at scale, and absolute reliability. And, the following facts support our claims. Our customers deploy on their hardware vendor of choice, our software supports very demanding use cases performance-wise [insert Dailymotion video link] and when it comes to reliability, we commit contractually. Indeed, our premium support offering comes with SLAs on availability and durability, backed with financial penalty schemes.

One more thing: Hardware matters. More than ever.

Yes, “software is eating the storage world.” It will change this industry value-chain forever: One can already see traditional storage industry players moving along the chain: Western Digital (WD)/Hitachi Global Storage Technologies (HGST) acquired Amplidata, Seagate acquired Xyratex, and every server vendor and original design manufacturer (ODM) is looking to expand their market share: in March 2015 the International Data Corporation’s Worldwide Quarterly Server Tracker observed that “server market demand remained positive due to an on-going enterprise refresh cycle coupled with continued infrastructure investments by cloud service providers,” and predicted favorable future growth. And, money will change pockets as we predicted it in “The Future of Storage.”

And at the same time, hardware matters now, and more than ever. Because dropping the need for tight hardware/software integration and certification testing allows us to take advantage of hardware innovation as soon as it’s released. Larger disks such as SMR will help with more capacity, and require specific access patterns and imply more complex rebuild operations in the Petabyte Era. New network standards like RDMA promise low latencies, and require the storage software to evolve to take full advantage. IP drives will allow our customers to leverage the associated system architecture (separate at a disk level data management and data placement) in order to grow Petabyte systems even more gracefully. All of these are exciting developments directly tied to innovation in the hardware space.

The bottom line is; hardware still represents typically 2/3 of any storage system value. So it matters. Hardware vendors know that and keep innovating. And at Scality, we indeed want to partner with them and take advantage of any of their innovations. Super-fast. That’s why we have a strategic partnership with HP, Seagate and will soon announce many more.

Conclusion: this is a revolution. The tide is up. Anyone who faces petabyte-scale challenges is very much a part of the Petabyte Era, and should talk to Scality.

So talk to us. We have 6 years of field experience, 5 consecutive major releases of the RING software and 75 strong customer references that make “storage software on industry standard hardware,” and the Petabyte Era a reality. It’s here, and available now.

news & events

New NAS Archiver

Tier inactive data off from primary NAS storage to Scality RING

In the News

The redesigned and improved MetalK8s 2.X

Events Updates

What the Corona Virus means for Events in 2020

 

Get a Live Demo

Request a demonstration

 

SAN FRANCISCO, USA

149 New Montgomery Street, Suite 607
San Francisco, CA, 94105
Email: sales.us@scality.com
Telephone: +1 (650) 356-8500
Fax: +1 (650) 356-8501
Toll Free: +1 (855) 722-5489


PARIS, FRANCE

11 rue Tronchet
75008 Paris, France
Email: sales.eu@scality.com
Telephone: +33 1 78 09 82 70


WASHINGTON, D.C., USA

43777 Central Station Drive, Suite 410
Ashburn, VA 20147, USA
Email: sales.us@scality.com
Toll Free: +1 (855) 722-5489

TOKYO, JAPAN

Otemachi Bldg. 4F, 1-6-1, Otemachi
Chiyoda-ku Tokyo, 100-0004 Japan
Email: sales.japan@scality.com
Telephone: +81-3-4405-5400


LONDON, UNITED KINGDOM

20 St Dunstans Hill
London, United Kingdom, EC3R 8HL
Email: sales.eu@scality.com
Telephone: +44 203 795 2434

Products

The most powerful data storage platform.

Protect, search and manage your data on any cloud.

RING

ON PREMISES, PRIVATE CLOUD STORAGE SOLUTION

ZENKO

DATA MANAGEMENT ACROSS
MULTIPLE CLOUDS

NAS ARCHIVER

TIER INACTIVE DATA FROM NAS TO SCALITY RING

Hardware Alliances

Delivering fully integrated solutions.

Learn More

Read about Scality data storage and management solutions.