+1 (650) 356-8500 info@scality.com

How AI needs data like a rocket needs fuel


Explore Scality's new online magazine where you will find all the latest articles and news.

The advent of Artificial Intelligence (AI), and now Machine Learning (ML) and Deep Learning (DL), is driving amazing innovation and breakthroughs across many industries. AI is often compared to a rocket ship, with learning algorithms as its engine and data as jet fuel. At its core, ML/DL depends on training and inference, which involve feeding huge amount of (training) data to the algorithm so it can adapt and improve, in order to learn how to make decisions (inferences) on his own. The algorithms perform better and become more accurate as the training data sets grow. This is why AI/ML/DL workloads require data at such a massive scale. Simply put: the more data, the better outcome (as measured by accuracy, speed, etc).

The ability to aggregate and orchestrate massive amount of data surrounding AI/ML/DL workloads is critical. Data sets frequently reach multi-petabyte scale, with performance demands that could saturate the whole infrastructure. When dealing with such large-scale training and test data sets, addressing storage bottlenecks (latency and/or throughput issues) as well as capacity limitations/barriers are key success factors. AI/ML/DL workloads require a storage architecture that can keep data flowing through the pipeline, with both stellar raw I/O performance and capacity scaling prowess. The storage infrastructure needs to keep up with exceedingly demanding requirements across all stages of the AI/ML/DL pipeline. The adequate solution is a storage infrastructure specifically built for raw speed and unlimited scale.

AI Data Node from HPE is an integrated, packaged solution tailor-made for AI/ML/DL workloads. It offers the best of both worlds, combining HPE Scalable Object Storage with Scality RING and WekaIO Matrix™ parallel file System, running side-by-side on HPE Apollo 4200 Gen10 server. In a nutshell, AI Data Node from HPE implements a two-tier storage architecture, featuring a high-performance flash tier paired with a scalable object storage tier, all in-place and under a single namespace. By combining the inherent storage performance of HPE Apollo 4200 Gen10 server, the raw performance of WekaIO parallel file system, and the unlimited scale and efficiency of Scality RING, the AI Data Node fulfills the raw storage performance and storage capacity scaling demands imposed by AI/ML/DL workloads, and delivers the data to fuel and accelerate your AI rocket ship.

To learn more, we invite you to download the technical white paper detailing the Reference Architecture for AI Data Node from HPE.

news & events

Press Release

Analyst report puts Scality in its Leaders circle with ‘Outperformer’ designation

In the News

The redesigned and improved MetalK8s 2.X

Events Updates

What the Corona Virus means for Events in 2020


Get a Live Demo

Request a demonstration



149 New Montgomery Street, Suite 607
San Francisco, CA, 94105
Email: sales.us@scality.com
Telephone: +1 (650) 356-8500
Fax: +1 (650) 356-8501
Toll Free: +1 (855) 722-5489


11 rue Tronchet
75008 Paris, France
Email: sales.eu@scality.com
Telephone: +33 1 78 09 82 70


43777 Central Station Drive, Suite 410
Ashburn, VA 20147, USA
Email: sales.us@scality.com
Toll Free: +1 (855) 722-5489


Otemachi Bldg. 4F, 1-6-1, Otemachi
Chiyoda-ku Tokyo, 100-0004 Japan
Email: sales.japan@scality.com
Telephone: +81-3-4405-5400


20 St Dunstans Hill
London, United Kingdom, EC3R 8HL
Email: sales.eu@scality.com
Telephone: +44 203 795 2434