+1 (650) 356-8500 info@scality.com

How AI needs data like a rocket needs fuel

The advent of Artificial Intelligence (AI), and now Machine Learning (ML) and Deep Learning (DL), is driving amazing innovation and breakthroughs across many industries. AI is often compared to a rocket ship, with learning algorithms as its engine and data as jet fuel. At its core, ML/DL depends on training and inference, which involve feeding huge amount of (training) data to the algorithm so it can adapt and improve, in order to learn how to make decisions (inferences) on his own. The algorithms perform better and become more accurate as the training data sets grow. This is why AI/ML/DL workloads require data at such a massive scale. Simply put: the more data, the better outcome (as measured by accuracy, speed, etc).

The ability to aggregate and orchestrate massive amount of data surrounding AI/ML/DL workloads is critical. Data sets frequently reach multi-petabyte scale, with performance demands that could saturate the whole infrastructure. When dealing with such large-scale training and test data sets, addressing storage bottlenecks (latency and/or throughput issues) as well as capacity limitations/barriers are key success factors. AI/ML/DL workloads require a storage architecture that can keep data flowing through the pipeline, with both stellar raw I/O performance and capacity scaling prowess. The storage infrastructure needs to keep up with exceedingly demanding requirements across all stages of the AI/ML/DL pipeline. The adequate solution is a storage infrastructure specifically built for raw speed and unlimited scale.

AI Data Node from HPE is an integrated, packaged solution tailor-made for AI/ML/DL workloads. It offers the best of both worlds, combining HPE Scalable Object Storage with Scality RING and WekaIO Matrix™ parallel file System, running side-by-side on HPE Apollo 4200 Gen10 server. In a nutshell, AI Data Node from HPE implements a two-tier storage architecture, featuring a high-performance flash tier paired with a scalable object storage tier, all in-place and under a single namespace. By combining the inherent storage performance of HPE Apollo 4200 Gen10 server, the raw performance of WekaIO parallel file system, and the unlimited scale and efficiency of Scality RING, the AI Data Node fulfills the raw storage performance and storage capacity scaling demands imposed by AI/ML/DL workloads, and delivers the data to fuel and accelerate your AI rocket ship.

To learn more, we invite you to download the technical white paper detailing the Reference Architecture for AI Data Node from HPE.

Maziar Tamado

Maziar Tamado

Director of Product Marketing

News & Events


Introducing RING8 with XDM

Intelligent data storage and orchetration for large-scale hybrid cloud


Scality Life

Scality's New Online Magazine


Events & Webinars

Meet with Scality


Get a Live Demo

Request a demonstration



149 Montgomery Street California Street, Suite 607
San Francisco, CA, 94105
Email: sales.us@scality.com
Telephone: +1 (650) 356-8500
Fax: +1 (650) 356-8501
Toll Free: +1 (855) 722-5489


11 rue Tronchet
75008 Paris, France
Email: sales.eu@scality.com
Telephone: +33 1 78 09 82 70


43777 Central Station Drive, Suite 410
Ashburn, VA 20147, USA
Email: sales.us@scality.com
Toll Free: +1 (855) 722-5489


50 Milk Street, 16th Floor
Boston, MA 02109, USA
Email: sales.us@scality.com


Otemachi Bldg. 4F, 1-6-1, Otemachi
Chiyoda-ku Tokyo, 100-0004 Japan
Email: sales.japan@scality.com
Telephone: +81-3-4405-5400


20 St Dunstans Hill
London, United Kingdom, EC3R 8HL
Email: sales.eu@scality.com
Telephone: +44 203 795 2434

Share This