Object storage
S3 access logging at scale: Managing request logs
S3 access logs record every request made to a bucket: who made it, from where, which object it touched, what the result was and how long it took. They are ...
Author
Joshua Silvia
Object storage
Object storage rolling upgrades: How updates stay online
Storage software needs updating like any other software: security fixes, bug fixes, new features and support for new hardware. For a system that applications ...
Object storage
Mixed hardware in object storage clusters
Software-defined object storage promises that a cluster can outlive the hardware it started on. Nodes are added as capacity grows and retired as they age, so ...
Object storage
Object storage metadata: Why object counts matter
Object storage is usually sized and priced by capacity: how many petabytes it holds and how fast it can move them. The second number that decides how a cluster ...
Object storage
Small object storage: Where overhead comes from
Object storage is built around large objects. Its protection schemes, its throughput figures and its cost per terabyte all look best when files are measured in ...
Object storage
Silent data corruption: Detecting bit rot in storage
Most storage failures announce themselves. A drive stops responding, a server drops off the network, an alert fires. Silent data corruption does not. A few ...
Object storage
Object storage deletion at scale: How mass expiry works
Deleting data sounds like the cheapest thing a storage system can do. At small scale it is. At the scale of hundreds of millions of objects expiring under a ...
Object storage
Data placement across racks and sites
Data placement is the set of rules that decides where each copy or fragment of an object physically lands: which drives, which servers, which racks and which ...
Object storage
Stretched clusters: Replication across sites
A stretched cluster is a single storage system whose nodes are spread across two or more sites close enough to behave, for most purposes, like one data center. ...
Object storage
Object storage site failover: What happens to writes?
When a site running object storage fails, the first question is whether applications can keep reading and writing. The second, which matters more and gets ...