bisibility — Track Google rankings and Search Console insights. Free during beta.
Try bisibility freeOur product

Object Storage

A curated collection of the best object storage services for archiving raw HTML, screenshots, and large scraped datasets.

Quick answer

Object storage should be chosen as a storage backend, not as a transfer tool. The MinIO community repository is archived and needs a separate maintenance plan for self-hosted S3-compatible storage, while Cloudflare R2 fits managed S3-compatible storage with zero egress fees. Use tools such as rclone for moving data between storage systems, not as the backend itself.

Top picks in Object Storage

  1. Cloudflare R2

    Zero egress
    Fits teams that want managed S3-compatible object storage on Cloudflare with zero egress fees for frequently accessed scraped data.
Favicon

 

  
  
Favicon

 

  
  
Favicon

 

  
  
Favicon

 

  
  
Favicon

 

  
  
Favicon

 

  
  

Frequently asked questions

What exactly is object storage?

Object storage stores data as objects, with content and metadata addressed by a key. Amazon S3 organizes objects in buckets; the bucket, object key and optional version identify an object. A key that resembles a file path does not by itself give the service filesystem behavior.

Sources (checked ): Amazon S3 objects, buckets and keys