webscraping.app
Browse
About Us
Submit
Sign In
Latest tools
Categories
Tags
Submit
About Us
/
Categories
/
Infrastructure
Infrastructure
Browse 3 subcategories of Infrastructure tools and find the perfect solution for your needs.
Search Engines
6 tools
Cloud Compute
6 tools
Object Storage
4 tools
Popular Categories:
Browser Automation
14
Scraping Frameworks
11
ETL Tools
9
Analytics Databases
9
SERP APIs
9
Workflow Orchestration
9
AI Web Scraping
8
Scraping APIs
8
Proxy Services
6
Distributed Crawling
6
Search Engines
6
Cloud Compute
6
Order by
Cloudflare R2
S3-compatible storage with ZERO egress fees. $15/TB/month. Perfect for frequently accessed scraped data.
Object Storage
Render
Cloud platform for web services, background workers, and cron jobs. Simple deployment for scraping services.
Cloud Compute
Railway
Deploy apps from GitHub with zero config. Auto-scaling containers for scraping workloads with built-in databases.
Cloud Compute
AWS Lambda
Amazon serverless compute. Run scrapers triggered by events or schedules. Integrates with S3, SQS for scraping pipelines.
Cloud Compute
Cloudflare Workers
Edge serverless platform. Run JavaScript/TypeScript at the edge with low latency. Great for lightweight scrapers and proxies.
Cloud Compute
Modal
Serverless Python platform with native Playwright support. Run headless browsers at scale with built-in scheduling.
Cloud Compute
Fly.io
Deploy containers globally on edge servers. Run long-running scrapers with persistent storage and global distribution.
Cloud Compute
Algolia
Managed search, great for e-commerce
Search Engines
Manticore Search
2.8x faster for big data, 10x faster log analytics
Search Engines
OpenSearch
AWS-backed fork, Apache 2.0 license
Search Engines
RustFS
2.3x faster, Apache 2.0 license, S3-compatible
Object Storage
Typesense
Fast, simple with sub-50ms response times
Search Engines
rclone
rsync for cloud storage. Sync, copy, mount 70+ storage providers. Essential for moving scraped data.
Object Storage
Meilisearch
Lightning-fast open-source search engine
Search Engines
MinIO
MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.
Object Storage
Elasticsearch
Free and Open Source, Distributed, RESTful Search Engine
Search Engines