webscraping.app
Browse
Pricing
About Us
Submit
Sign In
Latest tools
Categories
Tags
Pricing
Submit
About Us
/
Categories
/
Data Processing
/
Task Queues
Task Queues
A curated collection of the best distributed task queue systems for managing background jobs and parallel processing workloads.
Popular Categories:
Browser Automation
14
Scraping Frameworks
11
Analytics Databases
9
SERP APIs
9
ETL Tools
9
Workflow Orchestration
9
AI Web Scraping
8
Scraping APIs
8
Distributed Crawling
6
Cloud Compute
6
Proxy Services
6
Search Engines
6
Task Queues – webscraping.app
Order by
Inngest
Durable Functions for Workflows and Queues
Task Queues
Inngest replaces traditional queues with durable step functions, enabling reliable multi-step workflows on serverless, servers, or the edge.
Huey
Lightweight Python Task Queue
Task Queues
Huey is a lightweight Python task queue with a clean API supporting Redis, SQLite, or in-memory storage for background job processing.
BullMQ
Message Queue and Background Jobs for Node.js
Task Queues
BullMQ is an open-source Redis-based message queue trusted by thousands of companies processing billions of jobs daily across Node.js, Python, and more.
RQ (Redis Queue)
Simple Job Queues for Python
Task Queues
RQ is a lightweight Python library for queueing jobs and processing them in the background with Redis-backed workers.
Celery
Distributed Task Queue for Python
Task Queues
Celery is a simple, flexible, and reliable distributed task queue for processing vast amounts of messages with real-time and scheduled execution.