releases
A Job Queue in One SQLite File: ukue 0.1 Lets Small Teams Skip Redis
Sooner or later every web app needs to do something outside the request. Send the welcome email after the user has seen the page. Resize the photo while they carry on. …
Version 0.1, free and open source
A job queue in one file
ukue keeps your background jobs in a single SQLite file, with retries, delayed jobs and dead letters. Embed it in your app, or run it as one small binary that any language can talk to. There's no Redis or RabbitMQ to look after.
1 file
Holds every queue, job and retry. Copy it and you have a backup
0 lost
Jobs out of 8,000 while worker processes were killed 250 times
900/s
Jobs one worker ran, each step written safely to disk
Apache 2.0
License for all of the code
Speed measured on a two-core cloud machine with every change flushed to disk. The test logs are on GitHub.
Guides and notes
All posts →
use cases
A Raspberry Pi on a Patchy Connection: Readings Wait in a ukue File Until the Internet Is Back
Think of a market garden with three greenhouses, each with temperature, humidity and soil sensors wired to a Raspberry Pi. Every minute the Pi reads the sensors and sends …
use cases
AI Transcription on a Rented GPU: Python Workers Pull Jobs From ukue Over HTTP
Say a small podcast-hosting service wants to offer transcripts. Speech-to-text models are quick on a GPU and painfully slow without one, and the service’s web …
use cases
An Order and Its Receipt Email in One SQLite Transaction With ukue's EnqueueTx
Take a small online shop that runs as a single Go program with its data in SQLite: one file to back up and no database server to look after. When an order comes in, the …
use cases
Appointment Reminders With ukue: Jobs Scheduled Days Ahead, Deleted When a Booking Moves
Picture a hair salon in London that takes bookings online, weeks ahead, and texts every client a reminder 24 hours before the appointment. No-shows cost it money, so the …
use cases
Checking 300 Websites Every Night With ukue, Cron and a Shell Script
Say a two-person web agency looks after 300 client websites. Each morning they want to know which sites were down overnight and which TLS certificates are close to …
testing
How the ukue Job Queue Was Tested: 250 Killed Workers, 0 Lost Jobs
A job queue makes one promise above all others: a job that was added runs, even if the machine has a bad day. So the most important tests for ukue don’t check the …
use cases
Photo Upload Thumbnails With ukue: Previews First, Print Sizes When the CPU Is Free
Take a portfolio site where photographers upload full-size JPEGs after a shoot, a few hundred at a time and 20 or 30 megabytes each. Every photo needs three resized …
use cases
Signup Emails From a Python Web App, Sent in the Background With ukue
Say a three-person team runs a Flask app where people book cooking classes. Every new account gets a welcome email, and today the app sends it inside the signup request. …
Questions or ideas?
If ukue nearly fits your project, or you'd like it to do something it doesn't yet, write in.