Comment by brightball
Comment by brightball 4 days ago
The way that Oban for Elixir and GoodJob for Ruby leverage PostgreSQL allows for very high throughput. It's not something that easily ports to other DBs.
Comment by brightball 4 days ago
The way that Oban for Elixir and GoodJob for Ruby leverage PostgreSQL allows for very high throughput. It's not something that easily ports to other DBs.
A combination of LISTEN/NOTIFY for instantaneous reactivity, letting you get away with just periodic polling, and FOR UPDATE...SKIP LOCKED making it efficient and safe for parallel workers to grab tasks without co-ordination. It's actually covered in the article near the bottom there.
Good Job is a strong attempt. I believe it's based around Advisory Locks though.
Appreciate the added context here, this is indeed some special sauce that challenges my prior assumptions!