Skip to content

feat(batch-queue): two-level tenant dispatch for fair queue #3133

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ericallam merged 9 commits into from
Feb 26, 2026
+2,039 −168
Merged

feat(batch-queue): two-level tenant dispatch for fair queue #3133

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
6aa8954
feat: two-level tenant dispatch for fair queue (TRI-7082)
ericallam Feb 25, 2026
e1604f7
safer legacy master queue draining
ericallam Feb 25, 2026
a7c1b4a
fix: update visibility manager release/reclaim to use dispatch indexes
ericallam Feb 26, 2026
8d0a826
test: add release/reclaim dispatch index tests and legacy migration t…
ericallam Feb 26, 2026
d79ca44
fix: fallback dispatch scheduler was reading empty master queue
ericallam Feb 26, 2026
4a62c4b
typecheck fixes
ericallam Feb 26, 2026
b855e48
Better DRR efficiency and making sure selection is fair
ericallam Feb 26, 2026
af54cdf
fix: dispatch index shard must be tenant-based, not queue-based
ericallam Feb 26, 2026
321b462
chore: add server changes file for dispatch shard fix
ericallam Feb 26, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions .server-changes/fix-dispatch-shard-tenant-based.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
---
area: webapp
type: feature
---

Two-level tenant dispatch architecture for batch queue processing. Replaces the
single master queue with a two-level index: a dispatch index (tenant → shard)
and per-tenant queue indexes (tenant → queues). This enables O(1) tenant
selection and fair scheduling across tenants regardless of queue count. Improves batch queue processing performance.
Loading