sourcebot/packages
Derek Miller 2c0540f6bf
fix(backend): Limit concurrent git operations to prevent resource exhaustion (#590) (#593)
When syncing generic-git-host connections with thousands of repositories,
unbounded Promise.all caused resource exhaustion (EAGAIN errors) by spawning
too many concurrent git processes. This resulted in valid repositories being
incorrectly skipped during sync.

- Add p-limit to control concurrent git operations (max 100)
- Follow existing pattern from github.ts for consistency
- Prevents file descriptor and process limit exhaustion
- Uses rolling concurrency to avoid head-of-line blocking

Fixes #590
2025-11-01 15:15:09 -07:00
..
backend fix(backend): Limit concurrent git operations to prevent resource exhaustion (#590) (#593) 2025-11-01 15:15:09 -07:00
crypto chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
db chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
error v3 effort (#158) 2025-03-31 22:34:42 -07:00
logger chore(worker,web): Repo indexing stability improvements + perf improvements to web (#563) 2025-10-18 16:31:22 -07:00
mcp @sourcebot/mcp v1.0.7 2025-10-28 23:03:11 -07:00
schemas chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
shared feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
web chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00