ti.sil/sourcebot
1
0
Fork 0
mirror of https://github.com/sourcebot-dev/sourcebot.git synced 2025-12-14 21:35:25 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1
sourcebot/packages/backend/src
History
Derek Miller 2c0540f6bf
fix(backend): Limit concurrent git operations to prevent resource exhaustion (#590) (#593) 
When syncing generic-git-host connections with thousands of repositories,
unbounded Promise.all caused resource exhaustion (EAGAIN errors) by spawning
too many concurrent git processes. This resulted in valid repositories being
incorrectly skipped during sync.

- Add p-limit to control concurrent git operations (max 100)
- Follow existing pattern from github.ts for consistency
- Prevents file descriptor and process limit exhaustion
- Uses rolling concurrency to avoid head-of-line blocking

Fixes #590
2025-11-01 15:15:09 -07:00
..
ee chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
azuredevops.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
bitbucket.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
configManager.ts feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
connectionManager.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
connectionUtils.ts feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
constants.ts fix(web): Fix /settings/connections throwing a error when there is a git connection present (#588) 2025-10-31 13:08:51 -07:00
env.ts feat(ee): GitLab permission syncing (#585) 2025-10-30 11:08:10 -07:00
gerrit.ts feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
git.ts feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
gitea.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
github.test.ts v3 effort (#158) 2025-03-31 22:34:42 -07:00
github.ts add p-limit to GitHub API calls to avoid overwhelming the node process (or the API rate limits) (#591) 2025-10-31 14:49:43 -07:00
gitlab.test.ts feat(gitlab): Add exclude.userOwnedProjects config setting (#498) 2025-09-08 22:38:18 -04:00
gitlab.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
index.ts feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
instrument.ts Add support for structured logs (#323) 2025-06-02 11:16:01 -07:00
posthog.ts v3 effort (#158) 2025-03-31 22:34:42 -07:00
posthogEvents.ts v3 effort (#158) 2025-03-31 22:34:42 -07:00
promClient.ts feat(worker,web): Improved connection management (#579) 2025-10-28 21:31:28 -07:00
repoCompileUtils.ts fix(backend): Limit concurrent git operations to prevent resource exhaustion (#590) (#593) 2025-11-01 15:15:09 -07:00
repoIndexManager.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
types.ts feat(web): Improved repository table (#572) 2025-10-25 14:51:41 -04:00
utils.test.ts fix(search-contexts): Fix issue where a repository would not appear in a search context if it was created after the search context was created (#354) 2025-06-17 14:04:25 -07:00
utils.ts chore(tech-debt): Remove built-in secret manager (#592) 2025-10-31 14:33:28 -07:00
zoekt.ts feat(web): Improved repository table (#572) 2025-10-25 14:51:41 -04:00