Commit graph

35 commits

Author SHA1 Message Date
msukkari
d70b729ee8 remove cpu split logic 2025-02-22 17:23:52 -08:00
msukkari
ced6c527ba add cpu split logic and only wait for postgres if we're going to connec to it 2025-02-21 17:13:35 -08:00
Michael Sukkarieh
fdd71cfcfe
add better visualization for connection/repo errors and warnings (#201)
* replace upsert with seperate create many and raw update many calls

* add bulk repo status update and queue addition with priority

* add support for managed redis

* add note for changing raw sql on schema change

* add error package and use BackendException in connection manager

* handle connection failure display on web app

* add warning banner for not found orgs/repos/users

* add failure handling for gerrit

* add gitea notfound warning support

* add warning icon in connections list

* style nits

* add failed repo vis in connections list

* added retry failed repo index buttons

* move nav indicators to client with polling

* fix indicator flash issue and truncate large list results

* display error nav better

* truncate failed repo list in connection list item

* fix merge error

* fix merge bug

* add connection util file [wip]

* refactor notfound fetch logic and add missing error package to dockerfile

* move repeated logic to function and add zod schema for syncStatusMetadata
2025-02-19 18:10:22 -08:00
Michael Sukkarieh
5d7a77bd92
db performance improvements and job resilience (#200)
* replace upsert with seperate create many and raw update many calls

* add bulk repo status update and queue addition with priority

* add support for managed redis

* add note for changing raw sql on schema change
2025-02-19 10:26:13 -08:00
msukkari
26cc70cc11 fix publishible stripe key handling in docker container 2025-02-13 18:45:27 -08:00
bkellam
8d2c731b88 Domain support 2025-02-12 13:45:12 -08:00
msukkari
92530a7ee0 switch encryption key as build arg to se if that fixes build issues 2025-01-30 13:12:45 -08:00
msukkari
f92acc0404 try to move encryption key env decleration in docker file to fix build issues 2025-01-30 12:49:04 -08:00
msukkari
9946901044 add initial logic for staging environment 2025-01-30 10:23:47 -08:00
Michael Sukkarieh
31114a9d95
add concept of secrets (#180)
* add @sourcebot/schemas package

* migrate things to use the schemas package

* Dockerfile support

* add secret table to schema

* Add concept of connection manager

* Rename Config->Connection

* Handle job failures

* Add join table between repo and connection

* nits

* create first version of crypto package

* add crypto package as deps to others

* forgot to add package changes

* add server action for adding and listing secrets, create test page for it

* add secrets page to nav menu

* add secret to config and support fetching it in backend

* reset secret form on successful submission

* add toast feedback for secrets form

* add instructions for adding encryption key to dev instructions

* add encryption key support in docker file

* add delete secret button

* fix nits from pr review

---------

Co-authored-by: bkellam <bshizzle1234@gmail.com>
2025-01-27 14:07:07 -08:00
Brendan Kellam
bae7ca3438
Add @sourcebot/schemas package (#177) 2025-01-24 10:51:49 -08:00
Michael Sukkarieh
a5006c52fe
Migrate to postgres (#174)
* spin up postgres in docker container

* get initial pol of postgres db working in docker image

* spin up postgres server in dev case

* updated syncedAt date after config sync:

* remove unnecessary port expose in docker file
2025-01-23 10:23:46 -08:00
msukkari
738bbaad30 add tenant mode support in docker container: 2025-01-21 12:20:55 -08:00
Brendan Kellam
6cf10b4988
Authentication (#164) 2025-01-16 15:24:13 -08:00
Michael Sukkarieh
7029aa70c1
parallelize repo indexing (#163)
* hacked together a example of using zoekt grpc api

* provide tenant id to zoekt git indexer

* update zoekt version to point to multitenant branch

* pipe tenant id through header to zoekt

* remove incorrect submodule reference and settings typo

* update zoekt commit

* remove unused yarn script

* remove unused grpc client in web server

* remove unneeded deps and improve tenant id log

* pass tenant id when creating repo in db

* add mt yarn script

* add pol of bullmq into backend

* add better error handling and concurrency setting

* spin up redis instance in dockerfile

* cleanup transaction logic when adding repos to index queue

* add NEW index status fetch condition

* move bullmq deps to backend

---------

Co-authored-by: bkellam <bshizzle1234@gmail.com>
2025-01-15 15:44:42 -08:00
Brendan Kellam
15b9e777e4
SQL Database (#157) 2025-01-14 13:37:31 -08:00
bkellam
b32598d091 Bump golang version 2025-01-09 15:49:53 -08:00
Brendan Kellam
33b5418bbf
Pass PostHog key at build time (#92) 2024-11-25 21:04:52 -08:00
Brendan Kellam
83270ffdc9
Add support for configurable domain sub-paths (#74) 2024-11-18 12:09:26 -08:00
Brendan Kellam
0f8f64c56f
Update docker container Node.JS version to v20 (#78) 2024-11-18 11:48:20 -08:00
Brendan Kellam
adba96a8c4
Add additional telemetry (#63) 2024-11-09 16:40:07 -08:00
Brendan Kellam
7966c1440c
Local directory support (#56) 2024-11-01 10:51:14 -07:00
Brendan Kellam
fc8815d135
Config format V2 (#42) 2024-10-17 16:31:18 -04:00
Brendan Kellam
4b51a8d7d7
Added SOURCEBOT_VERSION build arg + versioned telemetry (#41) 2024-10-17 14:50:07 -04:00
Brendan Kellam
d7b6829a42
Add env vars for overriding GitHub / GitLab hostnames in the .netrc file. (#26)
* Add env vars for overriding GitLab / GitHub hostnames used in the .netrc file. (GITLAB_HOSTNAME, GITHUB_HOSTNAME)

* Add docs

* Add changelog entry
2024-10-03 14:06:24 -07:00
Brendan Kellam
d0d104a1e1
Readme V3 + config examples (#12) 2024-09-29 14:17:43 -07:00
Brendan Kellam
74b9fe5c57
Add 'install' event that is fired once on first run (#11) 2024-09-28 16:47:07 -07:00
bkellam
fed2f75a28 Changed things s.t., /data/config.json is the default config path. If a file cannot be found at that path, a warning is issued and we fallback on ./sample-config.json 2024-09-27 23:38:32 -07:00
msukkari
d45a9bcd46 change default CONFIG_PATH to sample-config.json 2024-09-26 14:06:06 -07:00
msukkari
bcdee823ac bake sample-config into docker image so that we can run hello world without cloning 2024-09-24 20:56:51 -07:00
bkellam
3ef9be2b6b Add PostHog telemetry support 2024-09-16 21:37:34 -07:00
bkellam
0133999bbd Add fly.io config & workflow 2024-09-06 11:27:20 -07:00
bkellam
8e1f08fbf2 nit 2024-09-05 19:23:06 -07:00
bkellam
9c426fcab6 Try increasing yarn network timeout to fix failing github action 2024-09-05 18:04:51 -07:00
bkellam
0a66eea9ee For simplicity, move to a single docker container and use supervisord to handle running the processes. 2024-09-05 13:00:27 -07:00