Skip to content

WIP: refactor worker DB data preloading#403

Open
krokicki wants to merge 1 commit into
mainfrom
refactor-worker-data-upfront
Open

WIP: refactor worker DB data preloading#403
krokicki wants to merge 1 commit into
mainfrom
refactor-worker-data-upfront

Conversation

@krokicki

@krokicki krokicki commented Jul 6, 2026

Copy link
Copy Markdown
Member

This is a work in progress!

Gets rid of the backwards RPC calls from worker to the main process. The refactoring can probably go further to minimize what is sent to the workers, I need to take a longer look at that.

Summary

  • replace worker reverse DB RPC with parent-prepared request payloads
  • preload file share paths and minimal job metadata before dispatching worker actions
  • keep workers free of DB credentials while restoring a simple one-request / one-response IPC flow

Validation

  • pixi run test-backend tests/test_worker.py -q
  • pixi run test-backend tests/test_apps.py tests/test_apps_endpoints.py -q
  • pixi run test-backend tests/test_endpoints.py -q -k 'not root_endpoint and not spa_routing'

Note: full tests/test_endpoints.py in the temporary worktree only failed the two SPA/static asset checks because the worktree lacked built frontend assets.

Co-authored-by: Codex <codex@openai.com>
@krokicki krokicki changed the title Refactor worker DB data preloading WIP: refactor worker DB data preloading Jul 6, 2026
Base automatically changed from more-apps to main July 7, 2026 13:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant