Skip to content

Implement resource guard extension point and worker limiter - #43

Open
cottsay wants to merge 1 commit into
cottsay/parallel-executor-fixesfrom
cottsay/resource_guard
Open

Implement resource guard extension point and worker limiter#43
cottsay wants to merge 1 commit into
cottsay/parallel-executor-fixesfrom
cottsay/resource_guard

Conversation

@cottsay

@cottsay cottsay commented Sep 3, 2026

Copy link
Copy Markdown
Member

The point of this extension point is to support extension points which affect what jobs can be run by the parallel executor at what times.

The primary motivation here is to support a GNU-style jobserver, but the extension point is designed such that it could use historical build data to determine which jobs to run to reduce the "long tail" of the build, improving resource utilization.

The limiting of how many total package-level jobs are allowed to run was moved into this extension, and can therefore now be disabled as any extension could.

@cottsay cottsay self-assigned this Sep 3, 2026
@cottsay cottsay added the enhancement New feature or request label Sep 3, 2026
@cottsay
cottsay force-pushed the cottsay/resource_guard branch from 3640265 to f6e2529 Compare September 4, 2026 16:04
@codecov-commenter

codecov-commenter commented Sep 4, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 93.75000% with 7 lines in your changes missing coverage. Please review.
✅ Project coverage is 95.78%. Comparing base (58bab11) to head (f6e2529).

Files with missing lines Patch % Lines
...olcon_parallel_executor/resource_guard/__init__.py 90.41% 6 Missing and 1 partial ⚠️
Additional details and impacted files
@@                         Coverage Diff                         @@
##           cottsay/parallel-executor-fixes      #43      +/-   ##
===================================================================
- Coverage                            97.38%   95.78%   -1.61%     
===================================================================
  Files                                    4        7       +3     
  Lines                                  153      261     +108     
  Branches                                41       52      +11     
===================================================================
+ Hits                                   149      250     +101     
- Misses                                   1        7       +6     
- Partials                                 3        4       +1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants