Skip to content

Restore test ordering#11

Merged
samth merged 1 commit intomasterfrom
fix-test-ordering
Mar 31, 2026
Merged

Restore test ordering#11
samth merged 1 commit intomasterfrom
fix-test-ordering

Conversation

@samth
Copy link
Copy Markdown
Member

@samth samth commented Mar 31, 2026

Summary

  • The switch to links.rktd-based path discovery passed 282 individual link paths instead of the original 3 parent directories, changing the test traversal order
  • This pushed racket-test (the longest-running test) to near the end of the queue, creating a ~60 minute idle tail and causing 3 test timeouts from scheduling changes
  • Fix collects the unique parent directories of all link paths and passes those in the original order (collects, pkgs/, share/pkgs/), so test-directory recurses into each parent identically to before
  • Verified that the full file enumeration (13997 files) is identical to the old hardcoded approach

Test plan

  • CI passes
  • File enumeration matches old behavior (verified on hurin)
  • Next DrDr run completes in ~2.75h instead of ~3.5h
  • Timeouts for typed-racket, web-server-test, url-port resolve

@samth samth force-pushed the fix-test-ordering branch 4 times, most recently from fa8b8f4 to d0875ab Compare March 31, 2026 16:36
The timing of when various tests run was significant for both how
loaded the drdr machine is and how long the overall test run took.
This sorts the paths to restore the previous order.

There are surely smarter ideas here but I think this will work.
@samth samth force-pushed the fix-test-ordering branch from d0875ab to 5f2ebbc Compare March 31, 2026 16:41
@samth samth merged commit 41feb9d into master Mar 31, 2026
1 check passed
@samth samth deleted the fix-test-ordering branch April 2, 2026 17:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant