You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
[TS PBT] Provide campaign controls, shared budgets and extensible run artifacts #354
Part of #345. Depends on #353/#384. Supplies the common campaign shell and controls; #355 owns the repeated observation-driven feedback algorithm.
Goal
Provide one reproducible command and artifact contract for direct PBT, direct symbolic search, sequential control and the full feedback configurations, with identical original property semantics and accountable budgets.
Staged delivery
This issue delivers the campaign shell and direct controls before #355 completes the core feedback modes. #405 consumes both implementations using the same deadline, artifact and oracle contracts. Extension configuration/reduction for #400–#403 is implemented and accepted in those issues; no extension is a prerequisite for the shell or pilot. Core and extension results carry an explicit stage/capability label.
Initial controls
PBT_ONLY: concrete generation plus backend shrinking under the deadline.
SYMBOLIC_ONLY: original-predicate search plus concrete candidate validation; no random PBT phase.
SEQUENTIAL: concrete campaign followed, when appropriate, by original-predicate USVM search, replay and reduction. Preserve found violations without requiring another engine. Use this explicit name in reports; legacy HYBRID, if retained, is documented as an alias for SEQUENTIAL.
Unsupported phases can be skipped with capability diagnostics; definition errors stop the affected property. No semantic substitution on failure.
Preserve optional coverage and observations from the actual PBT run. The controls do not consume them as search feedback.
Shared extension boundary
Reuse property IDs, source/tool hashes, tagged values, run results and existing CLI options. Add a small mode/round/target record rather than a generic plugin framework.
Record original property/assertion, generator support, observation requests, phase/round, origin engine, source point, target/hypothesis, input provenance, coverage granularity and all replay outcomes.
Concrete values must be consumable by inference/mapping without rerunning PBT. Selected returned seeds and bounded neighborhood-generation decisions are recorded separately from mere explicit replay.
Unsupported observation/coverage/shrinking capabilities remain partial capabilities, not fabricated data.
Budgets
One monotonic total deadline per property/campaign with declared bounded rounds and phase caps; reserve concrete validation time before symbolic work.
Include relevant startup/frontend/adapter work, instrumentation, inference, mapping, search, replay and shrinking. Report one-time reusable setup and cold/warm assumptions consistently.
Allocation may transfer unused time within the total deadline. Adaptive changes belong to a named scheduler policy and are frozen before final evaluation.
Bound observation storage, candidate queues and returned-seed corpus; record truncation and stop reasons.
Fixed seeds do not promise deterministic timeout-limited solver behavior. Record actual tool/runtime/backend versions, settings and task revisions.
changed the title [-][TS PBT] Assemble the end-to-end fast-check and USVM pipeline[/-][+][TS PBT] Assemble the end-to-end PBT and USVM pipeline[/+]on Aug 22, 2026
changed the title [-][TS PBT] Assemble the end-to-end PBT and USVM pipeline[/-][+][TS PBT] Provide campaign controls, shared budgets and extensible run artifacts[/+]on Sep 30, 2026
Part of #345. Depends on #353/#384. Supplies the common campaign shell and controls; #355 owns the repeated observation-driven feedback algorithm.
Goal
Provide one reproducible command and artifact contract for direct PBT, direct symbolic search, sequential control and the full feedback configurations, with identical original property semantics and accountable budgets.
Staged delivery
This issue delivers the campaign shell and direct controls before #355 completes the core feedback modes. #405 consumes both implementations using the same deadline, artifact and oracle contracts. Extension configuration/reduction for #400–#403 is implemented and accepted in those issues; no extension is a prerequisite for the shell or pilot. Core and extension results carry an explicit stage/capability label.
Initial controls
Shared extension boundary
Budgets
Definition of Done