Adding job runs support to PyDABs

[hejcman-enverus]

Changes

• Add PyDABs models for the job_runs resource.
• Add Resources.job_runs and Resources.add_job_run(), including resource merging through load_resources.
• Add job_run_mutator support and register job_run as a PyDABs resource type.
• Add unit and acceptance coverage for defining a job and a referencing job run in Python.
• Add a changelog fragment for the new PyDABs support.

Example usage

from databricks.bundles.core import Resources, Variable
from databricks.bundles.job_runs import JobRun, JobRunLifecycle, JobRunTrigger
from databricks.bundles.jobs import Job


def load_resources() -> Resources:
    resources = Resources()

    resources.add_job("my_job", Job(name="My Job"))

    resources.add_job_run(
        "my_run",
        JobRun(
            job_id=Variable(path="resources.jobs.my_job.id", type=int),
            lifecycle=JobRunLifecycle(
                triggers=[JobRunTrigger(on_bundle_deploy=True)]
            ),
        ),
    )

    return resources

Why

The Databricks CLI supports job_runs as a bundle resource, but PyDABs had no equivalent model or resource registration. This prevented Python bundle definitions from creating job runs or referencing jobs defined in the same load_resources function.

This change brings job_runs in line with existing PyDABs resources such as jobs, schemas, and volumes. Job dependencies are expressed through normal bundle references, for example resources.jobs.my_job.id.

Tests

• Ran the complete PyDABs unit test suite: 245 tests passed.
• Ran Pyright: zero errors.
• Added and ran the bundle/python/job-runs-support acceptance test.
• Verified the acceptance test with both DMS configurations under the direct deployment engine.
• Ran repository quick checks successfully.

[github-actions]

Approval status: pending

/acceptance/bundle/ - needs approval

7 files changed
Suggested: @denik
Also eligible: @andrewnester, @janniklasrose, @shreyas-goenka, @anton-107, @lennartkats-db, @pietern

General files (require maintainer)

17 files changed
Based on git history:

• @denik -- recent work in .nextchanges/bundles/, python/codegen/codegen_tests/

_{Any maintainer (@andrewnester, @anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db, @janniklasrose, @lennartkats-db, @rugpanov, @rclarey) can approve all areas.
See OWNERS for ownership rules.}

[github-actions]

An authorized user can trigger integration tests manually by following the instructions below:

Trigger:
go/deco-tests-run/cli

Inputs:

• PR number: 6515
• Commit SHA: b7c2e807c3a4d862b531f6d88e537c987c5ed2b9

Checks will be approved automatically on success.

[Sankalp-Mittal]

Hi @hejcman-enverus, thanks for the PR.
We are currently consolidating support for all PyDABs resources in PR #6528 . Since that will cover this functionality and serve as our path forward, I'll be closing this PR. We really appreciate your time and effort here sorry for the overlap!