Skip to content

Extend PartitionedAssetTimetable to allow per asset partition#60966

Merged
Lee-W merged 10 commits intoapache:mainfrom
astronomer:per-asset-partition-mapper
Feb 17, 2026
Merged

Extend PartitionedAssetTimetable to allow per asset partition#60966
Lee-W merged 10 commits intoapache:mainfrom
astronomer:per-asset-partition-mapper

Conversation

@Lee-W
Copy link
Copy Markdown
Member

@Lee-W Lee-W commented Jan 23, 2026 •
edited
Loading

Why

closes: #57694

What

  • add default_partition_mapper and partition_mapper_mapping to PartitionedAssetTimetable.
Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)
  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@Lee-W Lee-W changed the title feat: add partition_mapper to base asset class Per Asset Partition Jan 23, 2026
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch 6 times, most recently from 4f7d47c to 463e306 Compare January 30, 2026 10:13
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch 6 times, most recently from b516821 to ce928f8 Compare February 5, 2026 14:01
@Lee-W Lee-W changed the title Per Asset Partition Extend PartitionedAssetTimetable to allow per asset partition Feb 5, 2026
@Lee-W Lee-W marked this pull request as ready for review February 5, 2026 14:05
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch 2 times, most recently from dee403b to 587fd5b Compare February 9, 2026 09:00
uranusjr
uranusjr reviewed Feb 9, 2026
View reviewed changes
Comment thread airflow-core/src/airflow/serialization/definitions/assets.py
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch 2 times, most recently from 58253a2 to 568528a Compare February 10, 2026 01:44
uranusjr
uranusjr reviewed Feb 10, 2026
View reviewed changes
Comment thread airflow-core/tests/unit/jobs/test_scheduler_job.py Outdated
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch 2 times, most recently from 8ec2ee0 to bd8c91d Compare February 12, 2026 02:35
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch from bd8c91d to 4c80db9 Compare February 13, 2026 10:20
@anishgirianish anishgirianish mentioned this pull request Feb 14, 2026
Closed
1 task
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch from 4c80db9 to 8c9d2ed Compare February 16, 2026 05:30
dstandish
dstandish reviewed Feb 16, 2026
View reviewed changes
Comment thread airflow-core/src/airflow/timetables/simple.py Outdated
guan404ming
guan404ming approved these changes Feb 16, 2026
View reviewed changes
Copy link
Copy Markdown
Member

@guan404ming guan404ming left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

Comment thread airflow-core/src/airflow/timetables/simple.py Outdated
@Lee-W Lee-W force-pushed the per-asset-partition-mapper branch from 8c9d2ed to d201c02 Compare February 17, 2026 08:47
@Lee-W Lee-W merged commit b3ffaaf into apache:main Feb 17, 2026
102 checks passed
@Lee-W Lee-W deleted the per-asset-partition-mapper branch February 17, 2026 10:31
choo121600 pushed a commit to choo121600/airflow that referenced this pull request Feb 22, 2026
@Lee-W @choo121600
Extend PartitionedAssetTimetable to allow per asset partition (apache…
234be28 
…#60966)
Subham-KRLX pushed a commit to Subham-KRLX/airflow that referenced this pull request Mar 4, 2026
@Lee-W @Subham-KRLX
Extend PartitionedAssetTimetable to allow per asset partition (apache…
b4ec478 
…#60966)
dominikhei pushed a commit to dominikhei/airflow that referenced this pull request Mar 11, 2026
@Lee-W @dominikhei
Extend PartitionedAssetTimetable to allow per asset partition (apache…
1b2895f 
…#60966)
Ankurdeewan pushed a commit to Ankurdeewan/airflow that referenced this pull request Mar 15, 2026
@Lee-W @Ankurdeewan
Extend PartitionedAssetTimetable to allow per asset partition (apache…
2964b37 
…#60966)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@uranusjr uranusjr uranusjr left review comments

@dstandish dstandish dstandish approved these changes

@guan404ming guan404ming guan404ming approved these changes

@ashb ashb Awaiting requested review from ashb ashb is a code owner

@kaxil kaxil Awaiting requested review from kaxil kaxil is a code owner

@amoghrajesh amoghrajesh Awaiting requested review from amoghrajesh amoghrajesh is a code owner

@bolkedebruin bolkedebruin Awaiting requested review from bolkedebruin bolkedebruin is a code owner

@jason810496 jason810496 Awaiting requested review from jason810496

Assignees

No one assigned

Labels

area:serialization area:task-sdk

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Interface for per-asset-dep partition mapping?

4 participants

@Lee-W @uranusjr @dstandish @guan404ming