Skip to content

feat: event-driven monitoring for Worker using SQS#9

Open
bdalpe wants to merge 9 commits intomainfrom
bd/feature/9-stateless-worker-enhancements
Open

feat: event-driven monitoring for Worker using SQS#9
bdalpe wants to merge 9 commits intomainfrom
bd/feature/9-stateless-worker-enhancements

Conversation

@bdalpe
Copy link
Copy Markdown

@bdalpe bdalpe commented Aug 26, 2025

Adds capabilities for new event-driven/stateless functionality added to the ECS worker in PrefectHQ/prefect#18508.

  • Adds SQS resource and configures EventBridge to publish ECS events to the queue
  • Adds IAM resources so the worker can read from the SQS queue

Additional adds:

  • New variable for setting extra worker environment variables

Closes #8

@bdalpe bdalpe added the enhancement New feature or request label Aug 26, 2025
@bdalpe bdalpe requested a review from mitchnielsen August 26, 2025 15:11
@bdalpe bdalpe self-assigned this Aug 26, 2025
@bdalpe bdalpe marked this pull request as ready for review September 8, 2025 19:43
@mitchnielsen
Copy link
Copy Markdown
Member

@bdalpe sorry I missed this one. Did you happen to deploy this in a real environment to confirm everything works as expected?

Comment thread events.tf
name_prefix = "prefect-worker-"
}

resource "aws_sqs_queue_policy" "this" {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't seen the pattern before of naming the resource this, is that common?

Comment thread iam.tf
Comment on lines +97 to +100
"ecr:BatchCheckLayerAvailability", # TODO: check if this is actually required
"ecr:BatchGetImage", # TODO: check if this is actually required
"ecr:GetAuthorizationToken", # TODO: check if this is actually required
"ecr:GetDownloadUrlForLayer", # TODO: check if this is actually required
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ideally let's keep or remove these before merge

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Implement ECS state observeration updates

2 participants