Skip to content

Feature support pipeline name in base_job_name at ModelTrainer #5638

@MarvinBeGood

Description

@MarvinBeGood

Describe the feature you'd like
i want to store the all files for jobs in a pattern like pipeline_name/job_name at this moment this is not possible for ModelTrainer class because train() function will call _create_training_job_args function which creates a s3 path like this:
s3://mybucket/my_pipeline_name/my_job_name/my-pipeline-name/my-job-name-20260318100943/input/sm_drivers/
or if the length of the base_job_name is longer then 63 the path could look like this:
s3://mybucket/my_pipeline_name/my_job_name/my-pipeline-name-extra-long-name/my-job-/input/sm_drivers/

How would this feature be used? Please describe.
This feature should be designed to help to store ModelTrainer files more consistently.
One suggestion for an S3 path would be {self.base_job_name}/input/20260318103152/sm_drivers/

Additional context
The Following Screenshot shows which code needs to be modified.

Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions