https://prefect.io
Join Slack
Hi all, I've got a question regrading usage of the <BatchSubmit> task. Im using it in a flow to laun...
# ask-community
c
Hi all, I've got a question regrading usage of the BatchSubmit task. Im using it in a flow to launch a series of AWS Batch jobs and it has been working as expected as I test and develop locally. However when I try to register the flow, it is still actually launching the jobs rather than registering the flow. My setup is in the thread
Copy code
job = BatchSubmit(
        job_name="name",
        job_definition="job_def:1",
        job_queue="queue",
    ).run(
        batch_kwargs={
            "containerOverrides": {
                'command': ["arg1", "arg2"]
            },
            "arrayProperties": {
                'size': 100
            }
        }
    )

    waiter = waiter.run(
        waiter_kwargs={"jobs": [job]}
    )
It seems like the problem could be that I'm invoking the run method. If that's the case, how should I be providing the specific parameters for the run?
nevermind! got the reorg
k
You good now?
c
yup all good, thanks!
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by