Hey all. Im currently on Prefect 1.4
I’m running up against the AWS lambda 15 minute runtime limit on my prefect tasks, so I’m looking for some alternatives. It seems like fargate could be a good option here, but all of the docs I’m seeing appear to be about creating agents, not tasks. Can someone point me a guide for that, or give any tips?
Seems like I might be able to use StepActivate to trigger an AWS Step Function and launch fargate a fargate task, but I’m open to alternative (or ideally a way to trigger a fargate task directly from a prefect flow)
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.