Hi! Has anyone had experience/success using Prefect's DaskTaskRunner with AWS Fargate (ie. creating temporary clusters with dask_cloudprovider.aws.FargateCluster)? I'm having an issue where I think my flow is resorting to a local hosted cluster (without warning that it failed to create a cluster/task on AWS) and am not sure if it's an error with how I've set up my task_runner configurations or if it's something else
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.