https://prefect.io logo
Title
m

Max Lei

02/25/2022, 8:54 PM
If we want to use
DaskExecutor
with
dask_cloudprovider.aws.FargateCluster
, how do we assign a task-definition to the cluster?
k

Kevin Kho

02/25/2022, 9:02 PM
I don’t think it’s a task definition because it’s a literal cluster? There is no input for that in the base class but I am not sure
👍 1
a

Anna Geller

02/25/2022, 10:39 PM
You can check the FargateCluster docs for details, it seems that you can provide a custom _`task_role_arn` -_ https://cloudprovider.dask.org/en/latest/_modules/dask_cloudprovider/aws/ecs.html#FargateCluster
task_role_arn: str (optional)
        The ARN for an existing IAM role for tasks to assume. This defines
        which AWS resources the dask workers can access directly. Useful if
        you need to read from S3 or a database without passing credentials
        around.