Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi All, if I want to build an image for dask cluster on fargate, would extending *`prefecthq/prefect`* and pip install my source code in the image be enough?

Yes for sure. That’s the most stable way to go about it

<@U01QEJ9PP53> Just to make sure, internally in the `prefecthq/prefect` image, it contains the logic to spin up a dask cluster to be connected?

No that is in the Flow definition when you do:
`flow.executor = DaskExecutor(...)` and then you can pass the `FargateCluster` into there and it’s created on the fly

Gotcha, I think I understand, thanks again for your help.