https://prefect.io logo
Title
m

Max Lei

02/23/2022, 8:55 PM
Hi All, if I want to build an image for dask cluster on fargate, would extending
prefecthq/prefect
and pip install my source code in the image be enough?
k

Kevin Kho

02/23/2022, 9:07 PM
Yes for sure. That’s the most stable way to go about it
m

Max Lei

02/23/2022, 9:15 PM
@Kevin Kho Just to make sure, internally in the
prefecthq/prefect
image, it contains the logic to spin up a dask cluster to be connected?
k

Kevin Kho

02/23/2022, 9:17 PM
No that is in the Flow definition when you do:
flow.executor = DaskExecutor(...)
and then you can pass the
FargateCluster
into there and it’s created on the fly
m

Max Lei

02/23/2022, 9:23 PM
Gotcha, I think I understand, thanks again for your help.
👍 1