Just published a blog about connecting Prefect to a Dask clu

Question

Just published a blog about connecting Prefect to a Dask cluster using Coiled for processing larger than memory Tasks and or Flows <https towardsdatascience com scaling your prefect workflow to the cloud 2dec4e0b213b>

itay livni · Answer

< Richard Pelgrim> Nice I like the resource manager example

Andrew Black · Answer

Excellent Richard I really like how you describe what Prefect does how our technologies work together and the TLDR at the top

Richard Pelgrim · Answer

Thanks < itay livni> lmk if you end up implementing it with Coiled anywhere Would love to have a look

Richard Pelgrim · Answer

Thanks < Andrew Black> happy to read you enjoyed the post

Todd de Quincey · Answer

Great example gist Exceptionally clear concise and covers all the bases Awesome work < Richard Pelgrim>

Richard Pelgrim · Answer

Thanks < Todd de Quincey> pray would love to hear about anything good or bad you re running into with Dask clusters

Todd de Quincey · Answer

Will do Just looking at coiled What s included in the free tier 1000 CPU hours per month if I am reading it correctly

Richard Pelgrim · Answer

Slack just sent me a notification for this message sorry to have missed this earlier How was your Coiled onboarding

Todd de Quincey · Answer

Didn t use it lol

Richard Pelgrim · Answer

haha ok fair enough slightly smiling face

Richard Pelgrim · Answer

because it was tricky onboarding or because you didn t end up needing it