Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

set the channel description: For asking questions and general chat during Prefect hosted livestreams.

:wave: Hi all - we're starting at 1p ET. Feel free to ask any questions in here, and join us on the livestream at <https://youtube.com/live/1tv6w22o7mI?feature=share|this link>.

would it be possible to share the slides/diagrams taylor is presenting?

Hi <@U05A70LARF0> - yes, Taylor is planning to share a pdf (or similar) version of what she is looking at

ECS Worker Guide.pdf

Here's the guide <@U03AT2QB6LF> put together on ECS Worker concepts!

Here's more info on <https://docs.prefect.io/2.11.0/guides/push-work-pools|push work pools>

is there an API for implementing new types of push work pools?

Do you mean beyond AWS ECS, Azure's ACI, and Google Cloud Run?

Not right now, let me see if <@U0259328DC7> has any thoughts on this when he has a chance

I’m specifically thinking about HTCondor or Slurm

I think the answer is going to be probably not in the short/medium term, but maybe Bill is thinking about this in the longer term for us.

Hey <@U05H5NCDW3U>, thanks for asking! Ironically, the best way to start is to <https://docs.prefect.io/2.11.0/guides/deployment/developing-a-new-worker-type/|create a new worker type>. Push work pools will always be a subset of all work pool types, since we always want to give users the option to operate Prefect in a pull model. Check out the <https://docs.prefect.io/2.11.0/guides/deployment/developing-a-new-worker-type/|guide for creating a worker> and, if you're interested, open a PR. We'd be happy to provide guidance and review.