Hi all – I've started using Prefect for some data ...
# prefect-community
Hi all – I've started using Prefect for some data flows and liking it so far! I have a few questions however as I want to see if there's a better way to do things: In order for a subflow run to be also sent to the queue, I couldn't find a better way other than deploying that subflow and then triggering it via the API with
. However, this makes it not possible to manually retry a failed subflow, is there a better way to do this? My use case is mostly the parent flow fetching inputs and then each subflow run would handle one of the inputs (I'm looping over the task that triggers the subflow deployment runs) Thanks!
We’ve got some work on the roadmap to make this experience more magical 🙂 https://github.com/PrefectHQ/prefect/issues/6689#issuecomment-1244522470 Why isn’t it possible to retry the failed subflow?
You should be able to do something roughly like: run the subflows in tasks using
, wait for the final state, fail if the subflow fails, and set retries on the task
Thanks! Looking forward to the upcoming features