Hi all – I've started using Prefect for some data ...
# prefect-community
m
Hi all – I've started using Prefect for some data flows and liking it so far! I have a few questions however as I want to see if there's a better way to do things: In order for a subflow run to be also sent to the queue, I couldn't find a better way other than deploying that subflow and then triggering it via the API with
deployments.run_deployment()
. However, this makes it not possible to manually retry a failed subflow, is there a better way to do this? My use case is mostly the parent flow fetching inputs and then each subflow run would handle one of the inputs (I'm looping over the task that triggers the subflow deployment runs) Thanks!
1
z
We’ve got some work on the roadmap to make this experience more magical 🙂 https://github.com/PrefectHQ/prefect/issues/6689#issuecomment-1244522470 Why isn’t it possible to retry the failed subflow?
You should be able to do something roughly like: run the subflows in tasks using
run_deployment
, wait for the final state, fail if the subflow fails, and set retries on the task
m
Thanks! Looking forward to the upcoming features