@Marvin I have a flow with a number of tasks that sends a notification on complete/failed states; I would like to add a subflow that runs other things on the side (think analytics that can be accessed later) and taht does not interfere with the complete/failed notifications; what is the best way to structure something like that?

not sure why marvin ghosted you here. can you explain what you mean by

does not interfere with the complete/failed notifications

?

if the sideflow fails or lags for whatever reason, I don’t want it to change/delay the status of the whole flow

i think there's a couple ways you could approach this, but the most direct one to me is to create a separate deployment for the sidecar flow, and just

run_deployment(..., timeout=0)

that from your main flow when needed (timeout=0 means don't wait)

would this submit the sidecar as a whole new flow? would I be able to view it on the dag of the flow that triggers it?

yes

is there a way for the subflow to be part of the existing flow? I am using k8s and would like to limit how many pods im spinnning up

well, that's the behavior if you just call the flow-decorated python function from your parent flow, but you had said > I don’t want it to change/delay the status of the whole flow

yea… is there another way I can link them in prefect UI?

i guess im not sure what you mean by sidecar then. IME "sidecar" is another container in the same pod so you want a subflow that's running in the same process as the parent flow, linked as a subflow in the UI, but doesn't influence the execution of the parent?

yup that’s exactly right

something feels strange about this to me. what if the "background" flow takes longer than the parent? should it keep the pod alive? I would think you might want to serve a couple tasks / flows in a long-lived container / pod and trigger runs of those as needed from your dynamically dispatched parent flows

background flow is not going to take longer

@Nate Is it possible to link 2 or more flow_runs with a parent or sibling type relationship, in the ui but have them be separate infra?