Hello Prefects,
I’am switching from Prefect 1 to 2 one.
And I’m blocked with the DAG free conception.
One part of my flow is predefined rigid DAG.
How can I achieve “dag behavior” in Prefect 2?
Toy example of my graph:
graph = {
"feature_1" : [],
"feature_2" : [],
"feature_3" : ["feature_1", "feature_2"],
"feature_4" : ["feature_3"],
"feature_5" : ["feature_4"],
}
So how can I “explain” that in the first time we can run in parallel
feature_1
and
feature_2
, but not the others one.
We can run
feature_3
, only when
feature_1
and
feature_2
was successfully executed, and feature_3 take like input parameters the results of
feature_1
and
feature_2
.
P.S. In production it should be run with
DaskTaskRunner
. Could be there any difficulty?