Jai P
07/31/2022, 8:28 PMAnna Geller
07/31/2022, 8:31 PMis the intention that you should feel comfortable using prefect for any use case"any" is a big word, but I'd say most dataflow related problems can be tackled with Prefect
Jai P
07/31/2022, 8:38 PMc = a + b
and a
is ready and available but b
is not, then the system is responsible for informing another system and telling b
to go be generated, and then responsible for calculating c
once b
is ready. you can also imagine that b
can change over time, so we want to not only know c
, but we'll want to know:
c_v1 = a_v1 + b_v1
c_v2 = a_v1 + b_v2
c_v3 = a_v2 + b_v2
...
Anna Geller
07/31/2022, 8:42 PMJai P
07/31/2022, 8:47 PMgenerate_data(p_1) --> generate_data(p_n)