with Flow("hello-world"):
task1 = hello_task()
task2 = test(task1)
with Flow("Multiple Flow"):
db_table=create_table()
raw=get_complete_date()
parsed=parse_complaint_data(raw)
populated_table= store_complaints(parsed)
populated_table.set_upstream(db_table)
from prefect import Flow
from prefect.tasks.prefect import StartFlowRun
data_engineering_flow = StartFlowRun(flow_name="hello-world",
project_name='ETL - Prefect',
wait=True)
data_science_flow = StartFlowRun(flow_name="Multiple Flow",
project_name='ETL - Prefect',
wait=True)
with Flow("main-flow") as flow:
result = data_science_flow(upstream_tasks=[data_engineering_flow])
flow.run()
flow.register(project_name="ETL - Prefect")
I am facing some issues in flow after executing the code we can able to
see flow in UI but We couldn't see task results and also its taking lots of time for processing.. can anyone help me out this
k
Kevin Kho
07/11/2022, 2:23 PM
Hey @Black Spy, can you move the code to the thread when you get a chance? The subflow will be a different flow in the UI for Prefect 1.0. You have to navigate to the
hello-world
flow run
b
Black Spy
07/11/2022, 4:41 PM
Code wise its working properly but in UI alone we have issues @Kevin Kho
k
Kevin Kho
07/11/2022, 5:32 PM
Ah I see, do you have a lot of tasks there? Could you take a screen shot of your UI?
b
Black Spy
07/12/2022, 3:39 AM
sure @Kevin Kho
k
Kevin Kho
07/12/2022, 3:42 AM
The subflow will be in another flow run in the dashboard you have to navigate to.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.