I am new to Prefect but experienced with airflow, I wrote a simple script but found my flow run multiple times automatically, sometimes 3 other times 6. Can't find anything in the community, please help. from prefect import Parameter, Flow, task print("***************") @task def get_bbp_data():     return "bbp_data" @task def get_sem_data():     return "sem_data" @task def align_bbp_sem_data(bbp, sem):     return "align_data" @task def generate_train_data(align):     return "train_data" with Flow("I5 ETL") as flow:     bbp_data = get_bbp_data()     sem_data = get_sem_data()     align_data = align_bbp_sem_data(bbp_data, sem_data)     train_data = generate_train_data(align_data) flow.visualize() flow.run()

Hi @John Song! We’re here to help 😄 - Can you send some of the logs that show your flow running multiple times? - Is this flow running with Prefect Cloud/Server by any chance or just locally?

itWorkspace>python on 3.7.5 (tags/v3.7.5:5c02a39a0b, Oct 15 2019, 001134) [MSC v.1916 64 bit (AMD64)] on win32 "help", "copyright", "credits" or "license" for more information. from i5_data.workflow import pipeline *********** 0-09-10 204523] INFO - prefect.FlowRunner | Beginning Flow run for 'I5 ETL' prefect.FlowRunnerBeginning Flow run for 'I5 ETL' 0-09-10 204523] INFO - prefect.FlowRunner | Starting flow run. prefect.FlowRunnerStarting flow run. 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_bbp_data': Starting task run... prefect.TaskRunnerTask 'get_bbp_data': Starting task run... 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_bbp_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'get_bbp_data': finished task run for task with final state: 'Success' 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_sem_data': Starting task run... prefect.TaskRunnerTask 'get_sem_data': Starting task run... 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_sem_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'get_sem_data': finished task run for task with final state: 'Success' 0-09-10 204523] INFO - prefect.TaskRunner | Task 'align_bbp_sem_data': Starting task run... prefect.TaskRunnerTask 'align_bbp_sem_data': Starting task run... 0-09-10 204523] INFO - prefect.TaskRunner | Task 'align_bbp_sem_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'align_bbp_sem_data': finished task run for task with final state: 'Success' 0-09-10 204523] INFO - prefect.TaskRunner | Task 'generate_train_data': Starting task run... prefect.TaskRunnerTask 'generate_train_data': Starting task run... 0-09-10 204523] INFO - prefect.TaskRunner | Task 'generate_train_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'generate_train_data': finished task run for task with final state: 'Success' 0-09-10 204523] INFO - prefect.FlowRunner | Flow run SUCCESS: all reference tasks succeeded prefect.FlowRunnerFlow run SUCCESS: all reference tasks succeeded *********** 0-09-10 204523] INFO - prefect.FlowRunner | Beginning Flow run for 'I5 ETL' prefect.FlowRunnerBeginning Flow run for 'I5 ETL' 0-09-10 204523] INFO - prefect.FlowRunner | Starting flow run. prefect.FlowRunnerStarting flow run. 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_bbp_data': Starting task run... prefect.TaskRunnerTask 'get_bbp_data': Starting task run... 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_bbp_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'get_bbp_data': finished task run for task with final state: 'Success' 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_sem_data': Starting task run... prefect.TaskRunnerTask 'get_sem_data': Starting task run... 0-09-10 204523] INFO - prefect.TaskRunner | Task 'get_sem_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'get_sem_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.TaskRunner | Task 'align_bbp_sem_data': Starting task run... prefect.TaskRunnerTask 'align_bbp_sem_data': Starting task run... 0-09-10 204524] INFO - prefect.TaskRunner | Task 'align_bbp_sem_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'align_bbp_sem_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.TaskRunner | Task 'generate_train_data': Starting task run... prefect.TaskRunnerTask 'generate_train_data': Starting task run... 0-09-10 204524] INFO - prefect.TaskRunner | Task 'generate_train_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'generate_train_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.FlowRunner | Flow run SUCCESS: all reference tasks succeeded prefect.FlowRunnerFlow run SUCCESS: all reference tasks succeeded *********** 0-09-10 204524] INFO - prefect.FlowRunner | Beginning Flow run for 'I5 ETL' prefect.FlowRunnerBeginning Flow run for 'I5 ETL' 0-09-10 204524] INFO - prefect.FlowRunner | Starting flow run. prefect.FlowRunnerStarting flow run. 0-09-10 204524] INFO - prefect.TaskRunner | Task 'get_bbp_data': Starting task run... prefect.TaskRunnerTask 'get_bbp_data': Starting task run... 0-09-10 204524] INFO - prefect.TaskRunner | Task 'get_bbp_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'get_bbp_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.TaskRunner | Task 'get_sem_data': Starting task run... prefect.TaskRunnerTask 'get_sem_data': Starting task run... 0-09-10 204524] INFO - prefect.TaskRunner | Task 'get_sem_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'get_sem_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.TaskRunner | Task 'align_bbp_sem_data': Starting task run... prefect.TaskRunnerTask 'align_bbp_sem_data': Starting task run... 0-09-10 204524] INFO - prefect.TaskRunner | Task 'align_bbp_sem_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'align_bbp_sem_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.TaskRunner | Task 'generate_train_data': Starting task run... prefect.TaskRunnerTask 'generate_train_data': Starting task run... 0-09-10 204524] INFO - prefect.TaskRunner | Task 'generate_train_data': finished task run for task with final state: 'Success' prefect.TaskRunnerTask 'generate_train_data': finished task run for task with final state: 'Success' 0-09-10 204524] INFO - prefect.FlowRunner | Flow run SUCCESS: all reference tasks succeeded prefect.FlowRunnerFlow run SUCCESS: all reference tasks succeeded

Are multiple visualizations produced as well?

Yes, there are 3 plots as well

Would you mind running

prefect diagnositcs

?

INFOprefect.FlowRunnerFlow run SUCCESS: all reference tasks succeeded { "config_overrides": {}, "env_vars": [], "flow_information": { "environment": { "executor": true, "labels": false, "logger": true, "metadata": false, "on_exit": false, "on_start": false, "type": "LocalEnvironment" }, "result": {}, "schedule": {}, "storage": {}, "task_count": 4 }, "system_information": { "platform": "Windows-10-10.0.17134-SP0", "prefect_version": "0.12.6", "python_version": "3.7.5" } }

Anytime!