Mitch
05/31/2023, 3:50 PMMitch
05/31/2023, 3:51 PMdf_inc = inception(accounts) #inception is a task
UploadSQLTask(task_args={'trigger': all_successful},
df=df_inc,
unlinkFile=False,
upstream_tasks=[inception]
)
Is there any reason this is running the inception task twice when I only want to run once?Zanie
upstream_tasks to be df_incMitch
05/31/2023, 3:57 PMZanie
Zanie
upstream_tasks at all here since you are passing df_inc as dataMitch
05/31/2023, 4:08 PMMitch
05/31/2023, 4:08 PMDeceivious
05/31/2023, 4:46 PMZanie
Task object there is adding a second instance of that task to the graph.Zanie
inception via df_inc as well as inception via upstream_task we’re going to have to copies of that task in the graph.Deceivious
05/31/2023, 5:35 PM