Mitch
05/31/2023, 3:50 PMMitch
05/31/2023, 3:51 PMdf_inc = inception(accounts) #inception is a task
UploadSQLTask(task_args={'trigger': all_successful},
df=df_inc,
unlinkFile=False,
upstream_tasks=[inception]
)
Is there any reason this is running the inception task twice when I only want to run once?Zanie
upstream_tasks
to be df_inc
Mitch
05/31/2023, 3:57 PMZanie
Zanie
upstream_tasks
at all here since you are passing df_inc
as dataMitch
05/31/2023, 4:08 PMMitch
05/31/2023, 4:08 PMDeceivious
05/31/2023, 4:46 PMZanie
Task
object there is adding a second instance of that task to the graph.Zanie
inception
via df_inc
as well as inception
via upstream_task
we’re going to have to copies of that task in the graph.Deceivious
05/31/2023, 5:35 PM