Hi everyone — on one of the first tasks in a flow I create an aws session object that is then passed as argument to many subsequent tasks. Is there any way to set this aws session globally for all tasks, so that I don’t have to explicitly pass it? I tried adding it to prefect.context but that doesn’t work..
k
Kevin Kho
05/27/2021, 12:30 AM
Hey @Bruno Murino, I don’t think there is a way to do this. Are you using DaskExecutor or LocalDaskExecutor?
b
Bruno Murino
05/27/2021, 9:26 AM
I’m using an ECS agent, so the tasks run as ECS tasks
k
Kevin Kho
05/27/2021, 2:50 PM
Yeah the general answer is no unfortunately because the connection has to be with the Task when it is mapped out to multiple workers.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.