Matt Alhonte
06/13/2023, 6:47 PM18:44:38.783 | INFO | botocore.credentials - Found credentials in environment variables.
and eventually times out. I'm running the py
file that has the Flow as a script, and have this at the end:
if __name__ == "__main__":
for memory in [15360, 30720, 63398, 126899]:
base_args = make_deployment_args(flow_name1, memory, user="matt")
storage1 = S3Bucket.load(<name>)
deployment1 = Deployment.build_from_flow(
flow=nb_flow, storage=storage1, **base_args
)
memory2 = 14360
base_args2 = make_deployment_args(flow_name2, memory2, user="matt")
storage2 = S3Bucket.load(<name>)
deployment1 = Deployment.build_from_flow(
flow=nb_subflows, storage=storage2, **base_args2
)
It works fine when I run it interactively, but not in CI/CD.