Tanishq Hooda
04/14/2023, 10:02 AMskip_upload=True
here which we set because our s3 bucket policy requires to have encryption set while uploading to s3, so we copy the flow code using aws s3 cp cmd and we set -sse AES256 parameter there. I'm wondering is this something that can be supported in prefect in future, or if it is already supported what is the parameter I need to add? Thanks!
deployment = Deployment.build_from_flow(
flow=flow,
name=FLOW_NAME,
parameters={},
infra_overrides={
"image": SHARED_CONFIG.value["prefect_image_name"],
"service_account_name": "sa",
"image_pull_policy": "Always",
"namespace": "nspc",
},
infrastructure={"block_type_slug": "kubernetes-job"},
work_queue_name="k8s",
storage=storage,
path=FLOW_NAME,
skip_upload=True,
)
Chris White
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by