Hi!
I'm using Python to make a Prefect deployment that loads its source code from GCS. I have a minimal reproducible example:
Copy code
from prefect import flow
from prefect_gcp import GcpCredentials, GCSBucket
if __name__ == "__main__":
gcs_bucket_block = GCSBucket.load("my-code-storage-block")
flow.from_source(
source=gcs_bucket_block,
entrypoint="my_file.py:my_flow",
).deploy(
name="my-gcs-deployment",
work_pool_name="my_pool",
job_variables={"env": {"EXTRA_PIP_PACKAGES": "prefect-gcp"} },
)
Now I'm wondering if it's possible to speed up the deployment by pointing to a zip-file containing the source code instead of having the source code as a directory. Any ideas how could I do that?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.