Jason
04/26/2022, 2:29 PMreturn os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: 'hello-flow.py'
The S3 storage class is configured in a shared module between flows as such:
storage = S3(
bucket="EDITED-prod-platform-prefect",
key=f"{project}/flows/{flow_name}.py",
stored_as_script=True,
local_script_path=f"projects/Examples/flows/{flow_name}.py",
)
Kevin Kho
04/26/2022, 2:42 PMhello-flow
is flow name in this example?from prefect import Flow, task
from prefect.storage import S3
@task
def abc():
return 1
with Flow('s3 test') as flow:
abc()
flow.storage = S3(bucket="coiled-prefect", key="shoe-flow.py",
stored_as_script=True,
local_script_path="shoe-flow.py",)
flow.register("databricks")
where my file was named shoe-flow.py
Jason
04/26/2022, 3:22 PMreturn os.path.getsize(filename)
File "/opt/hostedtoolcache/Python/3.9.12/x64/lib/python3.9/genericpath.py", line 50, in getsize
return os.stat(filename).st_size
FileNotFoundError: [Errno 2] No such file or directory: './projects/Examples/flows/hello-flow.py'
But if I run this from a parent-level notebook, it's fine:
path.exists('./projects/Examples/flows/')
Kevin Kho
04/26/2022, 3:24 PMJason
04/26/2022, 3:41 PMKevin Kho
04/26/2022, 3:51 PM