Andreas Nigg
07/22/2022, 9:36 AM/usr/local/lib/python3.9/site-packages/prefect/context.py:461: UserWarning: Failed to create the Prefect home directory at /.prefect
with SettingsContext(profile=profile, settings=new_settings) as ctx:
While Agent still starts up and picks up flow-runs, I get the following exception during flow-run
File "/usr/local/lib/python3.9/pathlib.py", line 1323, in mkdir
self._accessor.mkdir(self, mode)
FileNotFoundError: [Errno 2] No such file or directory: '/.prefect/storage'
I guess this has something to do with removing storage/default storage in the latest release? I configured my deployment with a RemoteFileSystem - Packager - not sure why prefect still needs to write something locally?
Find my flow + deployment in the Thread.from prefect import flow, task
from prefect.deployments import Deployment
from prefect.filesystems import RemoteFileSystem
from prefect.logging import get_run_logger
from prefect.packaging import FilePackager
@task
def greet_world():
logger = get_run_logger()
<http://logger.info|logger.info>("Hello world!")
@flow
def give_greeting() -> str:
greet_world()
minio_packager = FilePackager(filesystem=RemoteFileSystem(
basepath="<gcs://rm-datateam-prefect-global-storage>",
settings={
"type":
"service_account",
"project_id":
....
}))
Deployment(flow=give_greeting,
name="minio_file_package_with_remote_s3fs",
tags=["os4"],
packager=minio_packager)
if __name__ == "__main__":
give_greeting()
Anna Geller
07/22/2022, 9:51 AMFileNotFoundError: [Errno 2] No such file or directory: '/.prefect/storage'
with Orion set up on Kubernetes"Marvin
07/22/2022, 9:51 AMAndreas Nigg
07/22/2022, 9:54 AMFROM prefecthq/prefect:2.0b11-python3.9
COPY requirements.txt .
RUN python3 -m pip install --upgrade pip && python3 -m pip install -r requirements.txt
RUN mkdir /.prefect && chgrp -R 0 /.prefect && chmod -R g=u /.prefect
Anna Geller
07/22/2022, 10:28 AMAndreas Nigg
07/23/2022, 7:25 AM