https://prefect.io logo
Title
a

Andreas Nigg

07/20/2022, 10:54 AM
Hey, I'm using the latest prefect 2.0 b9 and when running "prefect storage ls" all my created blocks are shown - not only storage blocks. Is this expected? (It's actually not a blocking problem, just wanted to report, if not already known).
šŸ™Œ 1
āœ… 1
a

Anna Geller

07/20/2022, 12:38 PM
thanks so much for reporting this, we already have an issue about this internally
to be transparent: the prefect storage CLI and the default storage will be removed soon in favor of explicit definition e.g. via filesystems, details will follow next week, just so that you are aware
b

Billy McMonagle

07/20/2022, 5:18 PM
Hey Anna, I noticed this too and was able to update to using filesystems (I think this is a nice improvement!). One thing I noticed is that I need to install (in my case)
s3fs
separately, which isn't bundled as a requirement in any
extras
yet. This is nice though:
Deployment(
    name="k8s-example",
    flow=my_kubernetes_flow,
    flow_runner=k8s_flow_runner,
    # deprecated: flow_storage=S3StorageBlock(bucket=STORAGE_BUCKET),
    packager=FilePackager(
        filesystem=RemoteFileSystem(basepath=f"s3://{STORAGE_BUCKET}/")
    ),
)
l

Lucien Fregosi

07/21/2022, 5:34 PM
Hi @Anna Geller Iā€™m super interested in this new feature (I struggle with the CLI to automate storage creation through a kubernetes job). Is there any documentation incoming with this new
explicit definition
feature ?
a

Anna Geller

07/21/2022, 6:36 PM
we work on improving and hardening infrastructure blocks behind Deployments after GA release once things get more stable we'll update docs and provide more recipes and guidance
a

Andreas Nigg

07/21/2022, 7:09 PM
Hey Anna, quick question, a little bit related to all of this. With b8 you released the Packager concept. Why would anyone use this - what's the use case, compared to what we already had before?
a

Anna Geller

07/21/2022, 10:47 PM
it's primarily a helper abstraction for users who are e.g. not comfortable with Docker and want Prefect to package code, build image and push to registry for them
it's not strictly required - we're currently working on some changes to Deployments, we'll provide more guidance on that soon via docs and recipes
šŸ‘ 1