https://prefect.io logo
Title
b

Benjamin.bgx

07/22/2022, 12:24 PM
Hi ! I was testing Prefect Cloud 2.0 and tonight, all my block storage for cloud (Azure and AWS S3) disappear from the interface. I cannot create anymore now. Anyone with the same problem ?
1
a

Anna Geller

07/22/2022, 12:35 PM
as part of the latest release, storage blocks, including default storage and storage CLI were removed in favor of explicitly defined filesystems - you would need to use a RemoteFileSystem
b

Benjamin.bgx

07/22/2022, 12:36 PM
Allright !
🙌 1
Did we know when the doc will be up to date ? Kinda difficult with azure actually and I'm not sure about the param I need to use for a blob storage in the remote file system interface.
a

Anna Geller

07/22/2022, 1:27 PM
since it's built on top of fsspec, it will follows the same configuration as here https://github.com/fsspec/adlfs
but you're right, we need more docs here
b

Benjamin.bgx

07/22/2022, 1:29 PM
ahah yes, but that will do the job ! Thanks, you rock !
🙌 1
a

Anna Geller

07/22/2022, 1:31 PM
try:
from prefect.deployments import Deployment
from prefect.packaging import FilePackager
from prefect.filesystems import RemoteFileSystem

Deployment(
    flow=hello,
    name="file_packager_with_remote_adlfs",
    packager=FilePackager(
        filesystem=RemoteFileSystem(basepath="<az://orion>")
    ),
)
a

Andreas Nigg

07/22/2022, 2:16 PM
@Anna Geller Related question: What is actually the default packager used? With the update to b11 I recreated all deployments, but I did not add a packager to the Deployment. If I create the deployment, where are these deployments/packages actually stored, if I do not specify anything?
a

Anna Geller

07/22/2022, 2:17 PM
OrionPackager
they are then stored in the DB
in Orion backend DB - sqlite or postgres
a

Andreas Nigg

07/22/2022, 2:18 PM
Are there any drawbacks to using this approach? Especially when using prefect 2.0 cloud? It sounds quite intriguing - simply drop all the deployments at your DB - hands off 😄 (Your response times in this community are btw. awesome - nothing seen like that in any other community!!)
🙌 2
a

Anna Geller

07/22/2022, 2:19 PM
nope
🙏 1
the only drawback e.g. if you leverage Cloud 2.0 is that with OrionPackager your flow code is then stored in our Cloud backend, so this may be something to consider if you have some privacy concerns