Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi All. I am experimenting with Prefect 2.0 deployments. I am using azure storage as my deployment storage. The simplest example project I can make takes ~25mins to build the deployment. This is way too slow for any kind of CI/CD situation. Is this normal? Is it my connection? Am I doing something wrong?

You can cd into the directory with your flow. Or add files you don't want to upload to .prefectignore and you can also use the flag --skip-upload if you don't want Prefect to upload files to Azure

I am in the directory with my flow. I only have one example flow, Prefect and adlfs packages installed. I have a .prefectignore that created automatically. Does it normally take so long?

Only if you have a lot of files to upload. From my experience Azure is indeed much slower than S3 but that's outside of Prefect control. You can upload files yourself and add --skip-upload flag if that way performance is better

In the end, your deployment only needs to point Prefect at your flows. The build CLI only helps to make this process smoother by automatically uploading your files, but again this is something you have full control over