https://prefect.io logo
Title
j

James Constable

09/12/2022, 2:53 AM
Hi All. I am experimenting with Prefect 2.0 deployments. I am using azure storage as my deployment storage. The simplest example project I can make takes ~25mins to build the deployment. This is way too slow for any kind of CI/CD situation. Is this normal? Is it my connection? Am I doing something wrong?
a

Anna Geller

09/12/2022, 5:25 AM
You can cd into the directory with your flow. Or add files you don't want to upload to .prefectignore and you can also use the flag --skip-upload if you don't want Prefect to upload files to Azure
j

James Constable

09/12/2022, 5:38 AM
I am in the directory with my flow. I only have one example flow, Prefect and adlfs packages installed. I have a .prefectignore that created automatically. Does it normally take so long?
a

Anna Geller

09/12/2022, 8:16 AM
Only if you have a lot of files to upload. From my experience Azure is indeed much slower than S3 but that's outside of Prefect control. You can upload files yourself and add --skip-upload flag if that way performance is better
In the end, your deployment only needs to point Prefect at your flows. The build CLI only helps to make this process smoother by automatically uploading your files, but again this is something you have full control over
j

James Constable

09/12/2022, 8:50 AM
Ok. I'll keep experimenting.
👍 1