Hi All. I am experimenting with Prefect 2.0 deployments. I am using azure storage as my deployment storage. The simplest example project I can make takes ~25mins to build the deployment. This is way too slow for any kind of CI/CD situation. Is this normal? Is it my connection? Am I doing something wrong?
09/12/2022, 5:25 AM
You can cd into the directory with your flow. Or add files you don't want to upload to .prefectignore and you can also use the flag --skip-upload if you don't want Prefect to upload files to Azure
09/12/2022, 5:38 AM
I am in the directory with my flow. I only have one example flow, Prefect and adlfs packages installed. I have a .prefectignore that created automatically. Does it normally take so long?
09/12/2022, 8:16 AM
Only if you have a lot of files to upload. From my experience Azure is indeed much slower than S3 but that's outside of Prefect control. You can upload files yourself and add --skip-upload flag if that way performance is better
In the end, your deployment only needs to point Prefect at your flows. The build CLI only helps to make this process smoother by automatically uploading your files, but again this is something you have full control over