Anybody have anyluck with a storage block that you can use for multiple flows that doesn't just write over your files when you build the deployment?

Hey Seth - we overcome this by having one storage block per flow and having each storage block point to a different folder inside a remote bucket.

Do you use any form of CI/CD?

Yes

I guess you just have a script to create the block for the flow then?

We create the block using Python i.e.

def create_storage_block(bucket: str, flow: str) -> str:
    path = flow.replace("_", "-")
    block_name = f"{path}-code"

    AWS_ACCESS_KEY_ID = "XYZ"
    AWS_SECRET_ACCESS_KEY = "XYZ"

    block = S3(
        bucket_path=f"{bucket}/flows/{path}",
        aws_access_key_id=AWS_ACCESS_KEY_ID,
        aws_secret_access_key=AWS_SECRET_ACCESS_KEY,
    )
    block.save(block_name, overwrite=True)
    print(f"Storage block {block_name} created.")

Thank you sir, I'll use this while we wait for the github SB.

this got merged https://github.com/PrefectHQ/prefect/pull/6550 and will allow you to upload your project only once and skip upload for all subsequent deployments that share the same project dir

That doesn't seem to cover the same issue though, as that would just mean you don't overwrite the code you already put there.

release ETA is next week

That one looks like it would solve the issue.

yup, tons of flexibility here, we'll probably need some Discourse topic on how to not get overwhelmed over all those possibilities

I think once this is solved, that's my last hurdle for conversion. I've got all the docker and custom package stuff, including the CI/CD figured out.

nice! if you would like to share it in a blog post or Discourse topic or even share a GitHub repo, that would be awesome!