Deprecation of prefect.filesystems.S3 I try to und...
# ask-community
t
Deprecation of prefect.filesystems.S3 I try to understand what exactly will happen after September 2024. Given it is only removed from the Python package with the first Prefect release in October: • Will we still be able to use an older version of the Python package for managing the S3 blocks? • Will we still be able to retrieve/manage S3 blocks from Prefect Cloud? We currently use this class for creating, using, and removing our S3 blocks for the flow source code and the caching feature. Migrating the S3 blocks and re-deploying all existing flows would result in efforts on our side.
n
hi @Tobias Rohnstock i’m happy to more comprehensively answer your question, but have you checked out S3bucket from prefect_aws? The common theme here is that we’ve moved integration block code into libraries like Prefect AWS, S3Bucket is a drop in replacement for the S3 block
t
Hey @Nate, I have checked out the S3Bucket from prefect_aws and already switched from S3 to S3Bucket on a feature branch of our CI pipeline tooling -> it works as expected. 🎉 However, these changes will only take effect on Prefect deployments created after the switch from S3 to S3Bucket: Only for them the S3Bucket will be used instead of the S3 block. Production deployments created before the switch will remain the same using the S3 block until a new deployment is triggered by development work. Question: Will these already deployed Prefect deployments that use the S3 block work after September?
n
if you • have the S3 blocks saved on your server/workspace • have a version of the prefect SDK with S3 included (e.g. current latest 2.x) then things shouldn’t change for you, but you’d have to migrate to the S3Bucket to use those deployments on prefect 3 for example, as S3 has been removed from prefect in that version
t
Thank you Nate, this information does help us! We are using Prefect Cloud, no self-hosted Prefect server. Do I understand correctly that • version 2 of Prefect will keep the prefect.filesystem.S3? • there is no deadline for the Prefect 2 to Prefect 3 upgrade for flow deployments yet? To get the capacities for our platform team at the right time, I want to understand when we have to switch to Prefect 3.
n
both bullets are correct as far as I understand!