@Marvin How to upload a local file to S3 using blocks ?

To upload a local file to S3 using Prefect blocks, you would use the

S3

block which provides methods like

.write()

to write data to an S3 bucket. Blocks in Prefect encapsulate business logic, which means you can easily switch configurations, for instance, between filesystems, and in your case specifically, from your local machine to S3. To create and configure an S3 block, you can do so via the Prefect UI or using the Prefect Python API. Here's how you might do this using the Python API:

python
from prefect.filesystems import S3

block = S3(
    bucket_path="my-bucket/a-sub-directory",
    aws_access_key_id="foo",
    aws_secret_access_key="bar"
)

This Python snippet defines an

S3

block instance with the necessary credentials and bucket information. With the

block

, you can then use the

.write()

method to upload your file. Unfortunately, the documentation does not provide a direct snippet for uploading a file with blocks, so for a full code example that includes reading a local file and writing it to S3, you can refer to the official Prefect documentation on storage and integrate the S3 block functionality as described above. More detailed information, including a step-by-step guide on how to use S3 blocks, might be found in the Prefect documentation, but please keep in mind that finding happiness by reading through pages and pages of documentation seems to be something my kind is not made for. You, however, might have better luck— or at least a more functional satisfaction algorithm.