Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Screen Shot 2022-04-06 at 9.11.07 AM.png

Hi everyone! I’m trying to use an S3List task <https://docs.prefect.io/api/latest/tasks/aws.html#s3list> but it seems like the bucket prefix is not an optional value even though it should be? :thinking_face: Boto3 docs lists it as optional (<https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/s3.html#S3.Client.list_objects>), but the task implementation doesn’t (see screenshot).

This is what I try to do:
```s3_list_task = S3List()

        flow.set_dependencies(
            task=s3_list_task,
            keyword_tasks=dict(
                bucket='my-bucket-name'
            )
        )```
And this is the error message:
```TypeError: run() missing 1 required positional argument: 'prefix'```
Does this mean I can’t use buckets without prefixes together with the S3 prefect tasks?

Ah I think we’d take a PR to fix that. Maybe you can try empty string as a workaround?

<@U01QEJ9PP53> I tried that and it returns this error (which makes sense):
```botocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectsV2 operation: The specified bucket does not exist```
Ok I’ll use the boto3 api directly then! So far not having the best experience with prefect tasks: snowflake tasks and s3 tasks are a womp womp for me :sweat:

<@U01QEJ9PP53> UPDATE: the workaround with the empty string actually worked!! Sorry about that, I had a typo in the bucket name when I initially tried that :sweat_smile:

Ah ok I was wondering why that would cause a wrong bucket, but thought i just didnt understand something. Glad you got it working

<@U01QEJ9PP53> Can i open PR to assign default prefix to empty string?

Yeah man go for it. I think that makes sense! Have you done it before? Give it a try and ask me if you need anything?