Fina Silva-Santisteban
04/06/2022, 4:14 PMs3_list_task = S3List()
flow.set_dependencies(
task=s3_list_task,
keyword_tasks=dict(
bucket='my-bucket-name'
)
)
And this is the error message:
TypeError: run() missing 1 required positional argument: 'prefix'
Does this mean I can’t use buckets without prefixes together with the S3 prefect tasks?Kevin Kho
Fina Silva-Santisteban
04/06/2022, 4:19 PMbotocore.errorfactory.NoSuchBucket: An error occurred (NoSuchBucket) when calling the ListObjectsV2 operation: The specified bucket does not exist
Ok I’ll use the boto3 api directly then! So far not having the best experience with prefect tasks: snowflake tasks and s3 tasks are a womp womp for me 😓Kevin Kho
FuETL
04/06/2022, 6:52 PMKevin Kho