Thread
#prefect-community
    n

    Nadav

    1 year ago
    Hi, I am trying to write a flow that uses boto3 for interacting with AWS resources, i am installing prefect with aws extra in the docker image, but the flow fails in tasks that try to create aws clients with: “botocore.exceptions.DataNotFoundError: Unable to load data for: endpoints” any suggestions ?
    Kevin Kho

    Kevin Kho

    1 year ago
    Hey @Nadav, how do you install it with the aws extra?
    pip install
    or
    conda
    ? And then are you using a DaskExecutor?
    n

    Nadav

    1 year ago
    @Kevin Kho i install with pip and i do not use dask i use the default, i guess that is local right?
    Kevin Kho

    Kevin Kho

    1 year ago
    Yeah that would be local. I haven’t seen this before. What boto3 version do you get?
    Maybe you can also try explicitly installing boto3 (I don’t think it’s the issue. I am more assuming that an upgrade is needed)
    n

    Nadav

    1 year ago
    @Kevin Kho the boto3 version is .18.19, i tried installing boto3 using the requirements file but i get the same error
    when i run the docker container with -it and i run python importing boto3 and creating a client is succeeded
    Kevin Kho

    Kevin Kho

    1 year ago
    Are you hosting that container on AWS then using it in your flow?
    n

    Nadav

    1 year ago
    Yes the flow storage is docker hosted on ecr
    Kevin Kho

    Kevin Kho

    1 year ago
    Oh sorry I didn’t get back to you. But I would just make sure you pull the latest image from ECR? Like maybe tag it? Because if it worked in the container locally, it should work on ECR as well.