Hello, has anyone run into the below errors while using DbtShellTask?

CA Lee

09/01/2021, 4:27 AM

Hello, has anyone run into the below errors while using DbtShellTask?

CA Lee

09/01/2021, 4:27 AM

Copy code

[33mHTTPSConnectionPool(host='<http://bigquery.googleapis.com|bigquery.googleapis.com>', port=443): Max retries exceeded with url: /bigquery/v2/projects/xxx/datasets/gsheets/tables/stocks_data?prettyPrint=false (Caused by SSLError(SSLError("bad handshake: SysCallError(-1, 'Unexpected EOF')")))[0m

CA Lee

09/01/2021, 4:27 AM

Copy code

[33m('Connection aborted.', OSError("(32, 'EPIPE')"))[0m

CA Lee

09/01/2021, 4:28 AM

These errors are from running a DbtShellTask in a Prefect flow on a Ubuntu 20.04 server

CA Lee

09/01/2021, 4:28 AM

Running

dbt run

on the same server and dbt runs without such errors - doesn't seem to be any firewall / network issues

Kevin Kho

09/01/2021, 1:55 PM

Hey @CA Lee, hard to say but a couple of suggestions • Are you maybe using preemptible compute resources anywhere? • Are you running this job on a different machine? • You can also try downgrading the requests library • You likely have to load your certificate to Python for the request library like this. Linux, Mac

✅ 1

CA Lee

09/07/2021, 6:23 AM

Thanks @Kevin Kho, this was very helpful - downgrading my requests library solved the issue

👍 1

Kevin Kho

09/07/2021, 1:43 PM

No problem!

8 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.