Michael Booth
08/10/2021, 1:23 AM(prefect) mjboothaus@Michaels-Air tutorial % python 01_etl.py
...TRUNCATED - See thread
As a follow-up -- I ran the 2nd part of the tutorial 02_etl_flow.py
and I guess this illustrates the more helpful messages/info provided by the prefect library when tasks fail
(prefect) mjboothaus@Michaels-Air tutorial % python 02_etl_flow.py
...TRUNCATED... See thread
SOLVED - seems API was down - now OKKevin Kho
Michael Booth
08/10/2021, 2:53 AMKevin Kho
Michael Booth
08/10/2021, 3:10 AM(prefect) mjboothaus@Michaels-Air tutorial % python 01_etl.py
...TRUNCATED...
File "/Users/mjboothaus/code/github/prefecthq/prefect/examples/tutorial/aircraftlib/opensky.py", line 63, in _api_request_json
response.raise_for_status()
File "/opt/homebrew/Caskroom/mambaforge/base/envs/prefect/lib/python3.8/site-packages/requests/models.py", line 953, in raise_for_status
raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: <https://opensky-network.org/api/states/all?lamin=37.15294209056667&lamax=40.75094679823332&lomin=-79.76136868215879&lomax=-75.13474242904122>
02_etl_flow.py
(prefect) mjboothaus@Michaels-Air tutorial % python 02_etl_flow.py
...TRUNCATED...
requests.exceptions.HTTPError: 502 Server Error: Bad Gateway for url: <https://opensky-network.org/api/states/all?lamin=37.15294209056667&lamax=40.75094679823332&lomin=-79.76136868215879&lomax=-75.13474242904122>
[2021-08-10 11:24:07+1000] INFO - prefect.TaskRunner | Task 'extract_live_data': Finished task run for task with final state: 'Failed'
[2021-08-10 11:24:07+1000] INFO - prefect.TaskRunner | Task 'transform': Starting task run...
[2021-08-10 11:24:07+1000] INFO - prefect.TaskRunner | Task 'transform': Finished task run for task with final state: 'TriggerFailed'
[2021-08-10 11:24:07+1000] INFO - prefect.TaskRunner | Task 'load_live_data': Starting task run...
[2021-08-10 11:24:07+1000] INFO - prefect.TaskRunner | Task 'load_live_data': Finished task run for task with final state: 'TriggerFailed'
[2021-08-10 11:24:07+1000] INFO - prefect.FlowRunner | Flow run FAILED: some reference tasks failed.
Kevin Kho
Michael Booth
08/10/2021, 3:20 AM