Matteo Fiorillo
06/15/2022, 2:33 PMKevin Kho
06/15/2022, 2:34 PMMatteo Fiorillo
06/15/2022, 2:38 PMKevin Kho
06/15/2022, 2:39 PMMatteo Fiorillo
06/15/2022, 2:40 PMKevin Kho
06/15/2022, 2:41 PMMatteo Fiorillo
06/15/2022, 2:42 PMfrom prefect import Flow
from prefect.tasks.airbyte.airbyte import AirbyteConnectionTask
airbyte_conn = AirbyteConnectionTask(
airbyte_server_host="XX.XX.XX.XX",
airbyte_server_port=8000,
airbyte_api_version="v1",
connection_id="<uuid_of_the_connection>"
)
with Flow("material-scraper-data") as flow:
flow.add_task(airbyte_conn)
# Register the flow under the "airbyte" project
flow.register(project_name="laserhub")
Kevin Kho
06/15/2022, 2:44 PMMatteo Fiorillo
06/15/2022, 2:46 PMKevin Kho
06/15/2022, 2:46 PMMatteo Fiorillo
06/15/2022, 2:47 PMKevin Kho
06/15/2022, 2:57 PMMatteo Fiorillo
06/15/2022, 2:58 PMKevin Kho
06/21/2022, 1:35 PMMatteo Fiorillo
06/21/2022, 1:36 PMKevin Kho
06/21/2022, 1:37 PMMatteo Fiorillo
06/21/2022, 1:37 PMKevin Kho
06/21/2022, 1:51 PMMatteo Fiorillo
06/21/2022, 1:52 PMKevin Kho
06/21/2022, 1:56 PMMatteo Fiorillo
06/21/2022, 1:57 PMKevin Kho
06/22/2022, 1:52 PMBoggdan Barrientos
07/05/2022, 9:06 PMKevin Kho
07/05/2022, 9:30 PMMatteo Fiorillo
07/06/2022, 7:46 AMTask 'AirbyteConnectionTask': Exception encountered during task execution!
Traceback (most recent call last):
File "/home/m_fiorillo/miniconda3/lib/python3.9/site-packages/prefect/engine/task_runner.py", line 880, in get_task_run_state
value = prefect.utilities.executors.run_task_with_timeout(
File "/home/m_fiorillo/miniconda3/lib/python3.9/site-packages/prefect/utilities/executors.py", line 468, in run_task_with_timeout
return task.run(*args, **kwargs) # type: ignore
File "/home/m_fiorillo/miniconda3/lib/python3.9/site-packages/prefect/utilities/tasks.py", line 456, in method
return run_method(self, *args, **kwargs)
File "/home/m_fiorillo/miniconda3/lib/python3.9/site-packages/prefect/tasks/airbyte/airbyte.py", line 340, in run
connection_status = self._get_connection_status(
File "/home/m_fiorillo/miniconda3/lib/python3.9/site-packages/prefect/tasks/airbyte/airbyte.py", line 176, in _get_connection_status
self.logger.log(level=self.stream_output, msg=response.json())
AttributeError: 'AirbyteConnectionTask' object has no attribute 'stream_output'
Kevin Kho
07/07/2022, 4:34 PM