Jimmy Le
11/19/2022, 5:47 PMSuresh Rajendran
11/20/2022, 7:31 AMkomal azram
11/20/2022, 9:44 AMkomal azram
11/20/2022, 10:51 AMDekel R
11/20/2022, 12:38 PMDekel R
11/20/2022, 1:54 PMHoward
11/21/2022, 2:49 AMMohit Singhal
11/21/2022, 6:27 AMMichael Holzapfel
11/21/2022, 7:46 AMSachin Ranveer
11/21/2022, 9:13 AMAn Ninh Vũ
11/21/2022, 10:16 AMFuETL
11/21/2022, 11:05 AMFAIL
, PrefectStateSignal
, PrefectSignal
) inherit from BaseException
instead of Exception
?Patrick Alves
11/21/2022, 11:56 AMprefect config set PREFECT_LOGGING_EXTRA_LOGGERS="rootlogger,loguru,root,root logger"
But it did not worked.
Any tips?Matthew Seligson
11/21/2022, 2:53 PMLennert Van de Velde
11/21/2022, 3:05 PMJames Zhang
11/21/2022, 3:24 PMERROR | prefect.agent - Failed to submit flow run 'xxxx' to infrastructure.
how can I investigate the details?Guillermo Galan
11/21/2022, 4:02 PM16:44:27.874 | INFO | prefect.infrastructure.container-instance-job - AzureContainerInstanceJob 'sftp-to-blob-ingestion': Preparing to run command '/opt/prefect/entrypoint.sh python -m prefect.engine' in container 'a53fd966-c635-4605-a8ab-4a3f487a7463' (prefecthq/prefect:2.6.7-python3.9)...
16:44:27.875 | INFO | prefect.infrastructure.container-instance-job - AzureContainerInstanceJob 'sftp-to-blob-ingestion': Waiting for container creation...
16:45:37.024 | INFO | prefect.infrastructure.container-instance-job - AzureContainerInstanceJob 'sftp-to-blob-ingestion': Running command...
16:45:37.025 | INFO | prefect.agent - Completed submission of flow run '6bb0fc44-197e-4bfd-846e-877f5dbbf0b8'
16:48:43.454 | INFO | prefect.infrastructure.container-instance-job - AzureContainerInstanceJob 'sftp-to-blob-ingestion': Completed command run.
16:48:43.455 | INFO | prefect.infrastructure.container-instance-job - AzureContainerInstanceJob 'sftp-to-blob-ingestion': Deleting container...
In the meantime the Orion UI gets frozen in 'running' state and there are no log lines indicating any error or crash.Tushar Gupta
11/21/2022, 6:21 PMMadison Schott
11/21/2022, 7:17 PMCansu Kavılı
11/21/2022, 8:47 PMDevin McCabe
11/21/2022, 8:54 PMMichael Z
11/21/2022, 9:34 PMAshley Felber
11/21/2022, 10:07 PMMadison Schott
11/21/2022, 10:40 PMFROM prefecthq/prefect:1.4.0-python3.9
and now I get this error when running dbt deps
Ashley Felber
11/21/2022, 11:03 PMSteven Wilber
11/22/2022, 12:02 AMConnectionRefusedError: [Errno 111] Connect call failed ('127.0.0.1', 4200)
I'm assuming the flow running in the docker container cannot see the orion server on port 4200, however, I'm not sure what to do to fix that.
No doubt the next failure will be accessing the Airbyte server, but I'm not there yet.
Any help is much appreciated.Ben Muller
11/22/2022, 12:08 AMTuoyi Zhao
11/22/2022, 12:31 AMFernando Silveira
11/22/2022, 3:39 AMDockerContainer
storage block to my deployment indicating that it should just pull my docker image from AWS ECR and run the flow.
However, as far as I understand, the DockerContainer
block is also an infrastructure block and is meant to run the image against docker directly on a machine - i.e., NOT in a KubernetesJob
.
This means that so far, I've been relegated to using the S3
storage block which pushes my flow code to S3, only to pull it back to my docker image at flow run time (when the image already contains all the code it needs to run).
This feels wrong so I'm sure I must be missing something here. How do I configure KubernetesJob
to just pull a docker image and not rely on any additional storage block like S3?
PS: so far, I'm really enjoying how quickly I'm getting up to speed on prefect v2. Despite of kinks like this, I'm really enjoying the development experience.Mahesh
11/22/2022, 3:56 AM