Hi, We are thinking of migrating from Airflow to Prefect Cloud and would like to use Datadog to monitor the number of SUCCES and FAILURES of tasks, task execution time etc in Prefect Cloud.
Here are the metrics we can get from Airflow’s Datadog integration: https://docs.datadoghq.com/integrations/airflow/?tab=host
Is it possible to get the similar metrics in Prefect Cloud and integrate it with Datadog?
k
Kevin Kho
08/31/2021, 1:49 PM
Hey @Tomoyuki NAKAMURA, we dont have any built integration like that, but I have seen some users forward Prefect logs to Datadog. Unfortunately, I don’t have any code snippets. We would welcome contributions if it fits in the task library
t
Tomoyuki NAKAMURA
08/31/2021, 3:49 PM
Thank you for your answer. Do you have any plans to implement this kind of Datadog integration in Prefect Cloud in the future?
k
Kevin Kho
08/31/2021, 3:50 PM
We’ll talk about it, but I wouldn’t be able to give a timeline
t
Tomoyuki NAKAMURA
08/31/2021, 3:52 PM
I understand. I really hope such an integration will be implemented.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.