Is there a recommended way of exporting `flow_run`...
# ask-community
b
Is there a recommended way of exporting
flow_run
data (or any other entity) into a data-warehouse? We had a poor man's workflow engine that we are replacing by prefect. But we need to get the
flow_run
data to our data-warehouse, in order to then use the reporting tools. We were thinking of doing some sort of ETL that queries Prefect's GraphQL API, and loads it into our data warehouse. But we were wondering if there is a recommended way of achieving this? GraphQL's subscriptions do no work yet, right?
1
k
Hi @Bruno Roque! Yes the GraphQL API is the way to do this. You can call it from a Python script (or wherever). No there aren’t GraphQL subscriptions. We use Prefect flows internally to hit the GraphQL API and publish metrics on flow data.
b
Yes I understand. I have been working on exactly that today. Thanks!