and then you get the json, and then figure out how to load it
s
Suresh R
03/25/2022, 1:52 AM
Ok
Suresh R
03/25/2022, 1:53 AM
We are in standard plan, all the flow related info gets expired in 14 days, how we can use our own mechanism to store all flow metadata?
k
Kevin Kho
03/25/2022, 2:56 AM
What do you need from the metadata? Success/Failed for all run sover time? Because normally what people do is they just send all of the logs to something like DataDog
s
Suresh R
03/25/2022, 6:12 AM
Flow run status, task status, result state
k
Kevin Kho
03/25/2022, 1:37 PM
Yeah I think you need to use the GraphQL API and run a batch job to get those
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.