Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi! When using Prefect Cloud, where is the log of flow runs stored? What about the parameters in past flow runs?

for logs I meant the flow run logs we see in Prefect Cloud UI

Log is stored in the database that comes with Prefect Cloud. Parameters of past flow runs can also be queried using the GraphQL API

Thank you. Does “the database that comes with Prefect Cloud” means Prefect team has access to the logs and past parameter values in some degrees? Can we trust that even Prefect SDEs/DEs cannot retrieve the logs or will you be able to do so?

Moreover, is there a way to route parameters and logs to our own database/storage systems when using Prefect Cloud?

We could retrieve the logs (to some extent) to help look at what happened to customer Flows. If you want to prevent something from being logged, you could create a filter to prevent those from being sent.

You can add your own handler to the logger and there is this <https://github.com/PrefectHQ/prefect/blob/master/src/prefect/config.toml#L67|setting> you can turn off

Parameters pass through the API to kick off a Flow run so those runs are kept