Thread
#prefect-community
    Shaoyi Zhang

    Shaoyi Zhang

    4 months ago
    Hi! When using Prefect Cloud, where is the log of flow runs stored? What about the parameters in past flow runs?
    for logs I meant the flow run logs we see in Prefect Cloud UI
    Kevin Kho

    Kevin Kho

    4 months ago
    Log is stored in the database that comes with Prefect Cloud. Parameters of past flow runs can also be queried using the GraphQL API
    Shaoyi Zhang

    Shaoyi Zhang

    4 months ago
    Thank you. Does “the database that comes with Prefect Cloud” means Prefect team has access to the logs and past parameter values in some degrees? Can we trust that even Prefect SDEs/DEs cannot retrieve the logs or will you be able to do so?
    Moreover, is there a way to route parameters and logs to our own database/storage systems when using Prefect Cloud?
    Kevin Kho

    Kevin Kho

    4 months ago
    We could retrieve the logs (to some extent) to help look at what happened to customer Flows. If you want to prevent something from being logged, you could create a filter to prevent those from being sent.
    Shaoyi Zhang

    Shaoyi Zhang

    4 months ago
    Thank you!
    Kevin Kho

    Kevin Kho

    4 months ago
    You can add your own handler to the logger and there is this setting you can turn off
    Parameters pass through the API to kick off a Flow run so those runs are kept