Thread
#prefect-community
    j

    Jason

    3 years ago
    @Chris White Regarding state and metadata (e.g. log of task runs), you mentioned a while back that Prefect Cloud will have this setup by default. If we wanted to roll our own DB, how custom is this kind of setup and is there any Airflow-like equivalent to setting up your "metadata db" with a script?
    Chris White

    Chris White

    3 years ago
    Hi @Jason - it’s a fair question; I’m not sure what you’re asking when you ask “how custom is this kind of setup”, but it’s certainly possible. We don’t provide any method for doing so, as we believe Cloud is the “correct” abstraction for state storage and flow run orchestration
    j

    Jason

    3 years ago
    in the non-Cloud version of Prefect then, there is no persistence layer then?
    persistence, specific to , seeing all historical runs
    and we'd have to write the adapter to do that ourselves?
    Chris White

    Chris White

    3 years ago
    yup that is correct; the non-Cloud version of Prefect is only the engine which is designed purely for running flows in a minimal way
    j

    Jason

    3 years ago
    any way to get early access to Cloud?
    well - i signed up 🙂
    otherwise, I’d like to ideally host this on GKE if we can
    Chris White

    Chris White

    3 years ago
    That is certainly possible - would you mind shooting me an email at chris@prefect.io? Maybe include a tiny bit about your use case and we can set up a 30 min chat!
    j

    Jason

    3 years ago
    cool, will do!