https://prefect.io logo
Title
j

Jason

07/09/2019, 12:37 PM
@Chris White Regarding state and metadata (e.g. log of task runs), you mentioned a while back that Prefect Cloud will have this setup by default. If we wanted to roll our own DB, how custom is this kind of setup and is there any Airflow-like equivalent to setting up your "metadata db" with a script?
c

Chris White

07/09/2019, 3:59 PM
Hi @Jason - it’s a fair question; I’m not sure what you’re asking when you ask “how custom is this kind of setup”, but it’s certainly possible. We don’t provide any method for doing so, as we believe Cloud is the “correct” abstraction for state storage and flow run orchestration
j

Jason

07/09/2019, 5:25 PM
in the non-Cloud version of Prefect then, there is no persistence layer then?
persistence, specific to , seeing all historical runs
and we'd have to write the adapter to do that ourselves?
c

Chris White

07/09/2019, 6:16 PM
yup that is correct; the non-Cloud version of Prefect is only the engine which is designed purely for running flows in a minimal way
j

Jason

07/09/2019, 6:35 PM
any way to get early access to Cloud?
well - i signed up 🙂
otherwise, I’d like to ideally host this on GKE if we can
c

Chris White

07/09/2019, 6:36 PM
That is certainly possible - would you mind shooting me an email at chris@prefect.io? Maybe include a tiny bit about your use case and we can set up a 30 min chat!
j

Jason

07/09/2019, 6:36 PM
cool, will do!
💯 1