@Chris White Regarding state and metadata (e.g. log of task runs), you mentioned a while back that Prefect Cloud will have this setup by default. If we wanted to roll our own DB, how custom is this kind of setup and is there any Airflow-like equivalent to setting up your "metadata db" with a script?
07/09/2019, 3:59 PM
Hi @Jason - it’s a fair question; I’m not sure what you’re asking when you ask “how custom is this kind of setup”, but it’s certainly possible. We don’t provide any method for doing so, as we believe Cloud is the “correct” abstraction for state storage and flow run orchestration
07/09/2019, 5:25 PM
in the non-Cloud version of Prefect then, there is no persistence layer then?
persistence, specific to , seeing all historical runs
and we'd have to write the adapter to do that ourselves?
07/09/2019, 6:16 PM
yup that is correct; the non-Cloud version of Prefect is only the engine which is designed purely for running flows in a minimal way
07/09/2019, 6:35 PM
any way to get early access to Cloud?
well - i signed up 🙂
otherwise, I’d like to ideally host this on GKE if we can
07/09/2019, 6:36 PM
That is certainly possible - would you mind shooting me an email at email@example.com? Maybe include a tiny bit about your use case and we can set up a 30 min chat!