Hey, my question is a bit related to @Edmondo Porcu, what are the best practices about flow versionning and especially ETL flows that should interact with different env (and different db depending on the env) ?
06/21/2022, 10:53 AM
We don't have any Prefect-specific best practices recipes for that. The same best practices apply as you would implement it in Python. For Prefect, the recommendations might be: securely store credentials e.g. using Secrets, separate environments by tenants or in 2.0 workspaces
We may add some recommendations recipes in 2.0 at some point, curious what are you looking for in such a guide? how to move from dev to prod?
in Prefect 2.0, you'll be able to have one workspace with your DEV Snowflake credentials and another workspace with Snowflake credentials pointing to your PROD data warehouse, both can be referred to by the same name in your code - definitely something on our radar
06/21/2022, 2:36 PM
@Anna Geller this sounds like this will be a feature but is not yet released. Is that right?
06/21/2022, 2:38 PM
how to move from dev to prod?
yes for example. But you are right this may be more a general good practice on how to manage ETL pipelines between dev and prod environnement
06/21/2022, 3:01 PM
Yes and yes to both - definitely something that will be way easier very soon in Prefect 2.0
06/21/2022, 9:57 PM
When is Prefect 2.0 going to be GA? I see the task library doesn't contain Databricks