https://prefect.io logo
Title
b

Baris Cekic

04/28/2022, 12:49 PM
hey here , what is the best practice to generate flows dynamically on runtime and then register to server ? We are using in-house platform for designing ETL logic but after that to orchestrate the tasks in it we want to programatically generate the flows.
a

Anna Geller

04/28/2022, 1:07 PM
For dynamically-generated flows, you could use Prefect 2.0 and Cloud 2.0 already. This post discusses it more
b

Baris Cekic

04/28/2022, 1:10 PM
thanks Anna, let me check it. Btw, I have seen that the helm charts are not ready for 2.0 in a post , is it still open? do you have any plan soon to release helm charts?
a

Anna Geller

04/28/2022, 1:16 PM
Helm chart is no longer necessary due to Orion's simplicity. There are no Apollo servers to manage via docker containers. Instead, it's based on Postgres with REST-based orchestration APIs, so you could define all the infrastructure you need in a single Kubernetes deployment. We already have one recipe showing how to do that here
but if you are a Helm-chart fan, you can follow this Github issue 🙂
b

Baris Cekic

04/28/2022, 1:19 PM
wow that’s great, let me check deployment.
👍 1
@Anna Geller sorry but I could not find the dynamically generated flows in this post. https://discourse.prefect.io/t/should-i-start-with-prefect-2-0-orion-skipping-prefect-1-0/544
could you please point me?
a

Anna Geller

04/28/2022, 1:35 PM
I should have clarified, I meant generally Prefect 2.0 powered by Orion engine is able to automatically determine your flow structure without having to preregister a DAG
b

Baris Cekic

04/28/2022, 1:38 PM
Is there any example or documentation explaining this ?
a

Anna Geller

04/28/2022, 1:43 PM
yes https://orion-docs.prefect.io/faq/#why-orion but ask if you have any specific questions