Matthias
02/21/2022, 10:42 AMJoshua Greenhalgh
02/21/2022, 10:45 AMAnna Geller
02/21/2022, 11:05 AMKubernetesFlowRunner
- you can already deploy Orion to your Kubernetes cluster and begin your PoC! Here is a tutorial that shows how you can do that. If you have any questions along the way, we are happy to help.
Also, if you want to deploy your flows to Kubernetes using Prefect 1.0, this is also very straightforward and I can point you to the right resources such as this doc (there's more!) and help.Matthias
02/21/2022, 12:10 PMJoshua Greenhalgh
02/21/2022, 12:20 PMAnna Geller
02/21/2022, 12:40 PMJoshua Greenhalgh
02/21/2022, 12:43 PMEvan Sutherland
02/21/2022, 12:51 PMAnna Geller
02/21/2022, 12:51 PMJoshua Greenhalgh
02/21/2022, 1:18 PMAnna Geller
02/21/2022, 1:25 PMDeploymentSpecs
, and from executors to task runners.
And even if you have some complex workflow logic, we are working on providing plenty of examples for migrating various use cases to Orion. Some of them are already available here on Discourse.justabill
02/21/2022, 2:22 PMMatthias
02/21/2022, 2:36 PMEvan Curtin
02/21/2022, 6:16 PMJeremiah
02/21/2022, 8:03 PMKevin Kho
02/21/2022, 8:38 PMKhuyen Tran
02/21/2022, 8:48 PMMatthias
02/22/2022, 11:54 AMKhuyen Tran
02/22/2022, 3:11 PMMatthias
02/22/2022, 6:41 PMAnna Geller
02/22/2022, 6:44 PMKhuyen Tran
02/22/2022, 6:48 PMconfig.<some-parameter>
inside a flow to access a certain parameterMatthias
02/22/2022, 7:45 PMprefect run
cmd? I also noticed there is a main.py
, does that even work with the two hydra decorators (both in main and e.g. process_data)?Khuyen Tran
02/22/2022, 8:09 PMprefect run -p src/process_data.py
, but you can use python src/process_data.py
. I'm still trying to figure how how to use prefect run
with hydraMatthias
02/25/2022, 10:53 PMprefect run
. Unfortunately, you do loose some of Hydra’s features such as the hydra CLI. But I figured you don’t miss that since you have the full power of Prefect at your disposal. On top of that, I was able to create a POC to use hydra to configure task outputs. The sample flow, which runs locally, can be found here:
https://github.com/MatthiasRoels/prefect-examples/blob/main/hydra-integration/flow.pyKhuyen Tran
02/25/2022, 11:09 PMinitialize
function of Hydra. Thank you for the examples. I’m trying this out. Will let you know how it goes