Hi guys, I have a rather simple scenario. I have a list of job that I want to them all be a flow and then want to deploy them all. So it’s something like this.
Copy code
import job_wrapper
job_list = ["job_a","job_b",...]
for job in job_list:
@flow(name=job)
def run_job():
job_wrapper(job)
However, because that current deployment requires a unique entry_point function as well flow_name, now what i have is
Is there a less repetitive way of doing this that I might have missed
d
Deceivious
05/08/2023, 9:05 AM
There are multiple approaches for this.
1. You can write a deployemt script and use different default parameter for each deployment.
2. Use subflows.
k
Kaibo Chen
05/08/2023, 10:18 AM
I ended up using the first approach but still strugle to pass in a flow_name for each flow as parameter because the current deployment cli doesn’t take flow name as an option.
Kaibo Chen
05/08/2023, 10:19 AM
Also so keen to know how to use subflow. Could you elabrate on this a bit @Deceivious
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.