Does anyone know if it is possible to pass `StartF...
# ask-community
j
Does anyone know if it is possible to pass
StartFlowRun
storage information? Or a better way to store flows that need to operate in multiple environments?
k
Hey @Jake Place, do you mean like passing Github credentials to load a Flow from Github?
j
@Kevin Kho not quite; I’ll explain here in the thread
What I’m trying to do is run a set of worker flows in multiple environments/sites, but without registering a separate flow for every combination. What I currently do is exactly that; so think for flow
worker1
I’ll have to register
dev-site1-worker1
,
dev-site2-worker1
,
qa-site1-worker1
and so on. I store these in Gitlab under branches (dev, qa, etc as explained above). What I would like to do is have my folder
workers
, which would exist in each branch, and then have 1 scheduled worker that calls
StartFlowRun
and specifies “I am an agent with the
prod
label, so I will look for flow
worker1
under the
prod
branch.” This way I minimize the number of flows that I have to dig through when I’m manually running something. So the question is; is it possible to tell
StartFlowRun
to pull a flow from a specific location, or is there a more obvious way to store flows for multi-environment use that I’m missing
k
In current Prefect, I don’t think such functionality exists because Flows need to be registered and they need the storage specified when they get registered. The closest thing Prefect currently has is Parameters for this. For enterprise, there is multitenancy so you have have the copy of the same flow registered across a dev, and prod tenant for example. I think there will be broader support for this in Orion though
The storage in Orion can be configured during runtime.
j
@Kevin Kho can you point me towards documentation on Tenants? We’re on an enterprise plan. I found https://docs.prefect.io/api/latest/backend/tenant.html#tenantview but it seems a bit sparse
k
On the tenants, you’d have to purchase them with sales@prefect.io. I don’t think we have any docs on it unfortunately. I could ask sales to reach out to you also if you want to chat about it?
j
Let me talk to the team and see if that’s an avenue we want to explore. Thanks for letting me know the current path isn’t workable ATM. Are there plans to move Orion features into Prefect Cloud after the project gets a bit more mature?
k
No on that one. The plan is to help people migrate to Orion (Prefect 2.0) to get those new features.
👍🏽 1