Is there anyway to get the worker configuration during runtime? I am creating my own
job_configuration
item that has some config that I want to expose into my flow. Is this possible as of now?
j
Jamie Zieziula
08/22/2023, 10:36 PM
Hi @Farhood Etaati! Are you looking for other configuration outside of the
env
object?
f
Farhood Etaati
08/23/2023, 5:48 AM
Yes. I'm trying to get the job configuration object itself. I've developed a custom worker that has a complex configuration mechanism (docker in docker) so I need to propagate the meta worker info in an observable way. Environment is one way, but I would like to have more guarantee and more control over the exact config object I'm using.
Farhood Etaati
08/26/2023, 9:36 AM
@Jamie Zieziula Hi! Any updates on this? I want immutable configuration option for worker specific things. I need to prepare an environment before running a flow in the worker node.
👀 1
j
Jamie Zieziula
08/28/2023, 3:34 PM
I would suggest either providing this information via flow parameters OR setting them as environment variables through the base job template // infra overrides
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.