Any idea why my environment variables are missing during a p

Question

Any idea why my environment variables are missing during a pipeline execution I m using Docker storage and locally I can spin up a container and confirm that the env vars are indeed there

nicholas · Answer

Hi < Adam Roderick> can you give a little more info about your setup Are these Prefect prefixed environment variables

Adam Roderick · Answer

No they are the dictionary I pass into Docker storage

nicholas · Answer

Got it < Adam Roderick> I ve not tried it personally but I d imagine those variables still need to be prefixed with `PREFECT ` to be read into the pipeline

Adam Roderick · Answer

No these are variables that are injected into the docker image It was working until this morning when I redeployed and I m not sure what is different

Adam Roderick · Answer

Trying to track it down The build step even shows that they are applied `Step 21 22 ENV DBT EXECUTABLE= datateer venv dbt bin dbt DBT PROFILES DIR= ` and when I spin up a container I can see them all there when I run `printenv` But the pipeline doesn t see them when I trigger it from cloud

nicholas · Answer

Interesting let me ping someone on this

Adam Roderick · Answer

Thanks I ll keep looking too

josh · Answer

< Adam Roderick> how are you attempting to access the env vars during your flow run

Adam Roderick · Answer

Actually I m accessing them at build time that might be the issue `os environ MELTANO EXECUTABLE `

josh · Answer

Yeah there s a chance they aren t set during build time Where exactly during the build are you attempting to retrieve them

Adam Roderick · Answer

in the constructor of a custom Task

Adam Roderick · Answer

I think it s an order of operations thing Thanks for checking on it with me