Hi Christopher, so far all the flows i have are simple python ETL flows, build with docker storage. I tried both building with a custom dockerfile and with base_image + python_dependencies.
The specific reason is that our API serving the data do not run with root access and can't read the data. The options I have are changing the ownership of the files during generation, changing the permission to include the user of the API (seems doable only with a chmod everytime a new file is created, not best practice imo), or change the user of API to root (I would like to avoid that). If there's other options I'm interested too!
I was first searching in the agent configuration but it seems i should actually change the Dockerfile. I just stumbled on the USER docker command. I tried adding "USER <my user>" with a user that exists on the VM the flow is executed on, but it fails as it does not exists inside the docker built. I think I need to dig more this option it looks close to what I need 🤔