Good afternoon. I have been making great progress on our inital prefect workflow model. However, I ran into a snag I have no idea how to fix. I have a typical download/unzip/save to s3 workflow that I am trying to send to a generic docker agent (with Flow("<whatever>", storage = Docker()) as flow:). When I try to register, I get a healthcheck error: no module named bs4 / Flow uses module that is not importable. How do I get the flow to use bs4 on the docker agent?
k
Kevin Kho
01/31/2022, 8:16 PM
Is your storage definition just an empty
Docker()
? Maybe you can try adding Python dependencies as seen in the API to add the relevant Python packages?
Thanks, Kevin. Yes, just and empty Docker() object. I'll try this.
Tony Liberato
01/31/2022, 9:03 PM
That worked beautifully, Kevin. Thank you.
👍 1
k
Kevin Kho
01/31/2022, 9:05 PM
Nice!
t
Tony Liberato
02/03/2022, 8:39 PM
So one last question and then I think I have our system up and running: How do you start the agent and detach? I have a docker agent running on red hat, but I don't want the agent to stop if I close my putty session. Any suggestions?
k
Kevin Kho
02/03/2022, 8:40 PM
You need some other tool to do that. pm2 or tmux or something like that?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.