I m seeing some lag time when creating a Docker storage obje

Question

I m seeing some lag time when creating a Docker storage object ```INFO prefect Docker | Building the flow s Docker storage ``` The run stays in that state for a long time before finally logging out the steps from docker build Any suggestions on how I can troubleshoot or produce more verbose output Any idea what is going on that would cause a significant delay here

nicholas · Answer

Hi < Adam Roderick> if you start your agent with the ` verbose` flag you ll get a lot more insight into what s happening with the Docker build step

nicholas · Answer

As for what could be causing the delay my first guess is that Docker could be hitting some resource ceilings I m curious what that output will be though

nicholas · Answer

It could also just be a very large image

nicholas · Answer

Sorry just realized I read that wrong you re seeing that delay when building the storage at the registration step right

Adam Roderick · Answer

point up yes exactly that `flow storage = Docker `

Adam Roderick · Answer

then `flow register `

nicholas · Answer

Ah ok I don t think there s a good way to get insight into what s going on there the code for that step is pretty straightforward Which OS are you running

Adam Roderick · Answer

WSL on Windows

Adam Roderick · Answer

It does have a small amount of lag normally But nothing like this

Adam Roderick · Answer

It s Ubuntu 20 04 LTS

Adam Roderick · Answer

Could the code be downloading a large docker base image every time rather than using the locally cached image

Adam Roderick · Answer

Python 3 7 is the base image in my Dockerfile

nicholas · Answer

That could be the issue but I think there s normally some pulling output if that s the case and afaik the Python image isn t anything craz For reference <https github com PrefectHQ prefect blob 0c7daafd8854bed9aecdd1262b235c3dd792f025 src prefect environments storage docker py L342 L347|here s the build step> for the Client

nicholas · Answer

Which version of Docker are you running

Adam Roderick · Answer

Docker version 19 03 8 build afacb8b7f0

Adam Roderick · Answer

It looks like WSL and docker combination is slow

nicholas · Answer

Yeah I m just reading some of the issues on GitHub about that sorry for the delay

nicholas · Answer

Unfortunately I don t think there s much Prefect can do to speed that up or get insight into it confused

Adam Roderick · Answer

When I run a timeit on from prefect environments storage import Docker` on windows it takes just under 1 second

Adam Roderick · Answer

When I run the same on WSL it takes 10 13 seconds

Adam Roderick · Answer

I know that s not a prefect issue thanks for looking into it

nicholas · Answer

Wow that s stark

Adam Roderick · Answer

If you have any ideas now or in the future I m all ears

Adam Roderick · Answer

Yeah very stark The other imports from Prefect have no difference

nicholas · Answer

Oh one option is to use VSCode and its <https marketplace visualstudio com items itemName=ms vscode remote remote wsl|Remote WSL plugin> which ll store code in the WSL filesystem

nicholas · Answer

Since it seems to be a networking issue

Adam Roderick · Answer

That s the setup I am using

Adam Roderick · Answer

It s a great option for development But exhibits the same behavior

nicholas · Answer

Oh no anguished

nicholas · Answer

Well it sounds like the slowness was definitely on Docker s radar at some point seems like networking was something they were looking to solve with WSL 2 confused wish I could be of more help here I ll keep you posted if I come across anything from the team

Adam Roderick · Answer

Thanks I ll do the same