Is there a way to force the Docker storage to rebu...
# ask-communitym
matta
03/25/2021, 11:30 PMIs there a way to force the Docker storage to rebuild Python packages from scratch? We're having some trouble with cached versions causing problems between flows. Ops is trying to fix it from the CI/CD pipeline side, but I wonder if there's a way to do it from within Prefect?
t
Tyler Wanner
03/25/2021, 11:33 PMHi, Matta! Are you talking about docker caching?
m
matta
03/25/2021, 11:34 PMYeah! so like the
python_dependenciest
Tyler Wanner
03/25/2021, 11:34 PMI know that if you supply
build_kwargs = {"nocache":True}m
matta
03/25/2021, 11:35 PMOoh, awesome, thanks! I'll try that right now!
matta
03/25/2021, 11:38 PMHrm, it still tried to use the cached versions
t
Tyler Wanner
03/25/2021, 11:45 PMwhat's the output look like?
m
matta
03/25/2021, 11:47 PM Copy code
Collecting pyarrow==3.0
Using cached <https://files.pythonhosted.org/packages/62/d3/a482d8a4039bf931ed6388308f0cc0541d0cab46f0bbff7c897a74f1c576/pyarrow-3.0.0.tar.gz>
Complete output from command python setup.py egg_info:
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-build-sdfsfsf/pyarrow/setup.py", line 37, in <module>
from Cython.Distutils import build_ext as _build_ext
ModuleNotFoundError: No module named 'Cython'z
Zanie
03/25/2021, 11:51 PM
You could try setting the env var
PIP_NO_CACHE_DIR=trueZanie
03/25/2021, 11:52 PM
(with the DockerStorage
env_varsm
matta
03/25/2021, 11:52 PMSweet, I'll try that, thanks!
matta
03/26/2021, 12:06 AMBlah, still doesn't work. I guess the problem is upstream of what I can affect.
matta
03/26/2021, 12:14 AM(i have no idea how deployment pipelines work 😅 )
10 Views