so I have my flow in one file and then the tasks in another file. I finally got them to play nicely with Docker storage, but now in the RUN python /opt/prefect/healthcheck.py, it can't find the file that is in the same folder as the flow.
Copy code
System Version check: OK
/opt/prefect/healthcheck.py:130: UserWarning: Flow uses module which is not importable. Refer to documentation on how to import custom modules <https://docs.prefect.io/api/latest/storage.html#docker>
flows = cloudpickle_deserialization_check(flow_file_paths)
Traceback (most recent call last):
File "/opt/prefect/healthcheck.py", line 130, in <module>
flows = cloudpickle_deserialization_check(flow_file_paths)
File "/opt/prefect/healthcheck.py", line 43, in cloudpickle_deserialization_check
flows.append(cloudpickle.loads(flow_bytes))
ModuleNotFoundError: No module named "Module"
k
Kevin Kho
03/15/2022, 8:42 PM
Did you build this image beforehand or do you intend for DockerStorage to build it?
s
Sarah Floris
03/15/2022, 8:43 PM
Build this image beforehand.
k
Kevin Kho
03/15/2022, 8:46 PM
When you register then, you can do
flow.register(build=False)
s
Sarah Floris
03/15/2022, 8:47 PM
Sweet. I will try that.
Sarah Floris
03/15/2022, 8:47 PM
Thank you!
k
Kevin Kho
03/15/2022, 8:48 PM
This is a similar thread. He just moved his traceback to the end
Kevin Kho
03/15/2022, 8:56 PM
Oh yeah I just remembered from this thread you can do Local storage + KubernetesRun to point to your flow file inside the container
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.