Jovan Sakovic
10/28/2021, 1:29 PMKevin Kho
Jovan Sakovic
10/28/2021, 1:34 PM[2021-10-28 13:32:07,457] DEBUG - agent | Sleeping flow run poller for 10.0 seconds...
[2021-10-28 13:32:17,461] DEBUG - agent | Querying for ready flow runs...
[2021-10-28 13:32:17,708] DEBUG - agent | Found 1 ready flow run(s): {'5feb1d2a-c0c9-48b0-9318-fcd6a38e0b14'}
[2021-10-28 13:32:17,708] DEBUG - agent | Retrieving metadata for 1 flow run(s)...
[2021-10-28 13:32:17,925] DEBUG - agent | Submitting flow run 5feb1d2a-c0c9-48b0-9318-fcd6a38e0b14 for deployment...
[2021-10-28 13:32:17,932] INFO - agent | Deploying flow run 5feb1d2a-c0c9-48b0-9318-fcd6a38e0b14 to execution environment...
[2021-10-28 13:32:17,932] DEBUG - agent | Sleeping flow run poller for 0.25 seconds...
[2021-10-28 13:32:17,932] DEBUG - agent | Updating flow run 5feb1d2a-c0c9-48b0-9318-fcd6a38e0b14 state from Scheduled -> Submitted...
[2021-10-28 13:32:18,186] DEBUG - agent | Querying for ready flow runs...
[2021-10-28 13:32:18,215] DEBUG - agent | Submitted flow run 5feb1d2a-c0c9-48b0-9318-fcd6a38e0b14 to process PID 1398
[2021-10-28 13:32:18,216] INFO - agent | Completed deployment of flow run 5feb1d2a-c0c9-48b0-9318-fcd6a38e0b14
[2021-10-28 13:32:18,465] DEBUG - agent | No ready flow runs found.
[2021-10-28 13:32:18,466] DEBUG - agent | Sleeping flow run poller for 0.5 seconds...
...
...
[2021-10-28 13:32:45,370] DEBUG - agent | Sleeping flow run poller for 10.0 seconds...
[2021-10-28 13:32:48,359] DEBUG - agent | Sending agent heartbeat...
[2021-10-28 13:32:48,360] INFO - agent | Process PID 1398 returned non-zero exit code 1!
[2021-10-28 13:32:48,360] DEBUG - agent | Heartbeat succesful! Sleeping for 60.0 seconds...
[2021-10-28 13:32:55,371] DEBUG - agent | Querying for ready flow runs...
[2021-10-28 13:32:55,584] DEBUG - agent | No ready flow runs found.
[2021-10-28 13:32:55,584] DEBUG - agent | Sleeping flow run poller for 10.0 seconds...
Kevin Kho
Jovan Sakovic
10/28/2021, 1:35 PMKevin Kho
Jovan Sakovic
10/28/2021, 1:37 PMKevin Kho
Jovan Sakovic
10/28/2021, 1:45 PMFailed to load and execute Flow's environment: FlowStorageError('An error occurred while unpickling the flow:\n ModuleNotFoundError("No module named \'slack_metadata\'")\nThis may be due to a missing Python module in your current environment. Please ensure you have all required flow dependencies installed.')
To get around that, I made a __init__.py
in the prefect directory (where the flow and metadata script are).
Now, after trying the simple example, I assume that prefect saw the prefect directory as the prefect module, and could not import any of the prefect imports..Kevin Kho
LocalRun
RunConfig that lets you choose a working directory to run the flow.
If that init ends up not being called, I guess you would need an explicit import. I’m not sure it will be called.Jovan Sakovic
10/28/2021, 1:54 PM