Christopher Boyd
09/13/2022, 8:52 PMChristopher Boyd
09/13/2022, 8:52 PMLeon Kozlowski
09/13/2022, 9:17 PMstern --tail 500 prefect-orion
"message":"The POST operation against Job.batch could not be completed at this time, please try again.","reason":"ServerTimeout"
Frank Hardisty
09/14/2022, 12:30 AMAnton L.
09/14/2022, 6:24 AM-w
option:
f"`watch_flow_run` timed out after "
RuntimeError: `watch_flow_run` timed out after 12.0 hours of waiting for completion. Your flow run is still in state: <Running: "Running flow.">
Is there a way to pass a different max_duration to a watch_flow_run
in such usecase?Gintautas Jankus
09/14/2022, 6:52 AMdammy arinde
09/14/2022, 8:41 AMAndreas Nigg
09/14/2022, 9:44 AMChristian Vogel
09/14/2022, 11:48 AMJosé Duarte
09/14/2022, 1:24 PMpython -m prefect.engine flow_uuid
, it fetches the flow but then tries to copy files into the same folder, in this case deployment.path
is the cwd
& pwd
which in turn means that .
resolves to deployment.path
— making the filesystems.LocalFileSystem.get_directory
copy the files into themselves (through shutil.copytree
) which ends up in a HUGE error like so:
[<redacted for brevity>, '.', 'c', 'f', 'g', "'", '>', ' ', 'a', 'n', 'd', ' ', "'", '.', '/', '.', 'i', 's', 'o', 'r', 't', '.', 'c', 'f', 'g', "'", ' ', 'a', 'r', 'e', ' ', 't', 'h', 'e', ' ', 's', 'a', 'm', 'e', ' ', 'f', 'i', 'l', 'e', '<', 'D', 'i', 'r', 'E', 'n', 't', 'r', 'y', ' ', "'", '.', 'f', 'l', 'a', 'k', 'e', '8', "'", '>', ' ', 'a', 'n', 'd', ' ', "'", '.', '/', '.', 'f', 'l', 'a', 'k', 'e', '8', "'", ' ', 'a', 'r', 'e', ' ', 't', 'h', 'e', ' ', 's', 'a', 'm', 'e', ' ', 'f', 'i', 'l', 'e']
With regards to Prefect’s code, I have a solution, just check if both paths match and don’t copy in that case, but I’d like to get some feedback from the Prefect team before reporting a bug and sending in a fix — i.e. if I am doing something wrong.Vlad Tudor
09/14/2022, 1:46 PMJosé Duarte
09/14/2022, 2:10 PMLeon Kozlowski
09/14/2022, 2:43 PM| ERROR | prefect.agent - Failed to submit flow run 'FLOW_RUN_ID' to infrastructure.
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"The POST operation against Job.batch could not be completed at this time, please try again.","reason":"ServerTimeout","details":{"name":"POST","group":"batch","kind":"Job"},"code":500}
More configurations in threadBlake Hamm
09/14/2022, 3:29 PMDeployment
class (not seeing anything in the API reference). Or, if anyone else would find a .run()
method on the Deployment
class useful? 😼chris arettines
09/14/2022, 4:15 PMSam Garvis
09/14/2022, 5:17 PMKhuyen Tran
09/14/2022, 5:18 PMPedro Machado
09/14/2022, 5:20 PMKonstantinos
09/14/2022, 5:29 PMArun Giridharan
09/14/2022, 5:46 PMJason Leacox
09/14/2022, 6:07 PMkiran
09/14/2022, 7:06 PMimport psycopg2
from somewhere else instead? Running 2.3.2
Flow could not be retrieved from deployment.
Traceback (most recent call last):
File "<frozen importlib._bootstrap_external>", line 883, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/tmp/tmpcre52tf5prefect/SCRIPTNAME.py", line 3, in <module>
import psycopg2
ModuleNotFoundError: No module named 'psycopg2'
Chris Gunderson
09/14/2022, 7:45 PMAnat Tal Gagnon
09/14/2022, 7:47 PMAnat Tal Gagnon
09/14/2022, 7:50 PMAndrew Pruchinski
09/14/2022, 8:49 PMTony Piazza
09/14/2022, 8:53 PMMichael Dyer
09/14/2022, 9:23 PMLeon Kozlowski
09/14/2022, 9:24 PMKelvin Garcia
09/14/2022, 9:34 PMS3Result
? for a flow level result
I want to have something like this
bucket/jobs/{parameter}
Kelvin Garcia
09/14/2022, 9:34 PMS3Result
? for a flow level result
I want to have something like this
bucket/jobs/{parameter}
Mason Menges
09/14/2022, 9:53 PMKelvin Garcia
09/14/2022, 10:03 PM