Hi All, I'm new to prefect. Trying to deploy in pr...
# ask-community
p
Hi All, I'm new to prefect. Trying to deploy in process work pool and schedule the flow with github-block. I have scheduled the deployment for every one minute. Once scheduled first run at first minute is succesfull, but from the second minute every run is failing due to "*prefect.deployments.steps.core.StepExecutionError: Encountered error while running prefect.deployments.steps.git_clone*" error. Could anyone please help on this issue? I stuck here and not sure how to solve
c
Hi Poorani - to further assist you we will need to see the logs / traceback from the error
p
Thanks Chris, I got this error from logs ""*prefect.deployments.steps.core.StepExecutionError: Encountered error while running prefect.deployments.steps.git_clone*"
c
that error should have included more text though, which is what we'll need to help you debug further
have you looked at the logs from the flow run?
p
Hi Chris, pasting the error msg below Flow could not be retrieved from deployment. Traceback (most recent call last): File "E:\virtual\svt311\Lib\site-packages\prefect\deployments\steps\core.py", line 124, in run_steps step_output = await run_step(step, upstream_outputs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\deployments\steps\core.py", line 95, in run_step result = await from_async.call_soon_in_new_thread( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\_internal\concurrency\calls.py", line 291, in aresult return await asyncio.wrap_future(self.future) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\_internal\concurrency\calls.py", line 315, in _run_sync result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\utilities\asyncutils.py", line 255, in coroutine_wrapper return call() ^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\_internal\concurrency\calls.py", line 382, in call return self.result() ^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\_internal\concurrency\calls.py", line 282, in result return self.future.result(timeout=timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\_internal\concurrency\calls.py", line 168, in result return self.__get_result() ^^^^^^^^^^^^^^^^^^^ File "C:\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result raise self._exception File "E:\virtual\svt311\Lib\site-packages\prefect\_internal\concurrency\calls.py", line 345, in _run_async result = await coro ^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\deployments\steps\pull.py", line 123, in git_clone await storage.pull_code() File "E:\virtual\svt311\Lib\site-packages\prefect\runner\storage.py", line 225, in pull_code await run_process(cmd) File "E:\virtual\svt311\Lib\site-packages\anyio\_core\_subprocesses.py", line 62, in run_process async with await open_process( ^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\anyio\_core\_subprocesses.py", line 126, in open_process return await get_asynclib().open_process( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\anyio\_backends\_asyncio.py", line 1041, in open_process process = await asyncio.create_subprocess_exec( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Python311\Lib\asyncio\subprocess.py", line 221, in create_subprocess_exec transport, protocol = await loop.subprocess_exec( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Python311\Lib\asyncio\base_events.py", line 1694, in subprocess_exec transport = await self._make_subprocess_transport( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Python311\Lib\asyncio\windows_events.py", line 399, in _make_subprocess_transport transp = _WindowsSubprocessTransport(self, protocol, args, shell, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Python311\Lib\asyncio\base_subprocess.py", line 36, in init self._start(args=args, shell=shell, stdin=stdin, stdout=stdout, File "C:\Python311\Lib\asyncio\windows_events.py", line 921, in _start self._proc = windows_utils.Popen( ^^^^^^^^^^^^^^^^^^^^ File "C:\Python311\Lib\asyncio\windows_utils.py", line 153, in init super().__init__(args, stdin=stdin_rfd, stdout=stdout_wfd, File "C:\Python311\Lib\subprocess.py", line 1026, in init self._execute_child(args, executable, preexec_fn, close_fds, File "C:\Python311\Lib\subprocess.py", line 1538, in _execute_child hp, ht, pid, tid = _winapi.CreateProcess(executable, args, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: [WinError 2] The system cannot find the file specified The above exception was the direct cause of the following exception: Traceback (most recent call last): File "E:\virtual\svt311\Lib\site-packages\prefect\engine.py", line 405, in retrieve_flow_then_begin_flow_run flow = await load_flow_from_flow_run(flow_run, client=client) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\client\utilities.py", line 51, in with_injected_client return await fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\deployments\deployments.py", line 233, in load_flow_from_flow_run output = await run_steps(deployment.pull_steps) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\virtual\svt311\Lib\site-packages\prefect\deployments\steps\core.py", line 152, in run_steps raise StepExecutionError(f"Encountered error while running {fqn}") from exc prefect.deployments.steps.core.StepExecutionError: Encountered error while running prefect.deployments.steps.git_clone
Also, When I kept the concurrency limit for the work_queue as 1, it is working fine. if I try to increase the limit to 2 itself getting this errror
c
Ah this is very helpful thank you! Would you mind opening a GitHub issue for it so I don’t lose track? I believe the best title for it would be “can’t run multiple flows stored remotely concurrently on windows” and including that full trace back + your description would give us what we need to dig into it
p
sure chris
Is that possible to share the link that you are opening, so I can keep checking for solution
c
Once you create the issue you’ll have a link to any updates 👍 👍
👍 1
p
Hi I created the github Issue with the name you suggested above
c
thank you Poorani! We will investigate