Steven Trimboli
12/12/2023, 10:22 PMMarvin
12/12/2023, 10:22 PMprefect.engine
(#10400). This suggests there might be room for improved handling of command-line arguments within the Prefect CLI or engine, which could potentially relate to unexpected command errors. The entrypoint command is ["python", "-m", "prefect.engine"]
, and any additional command arguments are treated as a flow run ID. The discussion indicates a desire to allow for additional customized behavior beyond this.
Another issue discusses the ability to not overwrite CLI deployments (#6644). This seems less related but does touch upon CLI behavior, which could be worth considering if your issue is arising from deployment procedures.
The third issue mentions an excessive amount of AssertionError: feed_data before feed_eof
in the logs (#6335). This is an error related to asyncio and stream handling, which might indirectly suggest there are bugs or edge cases in the Prefect system that could lead to unexpected command errors if there are issues with the subprocess execution within asyncio.
Given the information above, I recommend the following:
1. Review the command and arguments you're using in the Kubernetes job to ensure it matches the expected format used by the Prefect CLI or engine.
2. Confirm that your Prefect agent and any related containers are using correctly structured entrypoint commands.
3. Check if there are any optional arguments or configurations that might be affecting the command recognition.
If the issue persists, it might be useful to open a new issue on the Prefect GitHub repository with specific details about your setup, the exact commands you're running, and the context in which the error occurs. That way, the Prefect team can take a closer look and provide more targeted assistance.Nate
12/12/2023, 10:22 PMNate
12/12/2023, 10:24 PMKa Wing Fong
12/12/2023, 10:33 PMNate
12/12/2023, 10:42 PMprefect -m prefect.engine
to prefect flow-run execute
, with the consequence that an agent on the newest version of prefect cannot start runs in any infrastructure that has prefect<2.12.0 (the version when flow-run execute
was introduced) installedNate
12/12/2023, 10:44 PMKa Wing Fong
12/12/2023, 10:47 PMSteven Trimboli
12/12/2023, 10:48 PMKa Wing Fong
12/12/2023, 10:48 PMKa Wing Fong
12/12/2023, 10:49 PMNate
12/12/2023, 10:49 PM