Oscar
07/21/2025, 7:11 AMIt seems there are two main issues in your Prefect configuration:
Script Output Issue: run_shell_script commands do not show any output, even with stream_output = true.
Project Path Issue: The deployment fails to find the project directory due to a FileNotFoundError.
The most significant error highlighted by the logs is the following:
FileNotFoundError: [Errno 2] No such file or directory: 'project'
This clearly indicates that Prefect cannot find the 'project' directory during flow execution.
Project structure and execution context:
You have the following directory structure:
src/
├── project/
│ ├── init.py
│ ├── main.py
│ ├── prefect.yaml
│ └── prefectTest.bkp
└── requirements.txt
You executed the prefect deploy command inside the src/ folder.
The main problem seems to stem from the fact that the deployment pipeline expects the project directory to be directly accessible, but due to the S3 pull into a temporary folder, the specified path for the 'project' directory is incorrect or no longer valid in the context where the flow is executed.
Does anyone know how to solve the problem?
p.s I saw that the stream output key didn't work to show the result if a pwd command using run_shell_script