Ben Zehavi
02/05/2024, 1:33 PMRunnerDeployment ignore my pull_steps parameter?Marvin
02/05/2024, 1:33 PMpull_steps parameter within the RunnerDeployment should not be ignored as it contains instructions for preparing your flows for a deployment run. Here are a few things you could look into or consider:
1. Ensure your prefect.yaml file is properly structured with the correct pull section and that it is correctly referenced within your deployment run.
2. The types of pull steps, such as set_working_directory, git_clone, and pull_from_{cloud}, must be correctly defined.
3. If you're using Prefect blocks and variable references, they will remain unresolved until runtime, so ensure they are correctly utilized and referenced in your pull steps.
4. Ensure that the blocks, particularly if you're using something like prefect_aws.deployments.steps.pull_from_s3, have the needed requirements, such as prefect-aws>=0.3.0.
If your pull_steps parameter is still being ignored despite these considerations, there might be an underlying issue or a bug. I'd recommend searching the GitHub issues for Prefect to see if this is a known issue or if others have encountered similar problems. Shall I search GitHub issues for relevant discussions?Marvin
02/05/2024, 1:34 PMRunnerDeployment is ignoring the pull_steps parameter:
1. Execution Order and Templating: The execution of prefect.yaml first handles the build section, followed by the push section, and finally the pull section. Although the pull section is templated with any step outputs, it's not run at this stage. It's important to ensure the steps are correctly templated and that you are checking the execution at the right stage.
2. Block References: Note that block references in the pull section are not hydrated for security purposes. This means that if your pull_steps rely on block references, they might not resolve as you expect.
3. Documentation: There might be a lack of up-to-date documentation or a discrepancy between the system behavior and the documentation. The excerpts do not directly address the cause of the pull_steps parameter being ignored, but such issues are not uncommon when dealing with evolving software.
If you've verified that the configuration and execution order align correctly with your expectations and the issue persists, it may be appropriate to search for relevant discussions or issues on Prefect's GitHub repository to see if others have encountered and resolved similar problems. Would you like me to search GitHub issues for more information on the RunnerDeployment ignoring pull_steps parameter?Ben Zehavi
02/05/2024, 1:34 PMMarvin
02/05/2024, 1:35 PMpull_steps being ignored in RunnerDeployment. This could imply that it's not a common issue or it hasn't been reported.
At this point, you may want to consider the following steps:
1. Double-check your deployment configuration and the prefect.yaml file to ensure everything is set up correctly.
2. Look for any typos or syntax errors in the definition of your pull_steps.
3. Review the order of operations in your deployment script to ensure that pull_steps are not being overwritten or bypassed by other parts of the script.
4. Make sure you're using the correct version of the Prefect library that supports the features you're trying to use.
5. If none of these steps resolve the issue, consider reaching out to the Prefect community or creating a new issue on the Prefect GitHub repository with details of your experience, configuration, and any error messages you're receiving.
This could also be a problem specific to your environment or setup, which might require a more tailored approach to debug. Given the lack of existing issues on the subject, it's likely that the solution will involve a closer inspection of your deployment configuration and usage of Prefect.