@Marvin How do I add an extra step to an existing deployment ?

To add an extra step to an existing deployment in Prefect 3.x, you need to modify the

prefect.yaml

file associated with your deployment. Here's a concise guide: 1. Locate the

prefect.yaml

File: This file should be at the root level of your repository and contains the deployment configuration. 2. Modify the YAML: Edit the

prefect.yaml

file to include the new step in the appropriate section. Deployment steps are typically defined within the

build

,

push

, or other relevant sections. 3. Update the Deployment: After making changes to the

prefect.yaml

file, run the command:

bash
   prefect deploy --name your-deployment

This command will update the deployment with the new configuration. You can specify the deployment by name to avoid interactive prompts. For more detailed guidance, you can refer to the Prefect documentation: Prefect YAML Deployment. If you're using an imperative style, ensure that the steps you add align with your workflow logic.

@Marvin Can I achieve the same via the python API ?

The Prefect 3.x Python API doesn't directly expose a method to modify deployment steps like you can with the

prefect.yaml

file. The

deploy

module exists, but it doesn't provide a straightforward way to update deployment configurations programmatically. To modify deployment steps, the recommended approach is to edit the

prefect.yaml

file and then use the CLI to update the deployment. If you prefer using Python, you might write a script to automate editing the YAML file and executing the CLI command, but this involves using external libraries for YAML manipulation and subprocess execution. If you're interested in more programmatic control, consider exploring Prefect's client API (

get_client

) for other deployment-related functions, though it may not provide direct step modification capabilities.

@Marvin Ok, is there an option when using the prefect.yaml with the CLI to skip the upload to S3 step ?

In Prefect 3.x, the

prefect.yaml

file includes a

push

section that handles the logic for uploading code to remote locations like S3. If you want to skip the upload to S3, you can customize this section. Here are some options: 1. Remove or Comment Out the Push Section: If your deployment doesn't need to upload to S3, you can simply remove or comment out the

push

section in the

prefect.yaml

file. 2. Customize Push Logic: Modify the

push

section to either skip the S3 upload or direct it to a different location that suits your needs. 3. CLI Options: When running

prefect deploy

, there isn't a direct CLI flag to skip specific steps like S3 upload, so changes must be made in the YAML configuration itself. For more details on customizing the

prefect.yaml

file, you can refer to the Prefect YAML Deployment documentation.