In Prefect 2 0 I m trying to create a Deployment which takes Prefect Community #prefect-community

In Prefect 2.0, I’m trying to create a Deployment ...

Riccardo Tesselli

07/20/2022, 8:08 AM

In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored in Prefect Cloud as a custom block. Here is the sample code:

Copy code

config = CustomConfig.load('my_block')

Deployment(
    name="My deployment",
    flow=my_flow,
    parameters={
        "password": config.password
    }
)

when I run this command from CLI

Copy code

prefect deployment create my_deployment.py

I get this error

Copy code

AttributeError: 'coroutine' object has no attribute 'password'

Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited

How can I do that?

Anna Geller

07/20/2022, 10:33 AM

Try out the Secret block instead that just got released

Anna Geller

07/20/2022, 10:34 AM

check out https://discourse.prefect.io/t/how-to-securely-store-secrets-in-prefect-2-0/1209

Riccardo Tesselli

07/20/2022, 11:24 AM

thanks @Anna Geller, but I think my situation is different from the example you provided. I know I can save and load blocks within flows, but at the moment I want to create a deployment as described in https://orion-docs.prefect.io/concepts/deployments/#creating-deployments by using the CLI. I’ve supposed that load would also work outside a flow but it looks like it doesn’t. Now I’m trying to create the deployment directly in Python with

Deployment.create()

, but now I’m facing with this error:

Riccardo Tesselli

07/20/2022, 11:26 AM

here is the code

Copy code

if __name__ == '__main__':

    config = CustomConfig.load('my_setup')

    deployment = Deployment(
        name="MyDeployment",
        flow=my_flow,
        parameters={
            "password": config.password,
            "slack_webhook": config.slack_webhook        }
    )
    deployment.create()

and I get this

Copy code

TypeError: Object of type 'AsyncWebhookClient' is not JSON serializable

Riccardo Tesselli

07/20/2022, 11:27 AM

so it looks like Pydantic is failing in serializing the Slack Webhook Block

Riccardo Tesselli

07/20/2022, 11:36 AM

so at the end I’ve fixed by doing this

Copy code

if __name__ == '__main__':

    config = CustomConfig.load('my_setup')

    deployment = Deployment(
        name="MyDeployment",
        flow=my_flow,
        parameters={
            "password": config.password,
            "slack_webhook": config.slack_webhook.url        }
    )
    deployment.create()

Riccardo Tesselli

07/20/2022, 11:39 AM

nevertheless, it could be handy to be able to quickly inject a block stored in the cloud into a deployment

Anna Geller

07/20/2022, 12:50 PM

we'll have more Deployment recipes after GA release, it should get easier in the next weeks

109 Views

Open in Slack

Previous Next