In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored ...

Riccardo Tesselli

07/20/2022, 8:08 AM

In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored in Prefect Cloud as a custom block. Here is the sample code:

Copy code

config = CustomConfig.load('my_block')

Deployment(
    name="My deployment",
    flow=my_flow,
    parameters={
        "password": config.password
    }
)

when I run this command from CLI

Copy code

prefect deployment create my_deployment.py

I get this error

Copy code

AttributeError: 'coroutine' object has no attribute 'password'

Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited

How can I do that?

Anna Geller

07/20/2022, 10:33 AM

Try out the Secret block instead that just got released

Anna Geller

07/20/2022, 10:34 AM

check out https://discourse.prefect.io/t/how-to-securely-store-secrets-in-prefect-2-0/1209

Riccardo Tesselli

07/20/2022, 11:24 AM

thanks @Anna Geller, but I think my situation is different from the example you provided. I know I can save and load blocks within flows, but at the moment I want to create a deployment as described in https://orion-docs.prefect.io/concepts/deployments/#creating-deployments by using the CLI. I’ve supposed that load would also work outside a flow but it looks like it doesn’t. Now I’m trying to create the deployment directly in Python with

Deployment.create()

, but now I’m facing with this error:

Riccardo Tesselli

07/20/2022, 11:26 AM

here is the code

Copy code

if __name__ == '__main__':

    config = CustomConfig.load('my_setup')

    deployment = Deployment(
        name="MyDeployment",
        flow=my_flow,
        parameters={
            "password": config.password,
            "slack_webhook": config.slack_webhook        }
    )
    deployment.create()

and I get this

Copy code

TypeError: Object of type 'AsyncWebhookClient' is not JSON serializable

Riccardo Tesselli

07/20/2022, 11:27 AM

so it looks like Pydantic is failing in serializing the Slack Webhook Block

Riccardo Tesselli

07/20/2022, 11:36 AM

so at the end I’ve fixed by doing this

Copy code

if __name__ == '__main__':

    config = CustomConfig.load('my_setup')

    deployment = Deployment(
        name="MyDeployment",
        flow=my_flow,
        parameters={
            "password": config.password,
            "slack_webhook": config.slack_webhook.url        }
    )
    deployment.create()

Riccardo Tesselli

07/20/2022, 11:39 AM

nevertheless, it could be handy to be able to quickly inject a block stored in the cloud into a deployment

Anna Geller

07/20/2022, 12:50 PM

we'll have more Deployment recipes after GA release, it should get easier in the next weeks

195 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.