Prefect 2.0: Hi, I can't seem to be able to run a deployed flow with tags -- it's not being picked up by the work queue/agent that's supposed to be handling that tag. 1. I created a work queue named

dev_queue

with the label

dev

and supporting all flow runners. It's the only work queue I have set up. 2. I ran an agent with

prefect agent start dev_queue

3. I created a deployment with the tag `dev`:

name: test_platform_flow_first_deployment
flow_name: Data Platform Demo
flow_location: ./test_platform_flow.py
parameters:
  to_print: "Hello from first deployment!"
tags:
  - dev

I verified in the UI that it has the right tag and flow runner. However, when I run the deployment, the flow run is never picked up. One suspicious thing I noticed is that the flow run doesn't inherit the

dev

tag from the deployment (although I don't know if it's a bug or a feature). When I remove all labels from the work queue, the flow runs are picked up correctly.

I wasn't able to reproduce using Python, let me try YAML :)

import platform
from prefect import task, flow
from prefect import get_run_logger
from prefect.deployments import DeploymentSpec
from prefect.flow_runners import SubprocessFlowRunner


@task
def say_hi():
    logger = get_run_logger()
    <http://logger.info|logger.info>("Hello world!")


@task
def print_platform_info():
    logger = get_run_logger()
    <http://logger.info|logger.info>(
        "Platform information: IP = %s, Python = %s, Platform type = %s, System Version = %s",
        platform.node(),
        platform.python_version(),
        platform.platform(),
        platform.version(),
    )


@flow
def hello_flow():
    hi = say_hi()
    print_platform_info(wait_for=[hi])


DeploymentSpec(
    name="dev", flow=hello_flow, tags=["local"], flow_runner=SubprocessFlowRunner()
)


if __name__ == "__main__":
    hello_flow()

yes the YAML without runner worked

ok, so this works:

name: dev
flow_location: /Users/anna/repos/gha/community.py
flow_name: hello
flow_runner:
  type: "docker"
tags:
  - dev

I configured a default storage so it should be good

this works 🎉

name: dev
flow_location: /Users/anna/repos/gha/community.py
flow_name: hello
flow_runner:
  type: "docker"
  config:
    volumes:
      - "/Users/anna/.aws:/root/.aws"
tags:
  - dev

Ah right, yes, it's Azure in my case but I see what you mean. Eventually I'd use Git storage for the flow code so it will be different anyway.

nice, just for full transparency: we don't have Git storage just yet, but it's on the roadmap

Sure. Thanks a lot 🙂 Also the Docker container requiring storage credentials note was great, I'd have to figure that one out right after getting this to work if you didn't mention it haha

Can you share your Azure YAML deployment configuration? I can try to replicate in my Azure Blob

For now I'm actually getting

httpx.HTTPStatusError: Client error '400 Bad Request' for url '<https://api-beta.prefect.io/api/accounts/1d7a71e3-4d77-4615-b3cf-966c2cedb752/workspaces/9d26098f-f680-43c8-b327-a34ea72f15b2/flow_runs/b7d2cfdc-53b2-4794-8095-27cea72fe18c>'

this has worked fine for me with Azure:

name: dev
flow_location: /Users/anna/repos/gha/community.py
flow_name: hello
flow_runner:
  type: "docker"
  config:
    env:
      AZURE_STORAGE_CONNECTION_STRING: xxx
tags:
  - dev