I am working on a POC to use Prefect to help orchestrate an ELT process. I was able to get a flow and tasks to run locally and show up in the local server ui. Then i setup a cloud prefect account because i wanted to test task concurrency and got it to kick of my flow from my local machine. My next step is to see what it takes to productionize the flow in Azure, so i have a few questions. 1. I know there is a azure marketplace item to Create Prefect Agent. Is that the best way to get that part setup? Is Kubernetes the way to go over just a VM with Docker? I tried getting the kubernetes version to install but it failed on the last step with "The received access token is not valid: at least one of the claims 'puid' or 'altsecid' or 'oid' should be present. If you are accessing as application please make sure service principal is properly created in the tenant.". no idea what that means and when i tried to run the install again, it gave me "A custom role with the same name already exists in this directory. Use a different name" 2. Does anyone know of a complete walkthough of setting up an agent in Azure (VM with docker or kubernetes). i did find something, but they dont show anything on setting up the kubernetes service etc. https://infinitelambda.com/post/prefect-workflow-automation-azure-devops-aks/

Hi Since updating Prefect from 3.6.16 to 3.6.17, I've been having problems with griffe package. Is anyone else experiencing these issues? For example my log during pytest :

from prefect.blocks.core import Block
../../../Library/Caches/pypoetry/virtualenvs/iguazu-zSPJHTsc-py3.14/lib/python3.14/site-packages/prefect/blocks/__init__.py:3: in <module>
    import prefect.blocks.notifications as notifications
../../../Library/Caches/pypoetry/virtualenvs/iguazu-zSPJHTsc-py3.14/lib/python3.14/site-packages/prefect/blocks/notifications.py:12: in <module>
    from prefect.blocks.abstract import NotificationBlock, NotificationError
../../../Library/Caches/pypoetry/virtualenvs/iguazu-zSPJHTsc-py3.14/lib/python3.14/site-packages/prefect/blocks/abstract.py:20: in <module>
    from prefect.blocks.core import Block
../../../Library/Caches/pypoetry/virtualenvs/iguazu-zSPJHTsc-py3.14/lib/python3.14/site-packages/prefect/blocks/core.py:27: in <module>
    from griffe import Docstring, DocstringSection, DocstringSectionKind, Parser, parse
E   ModuleNotFoundError: No module named 'griffe'
------------------------------------------------------------------------------------------------------------------------------- Captured stderr --------------------------------------------------------------------------------------------------------------------------------
Failed to initialize plugins: No module named 'griffe'

is there anyway to add

PREFECT_API_KEY

to self hosted prefect? I already have

PREFECT_API_KEY

configured in my docker compose but my local env is able to successfully able to execute flows on my self hosted prefect WITHOUT providing API key in any way.

@Marvin I have a prefect flow running 10 tasks in parallel on Ray via EC2. When I execute the following code by

python 3 file.py

, it works perfectly. I want to create a deployment out of this that I can run and trigger from the UI. I am happy to use docker for this and upload my docker file to a registry. I am on prefect 2.x and want to stay on it. How?

import time
from prefect import flow, task
from prefect_ray import RayTaskRunner

@task
def shout(number):
    time.sleep(0.5)
    print(f"#{number}")

@flow(task_runner=RayTaskRunner(
        address="<ray://1.2.2.3:10001>",
        init_kwargs={"runtime_env": {"pip3": ["prefect-ray"]}},
    ),
)
def count_to(highest_number):
    futures = [shout.submit(number) for number in range(highest_number)]
    for future in futures:
        future.wait()  # Ensure all tasks complete

if __name__ == "__main__":
    count_to(10)

Hi! Fetching sub-flow results without storage-serialization: I'm trying to run sub-flow from my parent-flow, over separate machines (through

run_deployment

) - and i want to get the (json-serialized) results directly returned in python rather than through serialized-dumps on file-system -since the external-machines are dead when i finish waiting for all sub-flows, local-files persistence crashes. i was hoping not to define a shared efs or spam s3 with temp-calculations - i assumed it's possible (something lie Airflow's xcomm, or just return the value which was already held by the subflow-process) After many (!) talks with Marvin, i tried to get the outputs through

flow_run.state.result(fetch=True)

and also made sure to activate the in-memory storage rather than file-system (which is not even defined as Block, but still) through

@flow(persist_result=False)

decorators. However i'm still failing over marvin's specific example snippet (this time over:

prefect.exceptions.MissingResult: State data is missing. Typically, this occurs when result persistence is disabled and the state has been retrieved from the API.

) Any idea if this snippet should work at all? am i missing something basic (some server-configuration)? must i define a shared-efs? i'll put on marvin's (slightly-modified) snippet in thread Thanks!

@Marvin I have a fastapi service where I have implemented a lot of the functionality that I need for running prefect workflows. Within this service, I rely on the fastapi dependency injection mechanism to construct and inject my dependencies into routes and various classes. How would you suggest migrating to prefect?

We've just migrated from the old Teams webhooks to the new Teams workflows for handling notification. I've created a block which works when I use it in a Prefect flow:

teams_webhook_block = MicrosoftTeamsWebhook.load("teams-analytics")

teams_webhook_block.notify("Hello from Prefect!")

However, when I try to use this block in an automation in Prefect Cloud, I get the following error when looking at the event feed:

"notification_log": "[ERROR]: There are no service(s) to notify"

How do I debug this? We're running the latest version of Prefect (3.0.2) and I re-registered the notification blocks (using prefect block register --module prefect_aws.credentials) to update them before configuring them. Edit: I created a Github issue https://github.com/PrefectHQ/prefect/issues/15404

Hello people, anybody know how to display progress bars from a running task on the prefect URL UI in logs

Hi, a newbie question… If the trigger for all tasks in a flow is “all successful”, and one of the upstream task fails, all of the downstream tasks are “trigger failed” (even if the upstream failed task is restarted and succeeds). This forces me to restart the trigger-failed tasks one by one. Is this the intended behavior? or am I missing something? Should I change the trigger to “all finished” in order to avoid this manual restarting of the downstream tasks when one of the upstream tasks fails at least once?

@Marvin I'm not seeing any task runs in the ui (or the database) when running my flow. I'm using ecs as a flow runner and the DaskTaskRunner.