Hi 👋 Sorry for bringing this up here again, as there is already a Git issue opened. I just fear that this will fall through the cracks. This is a huge chunk of functionality that has completely disappeared, and our daily routine with Prefect mainly involved checking this UI, which is now missing. Can someone from the DEV team confirm this issue and provide some ETA for the fix? @Deceivious @nicholas Thank you for any help on the issue. 🙏 https://github.com/PrefectHQ/prefect/issues/9485

any1 else having issues accessing automations in dashboard? existing automations aren't listing and create button doesnt work. checking console and network, says its a CORS issue.

cess to XMLHttpRequest at '<https://api.prefect.cloud/api/accounts/sensitive/automations/count>' from origin '<https://app.prefect.cloud>' has been blocked by CORS policy: Response to preflight request doesn't pass access control check: No 'Access-Control-Allow-Origin' header is present on the requested resource.

Hi! I would like to profile the memory consumption of my prefect flow, and I found this one but it's for prefect 1, and we're using the latest version of prefect. Can anyone recommend a good tool to profile memory (RAM) consumption over time (I'd like to plot it, or at least report peak sizes), either specifically for prefect, or some other general tool? So far I've tried mprof but it seems to be way off in reporting true memory consumption, even if I do use

--include-children

. My prefect flow calls a lot of Docker containers btw, which might be the reason that the reporting is way off.

Hey team, I was wondering if there's prometheus integration for Prefect2. Is there some doc/pointers you could help me with on this ?

Hi Prefect, I am running a flow, but I am seeing weird behaviour, here are two screenshots from the same flow run:

Screenshot 2023-05-09 at 6.13.25 AM.png

As you can see it trying to run the flow again, from inside it self, recursively. I am using Prefect version: 2.8.2

What could cause this weird behaviour?

Hey, I'm trying to execute my deployment but keep getting an import error

File "/Users/barad/Desktop/Code/prefect/venv/lib/python3.11/site-packages/prefect/utilities/importtools.py", line 164, in load_script_as_module
    raise ScriptError(user_exc=exc, path=path) from exc
prefect.exceptions.ScriptError: Script at 'quotes_flow.py' encountered an exception: ModuleNotFoundError("No module named 'common'")

How can I change the working directory?

quotes_flow.py

from prefect import flow, get_run_logger
from prefect.blocks.system import Secret

from common.blocks.mongodb import MongoDB
from common.subflows.crawl.crawl import crawl
from flows.quotes.parse import parse


@flow(name="quotes", flow_run_name="quotes-page-{page_number}")
def quotes_flow(run_id: str, page_number: int):
    logger = get_run_logger()
    conn_str = Secret.load('database-connection-string').get()
    database = MongoDB(conn_str=conn_str)

    run_config = database.find_one(
        database="configs",
        collection="run_configs",
        query={
            "run_id": run_id,
        },
    )

    actions = run_config["actions"]

    formatted_url = f"<https://quotes.toscrape.com/page/{page_number}/>"

    if 'CRAWL' in actions:
        crawl(url=formatted_url)
    else:
        <http://logger.info|logger.info>("Skipping crawl step")

    if 'PARSE' in actions:
        parse(url=formatted_url)
    else:
        <http://logger.info|logger.info>("Skipping parse step")


if __name__ == "__main__":
    quotes_flow(
        run_id="3227",
        page_number=1,
    )

Hey folks. My flows are eternally stuck in

pending

state while trying to run through an ECSTask block. I was referring to https://prefecthq.github.io/prefect-aws/#save-an-infrastructure-and-storage-block. Probing a bit further, I checked the

containerDefinition

for the ECS task that was created by

prefect deployment apply

and the command seems to be

["python","-m","prefect.engine"]

To me, it seems that this is the malformed command, as what I see from the logs is that the Fargate instance is stuck on this command and starts some sort of a server, instead of running the desired flow. Could you folks kindly advise on this?

How come there is no task showing up but Prefect things that there are 20 currently active? How do I force reset that? It blocks all my jobs 😢

Hi, do you know how to handle async results from an api cleanly with retry but without raising an exception ?

Hi Prefect, I'm starting to have to manage a bunch of different deployments for different environments. Multiple for local, dev, prod, and staging environments. Does the community have any good resources for good strategies to manage of all these?

@alex Is there a setting I can use to automatically cancel subflows when the parent flow is cancelled? Or do I need to manually cancel each of them?

How do you monitor the health of a self-hosted orion server? Like to check whether the server and the agents that talk to it are health? So far I've found this from the CLI that offers some insight:

prefect work-queue inspect [work_flow_id]

Hi all - is there a list of public IP addresses for Prefect Cloud (i.e. for integrations with services so they can also have prefect access be restricted by inbound IP)?

I'm looking to run flows using AWS ECS/ECR. My flow code will live entirely inside the docker images. The plan is for one "initial" flow/container to call another flow/container after completion, and do this three or so times until my ETL process is complete. Does anyone use this sort of setup, and if so, do you use a different ECS Task Definition for each Flow/Container? I'm fairly new to ECS, so I'm not sure if I can use multiple containers under one ECS Task Definition (the TD effectively acting as a way to give each container the credentials it needs to run) choosing just the container I want for a given flow, or if each flow/container needs its own ECS Task Definition. Any help would be greatly appreciated!

@Prefect Is there maintenance going on from the off-cycle release that happened yesterday? I've noticed the Prefect UI not being responsive and I've had several inexplicable flow runs earlier this morning

Any chance you could list the pricing for support plans on your website (https://www.prefect.io/pricing/)?

This message was deleted.

Prefect 1.0 I'm running a flow manually with flow.run(). How can i configure the log output from the flow?

What results in flows being left in Running state?

Hi 👋 We are seeing many false triggers of automation in last 3-4 days. Any ideas what would be the cause of the issue? https://github.com/PrefectHQ/prefect/issues/9507

Hey! I want to migrate a prefect1 flow to prefect2 and my idea is to skip the agent setup and directly use projects/workers. This is the push section in my

deployment.yaml

:

push:
  - prefect_aws.projects.steps.push_project_to_s3:
        requires: "prefect-aws>=0.3.1"
        bucket: "prefect-..."
        folder: somefolder
        credentials: "{{ prefect.blocks.aws-credentials.prod }}"

When initiating a deploy via

prefect deploy --name ...

, the step fails with

TypeError: Session.client() got an unexpected keyword argument 'profile_name'

. I am getting a similar error when using

push_project_to_gcs

and gcp credentials. The credentials themselves are working fine when using them with an agent and some ecstask. What's the correct way of using credentials stored in a block? Or is it possible to use a s3 block directly?

Hello, Why is this comment here? https://github.com/PrefectHQ/prefect/blob/db7bfbd352bfce7c43f58ceae4e8a9417cfb2475/src/prefect/tasks.py#L109 Whats the drawback of using

Task

over

task

?

HI community, I tried to setup a k3sjobs in for the flow deployment, now, when I run_deployment(), a new job is created, image is being pulled but it eventually failed. stating:

/usr/bin/python: No module named prefect.engine.__main__; 'prefect.engine' is a package and cannot be directly executed

More info: in the logs of prefect agent, which looks fine.

11:37:58.507 | INFO    | prefect.agent - Submitting flow run 'e7122502-521e-45aa-9d63-a015cf5aa436'
11:37:58.608 | INFO    | prefect.agent - Completed submission of flow run 'e7122502-521e-45aa-9d63-a015cf5aa436'
11:37:58.620 | INFO    | prefect.infrastructure.kubernetes-job - Job 'k3sjob-7ftqb': Pod has status 'Pending'.
11:39:38.012 | INFO    | prefect.infrastructure.kubernetes-job - Job 'k3sjob-7ftqb': Pod has status 'Running'.

but the args of k3s jobs pod is :

containers:
    - name: prefect-job
      image: >-
        <custom-image-url>
      args:
        - python
        - '-m'
        - prefect.engine

Lately, some of my flow runs have a "Run Count" of 2 (instead of 1). When looking at the "Results" tab I see that both runs were started pretty much at the same time. We're using k8s infra. What could be the conditions of a single flow run being started more than once?

HEY community! We are using prefect open source with Orion server prefect v 2. I have integrated the notification to a slack channel, and all working well. When a flow is crashed I get this message: image below Which is as desired but the flow url is:

<http://ephemeral-prefect/api/flow-runs/flow-run/05ec5358-311d-45e4-8f86-781552c7426b>

which is not a correct one. I want to it to be:

http://<my_url>/flow-runs/flow-run/05ec5358-311d-45e4-8f86-781552c7426b

, How can I do it?