Prefect 2.0. Is there a way to upload a file in the Cloud UI as a task argument? We have been using URLs for this but as we start to expand Prefect's use in our organization it is getting challenging to make sure the prefect agent has permissions to all the S3 buckets folks might upload a file to.

I'm seeing a lot of warnings about CancellationCleanup loop service taking a long time in my prefect server logs:

20:03:50.981 | WARNING | prefect.server.services.cancellationcleanup - CancellationCleanup took 30.438319 seconds to run, which is longer than its loop interval of 20.0 seconds.
20:04:24.279 | WARNING | prefect.server.services.cancellationcleanup - CancellationCleanup took 33.296899 seconds to run, which is longer than its loop interval of 20.0 seconds.

I've already deleted all the

Cancelled

runs in the hopes of fixing this, but it seems to have no effect. Also, my server's CPU usage is very high, and I'm wondering if it's potentially related to this. Does anyone know what makes CancellationCleanup take so long?

@Marvin Hello, I am currently trying to use prefect (using helm and values.yaml to setup work-pool and workers). The issue is each flow I try to run crashes due to validation error for KubernetesWorkerJobConfiguration env (value is not a valid dict)

Hi guys ! I’m trying to setup a

Prefect Agent

and a

prefect server

on my local computer, everything residing inside of

containers

. My

Prefect Server

`container(s)`is based on the

docker-compose

file retrieved from

prefect server config > server-docker-compose.yaml

. When spinning up a container for an Agent and running

prefect agent local start --api <http://host.docker.internal:4200>

, it says that I must be authenticated to communicate with the containerized server living in my local machine. My first question is: Is

authentication

mandatory in this kind of situation , for local run ? When I authenticate by creating a new tenant using

prefect server create-tenant -n default

outside the Agent container, I’m able to spin up the

Agent Container

and run everything. The problem is that I wanted to run the

create-tenant

inside the container too, but it’s not possible as I’m getting connection refused between containers.

Hi! Is it possible to increase max scheduled flows in prefect? I found “max_scheduled_runs_per_flow” parameter but it seems that is is only available in prefect server not prefect.

@Marvin is there a way to get my flow state using flow id?

@Marvin I have a local Dockerfile that I use to deploy a workflow. The work-pool also runs locally, but somehow I get the following error:

docker.errors.ImageNotFound: 404 Client Error for <http+docker://localhost/v1.47/images/create?tag=latest&fromImage=prefect-example>: Not Found ("pull access denied for prefect-example, repository does not exist or may require 'docker login'")

I can see the image locally though. This is my deployment code:

pipeline_flow.deploy(
        name="first-pipeline",
        work_pool_name="local-docker-pool",
        parameters={"folder": folder},
        image=DockerImage(
            name="prefect-example",
            tag="latest",
            dockerfile="Dockerfile"
        ),
        push=False,
    )

What could be the issue?

@Marvin How can I setup prefect 3.x using docker-compose? Note that I want to run flows using Docker work pool

@Marvin how to daemonize prefect server and worker start in windows

Folks, Good evening/afternoon/morning! 🙂 . Does anyone has OpenShift Yaml templates to set up PREFECT ? Due to privacy reason we cant use Prefect Cloud. So need to set up everything on our private OpenShift.. Anyone has Openshift Build , Deploy yaml templates