https://prefect.io
Join Slack
In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored ...
r

Riccardo Tesselli

about 4 years ago
In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored in Prefect Cloud as a custom block. Here is the sample code:
config = CustomConfig.load('my_block')

Deployment(
    name="My deployment",
    flow=my_flow,
    parameters={
        "password": config.password
    }
)
when I run this command from CLI
prefect deployment create my_deployment.py
I get this error
AttributeError: 'coroutine' object has no attribute 'password'

Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited
How can I do that?
r
a
  • 2
  • 8
  • 202
I'm having trouble with prefect logging with a loguru logger I've already set up.
a

Alex Papanicolaou

over 2 years ago
I'm having trouble with prefect logging with a loguru logger I've already set up.
a
  • 1
  • 2
  • 201
I'm seeing a lot of warnings about CancellationCleanup loop service taking a long time in my prefect...
z

Zachary Lee

about 3 years ago
I'm seeing a lot of warnings about CancellationCleanup loop service taking a long time in my prefect server logs:
20:03:50.981 | WARNING | prefect.server.services.cancellationcleanup - CancellationCleanup took 30.438319 seconds to run, which is longer than its loop interval of 20.0 seconds.
20:04:24.279 | WARNING | prefect.server.services.cancellationcleanup - CancellationCleanup took 33.296899 seconds to run, which is longer than its loop interval of 20.0 seconds.
I've already deleted all the
Cancelled
runs in the hopes of fixing this, but it seems to have no effect. Also, my server's CPU usage is very high, and I'm wondering if it's potentially related to this. Does anyone know what makes CancellationCleanup take so long?
z
  • 1
  • 1
  • 201
<@ULVA73B9P> How do I set logging level to 'debug' within a prefect flow?
m

merlin

over 1 year ago
@Marvin How do I set logging level to 'debug' within a prefect flow?
m
m
  • 2
  • 3
  • 199
Hello everybody! I've been playing around with the idea of self hosting Prefect server on a VM inst...
a

Aaron Gonzalez

about 3 years ago
Hello everybody! I've been playing around with the idea of self hosting Prefect server on a VM instance using docker compose. The following posts have gotten me pretty much all the way to having a working self-host option: • https://dev.to/calvinqc/the-easiest-docker-docker-compose-setup-on-compute-engine-1op1 • https://medium.com/the-prefect-blog/how-to-self-host-prefect-orion-with-postgres-using-docker-compose-631c41ab8a9f I am able to just set my local
PREFECT_API_URL
env var to the external IP address of my vm instance (not the nicest solution but I can clean this up later) and then I can immediately push my blocks and deployments to the server! 👍 The problem comes from when I lauch a run of one of my test deployments that use a Cloud Run Job. I never get out of the "Pending" status in the Prefect UI. Pretty sure it is something with my networking and probably not an actual issue with Prefect, but I can't seem to make any progress. I've tried setting up Serverless VPC Connections to allow the Cloud Run Job to be able to connect to the vm that has the server running, but maybe I've set it up incorrectly 🤷. Anyone else ever managed to get a cloud run job deployment to work with a vm instance hosted prefect server?
a
n
r
  • 3
  • 4
  • 199
Hi All, General Question - Can we deploy prefect on open shift ? Is there a doc for this ? Appreciat...
g

Gowtham Manne

over 4 years ago
Hi All, General Question - Can we deploy prefect on open shift ? Is there a doc for this ? Appreciate your help!
discourse 1
g
k
+2
  • 4
  • 16
  • 199
Hi, all of our flow runs have been failing for the last 12 hours with the error ```Submission failed...
m

Mark NS

almost 2 years ago
Hi, all of our flow runs have been failing for the last 12 hours with the error
Submission failed. RuntimeError: Cannot put items in a stopped service instance.
Does anyone know what might be causing this? cc @Marvin
m
m
  • 2
  • 3
  • 198
<@ULVA73B9P> give me an example how to retrieve flow id , who run the flow, and its all states and s...
i

Iryna

over 2 years ago
@Marvin give me an example how to retrieve flow id , who run the flow, and its all states and send this infor to snowflake
i
m
  • 2
  • 9
  • 198
<@ULVA73B9P> How do i upgrade from prefect v2 to v3 without losing any data for variables, blocks an...
a

Abhishek Singh

over 1 year ago
@Marvin How do i upgrade from prefect v2 to v3 without losing any data for variables, blocks and deployments
a
m
  • 2
  • 7
  • 197
<@ULVA73B9P> is there a way to disable the logging of a task finishing when running task.map? I'd li...
p

Paweł Biernat

over 1 year ago
@Marvin is there a way to disable the logging of a task finishing when running task.map? I'd like to map a task to a large list and I don't want my logs to be spammed with
Finished in state Completed()
.
p
m
  • 2
  • 3
  • 197
Previous373839Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by