Hello guys, i have a question regarding Timeouts. If i change

retries

and

retry_delay_seconds

params in the task declaration, does the Timeout change? Im having a Timeout error and i increased the above parameters which resulted on the task to fail sooner. Is there any relationship between

timeout_seconds

and the other variables? As i increase retires, i have to increase

timeout_seconds

as well?

Hi All, I want to schedule a prefect flow every minute and within the flow have a check to determine a file in s3 has changed, if the file is changed a bunch of tasks are executed, otherwise flow exits, for this I need to maintain state across flows, how can I do that, thanks a ton

@Marvin, how do i fail a flow if a task fails?

In Prefect 2.0, I’m trying to create a Deployment which takes arguments from a configuration stored in Prefect Cloud as a custom block. Here is the sample code:

config = CustomConfig.load('my_block')

Deployment(
    name="My deployment",
    flow=my_flow,
    parameters={
        "password": config.password
    }
)

when I run this command from CLI

prefect deployment create my_deployment.py

I get this error

AttributeError: 'coroutine' object has no attribute 'password'

Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited

How can I do that?

@Marvin I’m getting this error snowflake.connector.errors.MissingDependencyError: Missing optional dependency: pandas

Hi! We use prefect to run databricks tasks, and we've been noticing lately that the status prefect shows for a task doesn't always update in time - prefect frequently thinks something is still running, or hasn't even started, when it already started and finished. So the flow doesn't continue on to the next tasks in the dag and gets stuck. Eventually gets the updated status of the databricks tasks and continues. This seems like some sort of communication issue between prefect and databricks, but I can't figure out how to debug. Would appreciate some help here! Thanks!

Hi, I'm new to Prefect. It's fantastic to deploy pipelines by using Python code. However, I had faced some issues when deploying a pipeline to Prefect. Here's my scenario. • I want to run Prefect Agent in the K8s cluster, and I successfully plug the agent into our cluster. • I built a docker image in Gitlab CI and pushed the docker image to ECR. Then, I wrote the Dockerfile and reference from here. • I write a flow script and register to the Prefect cloud by using my local computer. Unfortunately, after running the pipeline, I got some errors: the python model was not found. As a result, I can't successfully import the module that I wrote in the project. And here's my flow script.

Failed to load and execute flow run: ModuleNotFoundError("No module named '/Users/xxx/'")

Thanks for helping. 🙇

I am experiencing a dependency issue with "pendulum" in prefect that doesnt seem to make sense; I am attempting to add "msgraph-sdk" package to my internal package ("prefect-trellis") but getting this error from poetry:

Because no versions of msgraph-sdk match >1.4.0,<2.0.0
 and msgraph-sdk (1.4.0) depends on microsoft-kiota-serialization-form (>=0.1.0), msgraph-sdk (>=1.4.0,<2.0.0) requires microsoft-kiota-serialization-form (>=0.1.0).
And because no versions of microsoft-kiota-serialization-form match >0.1.0
 and microsoft-kiota-serialization-form (0.1.0) depends on pendulum (>=3.0.0), msgraph-sdk (>=1.4.0,<2.0.0) requires pendulum (>=3.0.0).
And because prefect (2.19.6) depends on pendulum (<3.0)
 and no versions of prefect match >2.19.6,<3.0.0, msgraph-sdk (>=1.4.0,<2.0.0) is incompatible with prefect (>=2.19.6,<3.0.0).
So, because prefect-trellis depends on both prefect (^2.19.6) and msgraph-sdk (^1.4.0), version solving failed.

reading this, it seems like Prefect has a dependency on pendulum < 3.0 while graph-sdk has dependency on pendulum >= 3.0; however checking prefect's requirement, I only see pendulum referenced in the client which requires pendulum >= 3.0.0, <4 https://github.com/PrefectHQ/prefect/blob/2c25cd0df52959d9c499cc0487ec52d7afe04dc8/requirements-client.txt#L21. Is this dependency on pendulum < 3.0 intended for the main prefect package?

I'm creating an integration with datadog and I need to add a custom handler to prefect's flows. I need to add a handler that gets all logs from the run and spits it out as json. I've seen a lot of examples like the one bellow, but that's not what I need. I don't want to add a handler to each logger.

logger = prefect.context.get('logger')
logger.addHandler(log_handler)

I need something like this

log_handler = logging.StreamHandler()
log_handler.setFormatter(DatadogFormatter())
get_logger().addHandler(log_handler)

I add the handler to the 'root' logger and everything is logged the way I need. I've tried the latter and it works fine with

flow.run()

, but when I register the flow I can't get it to work with k8s. More details in the thread

Hello here, I am new to Prefect and run my first flow in my local K8S cluster and use

KubernetesRun

. The flow is trying to download the

py

file from a local git repo in the same local K8S cluster. But I got an

SSL_VERIFICATION

error even though the

url/host

for

git storage

is

HTTP

. Is there anyone having similar issue?