I am looking for a comparison with Mage. I read a comparison that is really favourable to Mage with respect to Prefect and I would like to read an opposite one 😄

Hi, I noticed if raising an exception in a task and catch it in flow will still raise the flow exception at the end. Is there way to avoid raise it again? Please see in thread for code example.

What’s the best way to prune\cleanup old data on Prefect Server? the

.prefect

directory reached a size of 428G.

Hey Guys I want to setup a flow dependency for my task, basically I am running a flow, inside which I have a flow which downloads some data and then after this data has been downloaded I want to run some tasks, but when I try to do so the download flow runs successfully but the tasks after that end up failing, any idea why could that be happening and how can I fix it?

Does anybody know of a way to get the input parameters of a task run to show up in the UI? Kind of like how

@task(result=PrefectResult())

makes the output of the task run appear in the UI, except I'm looking to do this with the inputs as well.

Hi, I am trying to register a simple flow in a server that I run in a docker locally. I first built a docker image on top of

prefecthq/prefect:latest

image, which also copied my python script

/src/test.py

and ran

prefect backend server

. Then in the

docker-compose.yaml

generated by

prefect server config

, I added a service

client

whose command is

python /src/test/py

. After running

docker-compose up

, I got the following error from the

client

service:

requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f24823ea0d0>: Failed to establish a new connection: [Errno 111] Connection refused'))

Meanwhile, I can access UI and on UI it’s connected to Apollo endpoint successfully. It seems like

client

fails to connect to server at localhost:4200?

I have noticed that flow runs seem to get stuck in a running state. This seems to be happening more and more frequently. We are using Prefect 2.4.0 and using K8s and GCS for infrastructure. I have found that for these flow runs I am seeing logs on the agent like this

prefect.agent - An error occured while monitoring flow run <flow_run_id> The flow run will not be marked as failed, but an issue may have occurred.

Hi all, my company is testing prefect and I am having trouble installing a kubernetes agent, which I suspect is because of the company proxy. When I try to install the agent the logs say that it is being registered, but then eventually I get an SSL error.

requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))

Is there a way to provide proxy credentials when starting the agent? I've tried using the --env flag to supply proxy information. Or is there something similar to a --verify=false that I can set?

Hi I'm currently trying to do some deployment testing, and I'm getting the following error: Specification in 'newflow.py', line 13 failed validation! You have not configured default storage on the server or set a storage to use for this deployment but this deployment is using a Universal flow runner which requires remote storage. I've currently got a file called: from prefect import flow @flow def hello_world(name="world"): print(f"Hello {name}!") # Note: a deployed flow does not need a command to # explicitly run the flow. The API handles this for you. # hello_world() from prefect.deployments import DeploymentSpec DeploymentSpec( flow=hello_world, name="hello-world-daily", ) and the error comes out when I run the following: prefect deployment create newflow.py

Hi Everyone, I am trying to trigger prefect flow deployed on cloud whenever file is landed to S3 bucket using AWS Lambda function by referring this documentation from Chris. Lambda function is failing with

"errorMessage": "HTTP Error 404: Not Found"

I am passing API URL

<https://api.prefect.io>

. I understand that this documentation is not latest and I also tried URL

<https://api.prefect.cloud/>

and getting same error. Request your inputs regarding this error in Prefect version 2.0