I am looking for a comparison with Mage. I read a comparison that is really favourable to Mage with respect to Prefect and I would like to read an opposite one 😄

Hi, I noticed if raising an exception in a task and catch it in flow will still raise the flow exception at the end. Is there way to avoid raise it again? Please see in thread for code example.

Does anybody know of a way to get the input parameters of a task run to show up in the UI? Kind of like how

@task(result=PrefectResult())

makes the output of the task run appear in the UI, except I'm looking to do this with the inputs as well.

What’s the best way to prune\cleanup old data on Prefect Server? the

.prefect

directory reached a size of 428G.

Hey Guys I want to setup a flow dependency for my task, basically I am running a flow, inside which I have a flow which downloads some data and then after this data has been downloaded I want to run some tasks, but when I try to do so the download flow runs successfully but the tasks after that end up failing, any idea why could that be happening and how can I fix it?

@Marvin any idea why i have this error; "Can't connect to Server API at https://api.prefect.cloud/api/accounts/c1cfb16a-fc3c-4c1f-b185-e0cb9a6333e6/workspaces/ce9b57ec-cf95-43d0-971a-15e1d87d90b7. Check that it's accessible from your machine." , I have restarted my internet several times

Hi, I am trying to register a simple flow in a server that I run in a docker locally. I first built a docker image on top of

prefecthq/prefect:latest

image, which also copied my python script

/src/test.py

and ran

prefect backend server

. Then in the

docker-compose.yaml

generated by

prefect server config

, I added a service

client

whose command is

python /src/test/py

. After running

docker-compose up

, I got the following error from the

client

service:

requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f24823ea0d0>: Failed to establish a new connection: [Errno 111] Connection refused'))

Meanwhile, I can access UI and on UI it’s connected to Apollo endpoint successfully. It seems like

client

fails to connect to server at localhost:4200?

I have noticed that flow runs seem to get stuck in a running state. This seems to be happening more and more frequently. We are using Prefect 2.4.0 and using K8s and GCS for infrastructure. I have found that for these flow runs I am seeing logs on the agent like this

prefect.agent - An error occured while monitoring flow run <flow_run_id> The flow run will not be marked as failed, but an issue may have occurred.

Hi all, my company is testing prefect and I am having trouble installing a kubernetes agent, which I suspect is because of the company proxy. When I try to install the agent the logs say that it is being registered, but then eventually I get an SSL error.

requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))

Is there a way to provide proxy credentials when starting the agent? I've tried using the --env flag to supply proxy information. Or is there something similar to a --verify=false that I can set?

hi! - I'm trying to sent environment variables for a deployment that will run in a docker image. I am using this example, but

MY_SECRET_KEY

is rendering as a string -

{{ prefect.secret('MY_SECRET_KEY') }}

. Is it possible to get the rendered prefect secret in a deployment?

deployment = Deployment.build_from_flow(
    flow=my_flow,
    name="my-flow-deployment",
    infrastructure=docker_infrastructure,
    work_pool_name="my-docker-pool",
    job_variables={
        "env": {
            "MY_SECRET_KEY": "{{ prefect.secret('MY_SECRET_KEY') }}"
        }
    }
)