https://prefect.io
Join Slack
I am looking for a comparison with Mage. I read a comparison that is really favourable to Mage with ...
e

Edmondo Porcu

over 2 years ago
I am looking for a comparison with Mage. I read a comparison that is really favourable to Mage with respect to Prefect and I would like to read an opposite one 😄
e
r
  • 2
  • 2
  • 742
Hi, I noticed if raising an exception in a task and catch it in flow will still raise the flow excep...
t

Tony Yun

about 2 years ago
Hi, I noticed if raising an exception in a task and catch it in flow will still raise the flow exception at the end. Is there way to avoid raise it again? Please see in thread for code example.
t
r
  • 2
  • 2
  • 715
Does anybody know of a way to get the input parameters of a task run to show up in the UI? Kind of ...
r

Ryan

almost 4 years ago
Does anybody know of a way to get the input parameters of a task run to show up in the UI? Kind of like how
@task(result=PrefectResult())
makes the output of the task run appear in the UI, except I'm looking to do this with the inputs as well.
👀 1
r
k
a
  • 3
  • 11
  • 687
What’s the best way to prune\cleanup old data on Prefect Server? the `.prefect` directory reached a ...
r

Roey Brecher

over 3 years ago
What’s the best way to prune\cleanup old data on Prefect Server? the
.prefect
directory reached a size of 428G.
✅ 1
r
a
  • 2
  • 3
  • 686
Hey Guys I want to setup a flow dependency for my task, basically I am running a flow, inside which ...
a

Abuzar Shaikh

over 3 years ago
Hey Guys I want to setup a flow dependency for my task, basically I am running a flow, inside which I have a flow which downloads some data and then after this data has been downloaded I want to run some tasks, but when I try to do so the download flow runs successfully but the tasks after that end up failing, any idea why could that be happening and how can I fix it?
a
a
  • 2
  • 3
  • 678
Hi, I am trying to register a simple flow in a server that I run in a docker locally. I first built ...
c

Christopher Chong Tau Teng

almost 4 years ago
Hi, I am trying to register a simple flow in a server that I run in a docker locally. I first built a docker image on top of
prefecthq/prefect:latest
image, which also copied my python script
/src/test.py
and ran
prefect backend server
. Then in the
docker-compose.yaml
generated by
prefect server config
, I added a service
client
whose command is
python /src/test/py
. After running
docker-compose up
, I got the following error from the
client
service:
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f24823ea0d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Meanwhile, I can access UI and on UI it’s connected to Apollo endpoint successfully. It seems like
client
fails to connect to server at localhost:4200?
c
k
a
  • 3
  • 25
  • 667
I have noticed that flow runs seem to get stuck in a running state. This seems to be happening more ...
n

Nick Coy

almost 3 years ago
I have noticed that flow runs seem to get stuck in a running state. This seems to be happening more and more frequently. We are using Prefect 2.4.0 and using K8s and GCS for infrastructure. I have found that for these flow runs I am seeing logs on the agent like this
prefect.agent - An error occured while monitoring flow run <flow_run_id> The flow run will not be marked as failed, but an issue may have occurred.
n
z
k
  • 3
  • 18
  • 662
<@ULVA73B9P> any idea why i have this error; "Can't connect to Server API at <https://api.prefect.cl...
l

Lawal Idris

10 months ago
@Marvin any idea why i have this error; "Can't connect to Server API at https://api.prefect.cloud/api/accounts/c1cfb16a-fc3c-4c1f-b185-e0cb9a6333e6/workspaces/ce9b57ec-cf95-43d0-971a-15e1d87d90b7. Check that it's accessible from your machine." , I have restarted my internet several times
l
m
  • 2
  • 16
  • 652
Hi all, my company is testing prefect and I am having trouble installing a kubernetes agent, which I...
b

Bennett Lambert

over 3 years ago
Hi all, my company is testing prefect and I am having trouble installing a kubernetes agent, which I suspect is because of the company proxy. When I try to install the agent the logs say that it is being registered, but then eventually I get an SSL error.
requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))
Is there a way to provide proxy credentials when starting the agent? I've tried using the --env flag to supply proxy information. Or is there something similar to a --verify=false that I can set?
b
a
  • 2
  • 5
  • 647
Hi I'm currently trying to do some deployment testing, and I'm getting the following error: Specifi...
s

Sang Young Noh

over 3 years ago
Hi I'm currently trying to do some deployment testing, and I'm getting the following error: Specification in 'newflow.py', line 13 failed validation! You have not configured default storage on the server or set a storage to use for this deployment but this deployment is using a Universal flow runner which requires remote storage. I've currently got a file called: from prefect import flow @flow def hello_world(name="world"): print(f"Hello {name}!") # Note: a deployed flow does not need a command to # explicitly run the flow. The API handles this for you. # hello_world() from prefect.deployments import DeploymentSpec DeploymentSpec( flow=hello_world, name="hello-world-daily", ) and the error comes out when I run the following: prefect deployment create newflow.py
✅ 1
s
a
v
  • 3
  • 102
  • 640
Previous234Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by