https://prefect.io
Join Slack
Hi, I am trying to register a simple flow in a server that I run in a docker locally. I first built ...
c

Christopher Chong Tau Teng

over 3 years ago
Hi, I am trying to register a simple flow in a server that I run in a docker locally. I first built a docker image on top of
prefecthq/prefect:latest
image, which also copied my python script
/src/test.py
and ran
prefect backend server
. Then in the
docker-compose.yaml
generated by
prefect server config
, I added a service
client
whose command is
python /src/test/py
. After running
docker-compose up
, I got the following error from the
client
service:
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f24823ea0d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Meanwhile, I can access UI and on UI itโ€™s connected to Apollo endpoint successfully. It seems like
client
fails to connect to server at localhost:4200?
c
k
a
  • 3
  • 25
  • 651
Hey Guys I want to setup a flow dependency for my task, basically I am running a flow, inside which ...
a

Abuzar Shaikh

about 3 years ago
Hey Guys I want to setup a flow dependency for my task, basically I am running a flow, inside which I have a flow which downloads some data and then after this data has been downloaded I want to run some tasks, but when I try to do so the download flow runs successfully but the tasks after that end up failing, any idea why could that be happening and how can I fix it?
a
a
  • 2
  • 3
  • 639
<@ULVA73B9P> how does Prefect compare to Temporal?
a

Aron T

11 months ago
@Marvin how does Prefect compare to Temporal?
a
m
  • 2
  • 1
  • 638
Hi, I noticed if raising an exception in a task and catch it in flow will still raise the flow excep...
t

Tony Yun

almost 2 years ago
Hi, I noticed if raising an exception in a task and catch it in flow will still raise the flow exception at the end. Is there way to avoid raise it again? Please see in thread for code example.
t
r
  • 2
  • 2
  • 632
Hi I'm currently trying to do some deployment testing, and I'm getting the following error: Specifi...
s

Sang Young Noh

about 3 years ago
Hi I'm currently trying to do some deployment testing, and I'm getting the following error: Specification in 'newflow.py', line 13 failed validation! You have not configured default storage on the server or set a storage to use for this deployment but this deployment is using a Universal flow runner which requires remote storage. I've currently got a file called: from prefect import flow @flow def hello_world(name="world"): print(f"Hello {name}!") # Note: a deployed flow does not need a command to # explicitly run the flow. The API handles this for you. # hello_world() from prefect.deployments import DeploymentSpec DeploymentSpec( flow=hello_world, name="hello-world-daily", ) and the error comes out when I run the following: prefect deployment create newflow.py
โœ… 1
s
a
v
  • 3
  • 102
  • 623
Hi all, my company is testing prefect and I am having trouble installing a kubernetes agent, which I...
b

Bennett Lambert

over 3 years ago
Hi all, my company is testing prefect and I am having trouble installing a kubernetes agent, which I suspect is because of the company proxy. When I try to install the agent the logs say that it is being registered, but then eventually I get an SSL error.
requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1091)')))
Is there a way to provide proxy credentials when starting the agent? I've tried using the --env flag to supply proxy information. Or is there something similar to a --verify=false that I can set?
b
a
  • 2
  • 5
  • 620
Does anybody know of a way to get the input parameters of a task run to show up in the UI? Kind of ...
r

Ryan

over 3 years ago
Does anybody know of a way to get the input parameters of a task run to show up in the UI? Kind of like how
@task(result=PrefectResult())
makes the output of the task run appear in the UI, except I'm looking to do this with the inputs as well.
๐Ÿ‘€ 1
r
k
a
  • 3
  • 11
  • 618
Hi Everyone, I am trying to trigger prefect flow deployed on cloud whenever file is landed to S3 buc...
j

JV

over 2 years ago
Hi Everyone, I am trying to trigger prefect flow deployed on cloud whenever file is landed to S3 bucket using AWS Lambda function by referring this documentation from Chris. Lambda function is failing with
"errorMessage": "HTTP Error 404: Not Found"
I am passing API URL
<https://api.prefect.io>
. I understand that this documentation is not latest and I also tried URL
<https://api.prefect.cloud/>
and getting same error. Request your inputs regarding this error in Prefect version 2.0
โœ… 1
j
r
n
  • 3
  • 12
  • 615
I have noticed that flow runs seem to get stuck in a running state. This seems to be happening more ...
n

Nick Coy

over 2 years ago
I have noticed that flow runs seem to get stuck in a running state. This seems to be happening more and more frequently. We are using Prefect 2.4.0 and using K8s and GCS for infrastructure. I have found that for these flow runs I am seeing logs on the agent like this
prefect.agent - An error occured while monitoring flow run <flow_run_id> The flow run will not be marked as failed, but an issue may have occurred.
n
z
k
  • 3
  • 18
  • 609
Hi Prefect, I was wondering if it is possible to connect the prefect UI to an internal network, tha...
p

Peter Roelants

over 4 years ago
Hi Prefect, I was wondering if it is possible to connect the prefect UI to an internal network, that might not be available from the host I'm viewing the UI with? It seems that currently
server.ui.apollo_url
is called from the browser (and not from the server where the UI is running). For example, I have a docker-compose managed prefect server somewhere with an internal network called
prefect-server
, which has both
apollo
,
ui
, and the other prefect server services. Using
apollo_url="<http://localhost:4200/graphql>"
only works if I also bind
apollo:4200
to the local
4200
port where I'm running the browser from. For example setting
apollo_url="<http://apollo:4200/graphql>"
and letting the UI -> GraphQL connection go via the docker network wouldn't work afaik. In this case I see the following error in my browser's JS console:
VM9:1 POST <http://apollo:4200/graphql> net::ERR_NAME_NOT_RESOLVED
p
n
+2
  • 4
  • 13
  • 603
Previous234Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by