https://prefect.io
Join Slack
Did anyone have this problem where the python client hangs on trying to set up deployment? ``` deplo...
b

Boris Tseytlin

almost 3 years ago
Did anyone have this problem where the python client hangs on trying to set up deployment?
deployment = Deployment.build_from_flow(
    flow=load_data_from_minio,
    name="load_data_from_minio",
    work_queue_name="default",
    schedule=schedule,
    storage=storage_block,
    infrastructure=infra_block,
)

if __name__ == "__main__":
    logging.basicConfig(level=logging.DEBUG)
    deployment.apply()
Running this code just seems to hang forever. No debug logs either. Full code in thread
b
z
+2
  • 4
  • 23
  • 357
can anyone help me shed some light on this warning and what might be wrong? ```13:22:08.805 | WARNIN...
d

Devin Flake

12 months ago
can anyone help me shed some light on this warning and what might be wrong?
13:22:08.805 | WARNING | prefect.events.clients - Unable to connect to '<wss://workflows.arte.adobe.net/api/events/in>'. Please check your network settings to ensure websocket connections to the API are allowed. Otherwise event data (including task run data) may be lost. Reason: server rejected WebSocket connection: HTTP 403. Set PREFECT_DEBUG_MODE=1 to see the full error.
13:22:08.805 | ERROR   | GlobalEventLoopThread | prefect._internal.concurrency - Service 'EventsWorker' failed with 11 pending items.
full output in thread
d
n
  • 2
  • 13
  • 355
<@ULVA73B9P> whats the difference between a task and a flow — can I just use flows?
g

Gabriel Lespérance

over 1 year ago
@Marvin whats the difference between a task and a flow — can I just use flows?
g
m
n
  • 3
  • 62
  • 354
Hi. Looking for some tips on self-hosted authentication / authorization (user logins, roles) when ru...
k

Keith Hickey

over 3 years ago
Hi. Looking for some tips on self-hosted authentication / authorization (user logins, roles) when running our own Prefect Orion (2.0) server. We can't use Prefect Cloud due to compliance issues with using the SaaS offering (despite its hybrid security model), and this seems to be about the only box not checked for what we want the tool to do in standalone form. I don't want to have to open it up and bolt on FastAPI OAuth2 support to the web api. Any other solutions or workarounds to make it so that anyone on the network can't arbitrarily start, stop, modify flows? Maybe there's a way to allow all GET requests and block any POST/PUT/DELETE etc. to effectively make it read-only by default, and writable for privileged users?
✅ 1
🔐 2
k
c
+2
  • 4
  • 3
  • 352
<@ULVA73B9P> I get this error when trying to set my Prefect profile. I use Prefect 2.10.3: ```Unknow...
h

hagai

about 1 year ago
@Marvin I get this error when trying to set my Prefect profile. I use Prefect 2.10.3:
Unknown setting 'PREFECT_SERVER_ALLOW_EPHEMERAL_MODE'. (type=value_error)
When I run
prefect config unset PREFECT_SERVER_ALLOW_EPHEMERAL_MODE
I get the same error
h
m
  • 2
  • 1
  • 349
Hey all! Wondering if anyone knows if Prefect has any prometheus metrics exposed. We’re trying to fi...
s

Samuel Hinton

over 4 years ago
Hey all! Wondering if anyone knows if Prefect has any prometheus metrics exposed. We’re trying to figure out how to integrate our current AlertManager monitoring with prefect server and its flows. Have other people solved monitoring in an elegant way?
s
d
  • 2
  • 2
  • 349
<@ULVA73B9P> how do i instruct a custom logger to flush its logs programmatically?
b

Blake

over 1 year ago
@Marvin how do i instruct a custom logger to flush its logs programmatically?
b
m
  • 2
  • 4
  • 346
<@ULVA73B9P> how many tasks can be created/ran at once without causing the postgres sql connection p...
m

Maity

over 2 years ago
@Marvin how many tasks can be created/ran at once without causing the postgres sql connection pool to reach its limit?
m
m
  • 2
  • 5
  • 346
How should web applications (Node.js) listen/subscribe to Prefect workflows completion? I have a ta...
o

Ofir

over 2 years ago
How should web applications (Node.js) listen/subscribe to Prefect workflows completion? I have a task that trains a deep learning model through a Web Application. The “*Start training*” button on the web app sends a
POST /model
REST API call to the Node.js server which then in turn calls Prefect 2.0 using the REST API to start a new run (of an existing deployment). The workflow will train the model, run inference on some data and then persist the output to a database. This is obviously an asynchronous operation that may take a few minutes (or more) to complete. Assuming the workflow succeeded, I would like to notify the users (those who have Chrome opened to my web app) that something has happened, i.e. training completed. How should the Node.js be notified when the flow has finished (either successfully / failed)? Is there like a middleware / RabbitMQ / other message queue that the Node.js app can subscribe to, onto which Prefect publishes event? If not, does Prefect expose other broadcast events? And if not, should I poll periodically from my app and maintain state diff? Thanks!
o
a
  • 2
  • 13
  • 346
Hello everyone, there's a way to configure Prefect so he can use a proxy server? I'm trying to log i...
i

Italo Barros

over 4 years ago
Hello everyone, there's a way to configure Prefect so he can use a proxy server? I'm trying to log in on Prefect cloud (using the CLI), but I'm receiving the following SSLError:
requests.exceptions.SSLError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:852)'),))
i
k
  • 2
  • 27
  • 345
Previous111213Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by