Christian Vogel
05/24/2022, 7:18 PMKevin Kho
05/24/2022, 7:28 PMChristian Vogel
05/24/2022, 7:31 PMAnna Geller
05/24/2022, 7:36 PMConcurrentTaskRunner
will likely be faster and solve your problem in a much easier way with less complexity involved@flow
instead of @flow(task_runner=RayTaskRunner())
Christian Vogel
05/24/2022, 7:39 PMZanie
05/24/2022, 7:44 PMChristian Vogel
05/24/2022, 7:45 PMZanie
05/24/2022, 7:45 PMChristian Vogel
05/24/2022, 7:46 PMZanie
05/24/2022, 7:47 PMprefect orion start
and set the PREFECT_API_URL
for your flow (it should be forwarded to the workers)
• Setup a Postgres database and set the database connection url (also forwarded to the workers, this is probably the worst option)Christian Vogel
05/24/2022, 7:49 PMZanie
05/24/2022, 7:49 PMChristian Vogel
05/24/2022, 7:50 PMZanie
05/24/2022, 7:50 PMChristian Vogel
05/24/2022, 7:50 PMterrence
05/24/2022, 7:56 PM