lialzm
12/17/2022, 9:51 AMTim-Oliver
12/17/2022, 3:28 PMFlorian Kühnlenz
12/17/2022, 7:53 PMFady Khallaf
12/18/2022, 11:20 AMAndrei Tulbure
12/18/2022, 2:14 PMAgnieszka
12/18/2022, 3:19 PMKelvin DeCosta
12/19/2022, 8:54 AM.build_from_flow
, but keep it disabled / turned off, similar to how we can turn them off via the UI?Tobias
12/19/2022, 10:44 AMNic
12/19/2022, 10:45 AMPatrick Tan
12/19/2022, 2:44 PMJames Zhang
12/19/2022, 4:12 PM...
File "/opt/prefect/workflow/tasks/model_train.py", line 64, in train_model
model = Top2Vec(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/top2vec/Top2Vec.py", line 668, in __init__
umap_model = umap.UMAP(**umap_args).fit(self.document_vectors)
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/umap/umap_.py", line 2516, in fit
) = nearest_neighbors(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/umap/umap_.py", line 328, in nearest_neighbors
knn_search_index = NNDescent(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py", line 920, in __init__
self._neighbor_graph = nn_descent(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/numba/core/dispatcher.py", line 468, in _compile_for_args
error_rewrite(e, 'typing')
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/numba/core/dispatcher.py", line 409, in error_rewrite
raise e.with_traceback(None)
numba.core.errors.TypingError: Failed in nopython mode pipeline (step: nopython frontend)
[1m[1m[1m[1mFailed in nopython mode pipeline (step: nopython frontend)
[1mUntyped global name 'print':[0m [1m[1mCannot determine Numba type of <class 'function'>[0m
[1m
File "../conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py", line 252:[0m
[1mdef nn_descent_internal_low_memory_parallel(
<source elided>
if verbose:
[1m print("\t", n + 1, " / ", n_iters)
[0m [1m^[0m[0m
[0m
[0m[1mDuring: resolving callee type: type(CPUDispatcher(<function nn_descent_internal_low_memory_parallel at 0x7fe7ea5adee0>))[0m
[0m[1mDuring: typing of call at /opt/conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py (358)
[0m
[0m[1mDuring: resolving callee type: type(CPUDispatcher(<function nn_descent_internal_low_memory_parallel at 0x7fe7ea5adee0>))[0m
[0m[1mDuring: typing of call at /opt/conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py (358)
[0m
[1m
File "../conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py", line 358:[0m
[1mdef nn_descent(
<source elided>
if low_memory:
[1m nn_descent_internal_low_memory_parallel(
[0m [1m^[0m[0m
The whole thing runs perfectly fine on my local, the python environment is also the same, but on the Prefect KubernetesJob it has the problem… I’m sure I’ve given the job enough resources (CPU & RAM)… anything to do with the parallelism? I don’t know much about the Numba CPUDispatcher
, can it be it’s not supported in a Prefect Task?
being stuck on this for days… 😣Michał Augoff
12/19/2022, 7:36 PMGreg Ott
12/19/2022, 8:13 PMEdmund Tian
12/19/2022, 9:00 PMRuntimeError: The task runner is already started!
Context:
I have an application hosted on GCP Cloud Run that allows multiple requests per container. Whenever my application receives an API request with a user_id
param, it triggers a flow run to update data for that user.
When I trigger the first Flow Run via an API request, everything works fine. But if I call the API again while the first Run is ongoing, my second API request with throw the above RuntimeError.
More context:
My application is written in Flask and served with Gunicorn. It’s deployed on GCP Cloud Run. Here’s the gunicorn config in my dockerfile
CMD exec gunicorn --bind :$PORT --workers 1 --threads 8 pelm_utility_service:app
Jason Noxon
12/19/2022, 9:45 PMprefect cloud login
I enter my API key, and I get an Index out of Range exception. Has anyone seen this?Jason Noxon
12/19/2022, 9:54 PMTraceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/prefect/cli/_utilities.py", line 41, in wrapper
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/prefect/utilities/asyncutils.py", line 205, in coroutine_wrapper
return run_async_in_new_loop(async_fn, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/prefect/utilities/asyncutils.py", line 156, in run_async_in_new_loop
return anyio.run(partial(__fn, *args, **kwargs))
File "/usr/local/lib/python3.8/dist-packages/anyio/_core/_eventloop.py", line 70, in run
return asynclib.run(func, *args, **backend_options)
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 292, in run
return native_run(wrapper(), debug=debug)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 287, in wrapper
return await func(*args)
File "/usr/local/lib/python3.8/dist-packages/prefect/cli/cloud.py", line 429, in login
workspace = current_workspace or workspaces[0]
IndexError: list index out of range
Praveen Shilavantar
12/19/2022, 10:03 PMclass API:
@flow
def start(self):
pass
I am getting TypeError: missing a required argument: 'self' (edited)puneet jindal
12/20/2022, 9:57 AMSlackbot
12/20/2022, 12:35 PMMichael Dymshits
12/20/2022, 12:51 PMpytest
which has perfect decorator
,
I got the following error (screenshot bellow).
If I comment #flow decorator, pytest runs without errors.Michael Dymshits
12/20/2022, 12:52 PMHamza Kazmi
12/20/2022, 1:22 PM(401) Reason: Unauthorized HTTP response headers: HTTPHeaderDict({'Audit-Id': '', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Date': 'Tue, 20 Dec 2022 13:00:03 GMT', 'Content-Length': '129'}) HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"Unauthorized","reason":"Unauthorized","code":401}
I have checked all keys and non of them is expired
What could be other possible reason for this error ?Harry Hause
12/20/2022, 3:05 PMMarcelo Santoro
12/20/2022, 3:13 PMVadym Dytyniak
12/20/2022, 3:14 PMMissi Sogbohossou
12/20/2022, 3:49 PMMissi Sogbohossou
12/20/2022, 3:49 PMMadison Schott
12/20/2022, 5:09 PM/usr/local/lib/python3.9/site-packages/prefect/core/flow.py:1726: UserWarning: No result handler was specified on your Flow. Cloud features such as input caching and resuming task runs from failure may not work properly.
Edmund Tian
12/20/2022, 5:29 PMOperationalError:
(sqlite3.OperationalError) no such table: flow_run_alert_policy
[SQL: ALTER TABLE flow_run_alert_policy RENAME TO flow_run_notification_policy]
(Background on this error at: <https://sqlalche.me/e/14/e3q8>)
I’m using the @flow
and @task
decorators for my Python functions. I’m not using Prefect Cloud. I’m on the following prefect version prefect==2.3.2
. It’s hard for me to repo because this occurs during my chron job, and it only occurs for a small subset of the Flow Runs. I haven’t been able to repo locally.
Anyone know what’s going on? A quick Google brought me to this, but this doesn’t seem related as I am not deploying anything and I’m not using orion
.Patrick Tan
12/20/2022, 6:57 PM