Deepanshu Aggarwal
12/16/2022, 8:37 AM/usr/local/lib/python3.9/runpy.py:127: RuntimeWarning: 'prefect.engine' found in sys.modules after import of package 'prefect', but prior to execution of 'prefect.engine'; this may result in unpredictable behaviour
warn(RuntimeWarning(msg))
Simon Macklin
12/16/2022, 10:30 AMSimon Macklin
12/16/2022, 10:30 AMJarvis Stubblefield
12/16/2022, 3:59 PMMySQLdb.OperationalError: (1205, 'Lock wait timeout exceeded; try restarting transaction')
… any thoughts or ideas on what might be causing additional delay?Nils
12/16/2022, 4:18 PMpersist_result
to False since the object it return is not compatible with the Pickle serializer. However, I'm receiving the following error. I'm running on 2.7.2.
Flow could not be retrieved from deployment.
Traceback (most recent call last):
File "<frozen importlib._bootstrap_external>", line 883, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/opt/prefect/main.py", line 6, in <module>
from steps.parse.parser import parse
File "/opt/prefect/steps/parse/parser.py", line 9, in <module>
from .html_parser import process_html
File "/opt/prefect/steps/parse/html_parser.py", line 22, in <module>
@task(persist_result=False)
TypeError: task() got an unexpected keyword argument 'persist_result'
Devansh Doshi
12/16/2022, 6:00 PMzlee
12/16/2022, 6:07 PMDeepanshu Aggarwal
12/16/2022, 6:21 PMAndrew
12/16/2022, 6:43 PM.git
to default .prefectignoreSean Davis
12/16/2022, 7:32 PMPatrick Tan
12/16/2022, 10:04 PMlialzm
12/17/2022, 9:51 AMTim-Oliver
12/17/2022, 3:28 PMFlorian Kühnlenz
12/17/2022, 7:53 PMFady Khallaf
12/18/2022, 11:20 AMAndrei Tulbure
12/18/2022, 2:14 PMAgnieszka
12/18/2022, 3:19 PMKelvin DeCosta
12/19/2022, 8:54 AM.build_from_flow
, but keep it disabled / turned off, similar to how we can turn them off via the UI?Tobias
12/19/2022, 10:44 AMNic
12/19/2022, 10:45 AMPatrick Tan
12/19/2022, 2:44 PMJames Zhang
12/19/2022, 4:12 PM...
File "/opt/prefect/workflow/tasks/model_train.py", line 64, in train_model
model = Top2Vec(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/top2vec/Top2Vec.py", line 668, in __init__
umap_model = umap.UMAP(**umap_args).fit(self.document_vectors)
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/umap/umap_.py", line 2516, in fit
) = nearest_neighbors(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/umap/umap_.py", line 328, in nearest_neighbors
knn_search_index = NNDescent(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py", line 920, in __init__
self._neighbor_graph = nn_descent(
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/numba/core/dispatcher.py", line 468, in _compile_for_args
error_rewrite(e, 'typing')
File "/opt/conda/envs/prefect/lib/python3.9/site-packages/numba/core/dispatcher.py", line 409, in error_rewrite
raise e.with_traceback(None)
numba.core.errors.TypingError: Failed in nopython mode pipeline (step: nopython frontend)
[1m[1m[1m[1mFailed in nopython mode pipeline (step: nopython frontend)
[1mUntyped global name 'print':[0m [1m[1mCannot determine Numba type of <class 'function'>[0m
[1m
File "../conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py", line 252:[0m
[1mdef nn_descent_internal_low_memory_parallel(
<source elided>
if verbose:
[1m print("\t", n + 1, " / ", n_iters)
[0m [1m^[0m[0m
[0m
[0m[1mDuring: resolving callee type: type(CPUDispatcher(<function nn_descent_internal_low_memory_parallel at 0x7fe7ea5adee0>))[0m
[0m[1mDuring: typing of call at /opt/conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py (358)
[0m
[0m[1mDuring: resolving callee type: type(CPUDispatcher(<function nn_descent_internal_low_memory_parallel at 0x7fe7ea5adee0>))[0m
[0m[1mDuring: typing of call at /opt/conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py (358)
[0m
[1m
File "../conda/envs/prefect/lib/python3.9/site-packages/pynndescent/pynndescent_.py", line 358:[0m
[1mdef nn_descent(
<source elided>
if low_memory:
[1m nn_descent_internal_low_memory_parallel(
[0m [1m^[0m[0m
The whole thing runs perfectly fine on my local, the python environment is also the same, but on the Prefect KubernetesJob it has the problem… I’m sure I’ve given the job enough resources (CPU & RAM)… anything to do with the parallelism? I don’t know much about the Numba CPUDispatcher
, can it be it’s not supported in a Prefect Task?
being stuck on this for days… 😣Michał Augoff
12/19/2022, 7:36 PMGreg Ott
12/19/2022, 8:13 PMEdmund Tian
12/19/2022, 9:00 PMRuntimeError: The task runner is already started!
Context:
I have an application hosted on GCP Cloud Run that allows multiple requests per container. Whenever my application receives an API request with a user_id
param, it triggers a flow run to update data for that user.
When I trigger the first Flow Run via an API request, everything works fine. But if I call the API again while the first Run is ongoing, my second API request with throw the above RuntimeError.
More context:
My application is written in Flask and served with Gunicorn. It’s deployed on GCP Cloud Run. Here’s the gunicorn config in my dockerfile
CMD exec gunicorn --bind :$PORT --workers 1 --threads 8 pelm_utility_service:app
Jason Noxon
12/19/2022, 9:45 PMprefect cloud login
I enter my API key, and I get an Index out of Range exception. Has anyone seen this?Jason Noxon
12/19/2022, 9:54 PMTraceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/prefect/cli/_utilities.py", line 41, in wrapper
return fn(*args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/prefect/utilities/asyncutils.py", line 205, in coroutine_wrapper
return run_async_in_new_loop(async_fn, *args, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/prefect/utilities/asyncutils.py", line 156, in run_async_in_new_loop
return anyio.run(partial(__fn, *args, **kwargs))
File "/usr/local/lib/python3.8/dist-packages/anyio/_core/_eventloop.py", line 70, in run
return asynclib.run(func, *args, **backend_options)
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 292, in run
return native_run(wrapper(), debug=debug)
File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
return loop.run_until_complete(main)
File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
return future.result()
File "/usr/local/lib/python3.8/dist-packages/anyio/_backends/_asyncio.py", line 287, in wrapper
return await func(*args)
File "/usr/local/lib/python3.8/dist-packages/prefect/cli/cloud.py", line 429, in login
workspace = current_workspace or workspaces[0]
IndexError: list index out of range
Praveen Shilavantar
12/19/2022, 10:03 PMclass API:
@flow
def start(self):
pass
I am getting TypeError: missing a required argument: 'self' (edited)Puneetjindal 11
12/20/2022, 9:57 AMSlackbot
12/20/2022, 12:35 PMSlackbot
12/20/2022, 12:35 PM