Chris L.08/15/2022, 8:32 AM
context manager works as expected in Prefect 1.0 (see https://discourse.prefect.io/t/how-to-use-dask-without-mapping-in-prefect-1-0-using-das[…]-client-to-call-client-submit-inside-a-prefect-task/470/13) but this behavior doesn't seem to migrate over to 2.0
Hawkar Mahmod08/15/2022, 8:53 AM
Dekel R08/15/2022, 1:51 PM
The code fails when running this specific row - (batch size is either an int or None)
Task 'upload_data_to_bq_task': Exception encountered during task execution! Traceback (most recent call last): File "/usr/local/lib/python3.8/dist-packages/prefect/engine/task_runner.py", line 880, in get_task_run_state value = prefect.utilities.executors.run_task_with_timeout( File "/usr/local/lib/python3.8/dist-packages/prefect/utilities/executors.py", line 468, in run_task_with_timeout return task.run(*args, **kwargs) # type: ignore File "/Users/dekelr/PycharmProjects/similarity-filter-layer/prefect_tasks/upload_data_to_bq.py", line 24, in upload_data_to_bq_task SystemError: unknown opcode
Everything works fine when I change this row to “if not batch_size:” After some troubleshooting - I found this thread - https://github.com/PrefectHQ/prefect/issues/3635 Running the same flow with the original row of -
if batch_size is None:
Still doesn’t work when registering with python 3.8 (same python version as in the container) Can you please explain this really odd behavior? Thanks
if batch_size is None:
dammy arinde08/15/2022, 2:05 PM
Oscar Björhn08/15/2022, 2:22 PM
Sam Garvis08/15/2022, 3:15 PM
Hamza Naanani08/15/2022, 3:24 PM
James Brady08/15/2022, 4:58 PM
Lana Dann08/15/2022, 5:57 PM
Jai P08/15/2022, 8:55 PM
datamongus08/15/2022, 11:25 PM
seems to only refer to Prefect 2.0
James Brady08/16/2022, 5:24 AM
emo loic08/16/2022, 9:20 AM
Andreas Nigg08/16/2022, 10:18 AM
Oscar Björhn08/16/2022, 10:38 AM
Marcin Grzybowski08/16/2022, 11:26 AM
Parwez Noori08/16/2022, 1:45 PM
Andreas Nigg08/16/2022, 1:50 PM
Tim Enders08/16/2022, 1:59 PM
sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) unable to open database file
microft08/16/2022, 2:44 PM
Tim Enders08/16/2022, 4:40 PM
defined on a mapped task? I now get this error (
) when trying to map across the subsequent function signature.
TypeError: object of type 'NoneType' has no len()
@task def get_items_list( client, entity, page, response_attr=None, path=None, params=None ):
Sam Garvis08/16/2022, 5:45 PM
, I get
whether I run this in an ipynb or with a python file through the terminal. Is it expected to run this command with await and async? Or is this not supposed to happen?
AttributeError: 'coroutine' object has no attribute 'get'
Blake Hamm08/16/2022, 6:16 PM
Alexander Belikov08/16/2022, 6:19 PM
and it worked. The main reason for using
processes =  for chunk in url_chunks: kwargs["mp3_urls"] = chunk processes.append(mp.Process(foo=foo, kwargs=kwargs)) for p in processes: p.start() for p in processes: p.join()
is to have a large model in memory shared between processes. In fact it works when I run this exact flow with prefect via a python script calling the flow as a fucntion, it works as expected. However, when run it as
or via a scheduled run, the processes in
prefect deployment run ...
don't run. The flow result is marked as success to my surprise. Any ideas?
chicago-joe08/16/2022, 7:24 PM
Vlad Tudor08/16/2022, 7:42 PM
locally and to bind it to minikube for testing purposes. For now, I see the Agent in the Server UI, but the tasks are not executed. How do I configure this? Thank you for you patience, I am new to Prefect.
😄 minikube v1.26.1 on Ubuntu 20.04 ✨ Using the docker driver based on existing profile 👍 Starting control plane node minikube in cluster minikube 🚜 Pulling base image ... 🏃 Updating the running docker "minikube" container ... 🐳 Preparing Kubernetes v1.24.3 on Docker 20.10.17 ... ▪ Generating certificates and keys ... ▪ Booting up control plane ... ▪ Configuring RBAC rules ... 🔎 Verifying Kubernetes components... ▪ Using image <http://gcr.io/k8s-minikube/storage-provisioner:v5|gcr.io/k8s-minikube/storage-provisioner:v5> 🌟 Enabled addons: storage-provisioner, default-storageclass 🏄 Done! kubectl is now configured to use "minikube" cluster and "default" namespace by default
Tim Enders08/16/2022, 8:54 PM
sqlalchemy.exc.TimeoutError: QueuePool limit of size 5 overflow 10 reached, connection timed out, timeout 30.00 (Background on this error at: <https://sqlalche.me/e/14/3o7r>)
Hammad Haqqani08/16/2022, 10:03 PM
prefect agent ecs start --cluster arn:aws:ecs:us-west-2:00000000:cluster/prefect-dev --label aws-ecs
Usage: prefect agent [OPTIONS] COMMAND [ARGS]...
Try 'prefect agent --help' for help.
╭─ Error ────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ No such command 'ecs'. │
Ben Muller08/16/2022, 10:38 PM