@Marvin Im not getting all Kubernetes pod logs when doing

logs_dict = await run_namespaced_job(job)

. Wondering how I can get all pod logs in prefect UI

Is there an easy way to disable retries for flows and tasks that have been declared as

@task(retries=5)

etc. during my tests without resorting to mocking?

@Marvin I’m trying to run a docker container from a prefect flow. The prefect 1.0 solution of using DockerRun seemed to be ideal, so I’m looking for a replacement … however DockerContainer has issues connecting to my local docker server … Here’s my (derived from @Nate’s example - thanks!) code …

from prefect.infrastructure.container import DockerContainer
DockerContainer(
    image="my_image",
    command=["python", "/app/modules/my_image/scripts/run_test_script.py"]
).run()

But this gives the following error: 404 Client Error for http+docker://localhost/v1.41/images/create?tag=latest&fromImage=my_image: However it runs fine from the command line if I use:

docker run --entrypoint python my_image /app/modules/my_image/scripts/run_test_script.py

Do I need to somehow set permissions for prefect to access docker? How do I do that for a local docker container? (edited)

Hi, We are intermittently getting this error in some of our prefect flows running on 2.8.4 and tried increasing resources as well but nothing works. If someone has faced this earlier, please help. Setup is running on kubernetes.

AssertionError

Traceback (most recent call last):

  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)

  File "/usr/lib/python3.8/asyncio/base_events.py", line 603, in run_until_complete
    self.run_forever()

  File "/usr/lib/python3.8/asyncio/base_events.py", line 570, in run_forever
    self._run_once()

  File "/usr/lib/python3.8/asyncio/base_events.py", line 1823, in _run_once
    event_list = self._selector.select(timeout)

  File "/usr/lib/python3.8/selectors.py", line 468, in select
    fd_event_list = self._selector.poll(timeout, max_ev)

  File "/usr/local/lib/python3.8/dist-packages/prefect/engine.py", line 1670, in cancel_flow_run
    raise TerminationSignal(signal=signal.SIGTERM)

prefect.exceptions.TerminationSignal


During handling of the above exception, another exception occurred:

Traceback (most recent call last):

  File "/usr/local/lib/python3.8/dist-packages/prefect/engine.py", line 1533, in orchestrate_task_run
    result = await run_sync(task.fn, *args, **kwargs)

  File "/usr/local/lib/python3.8/dist-packages/prefect/utilities/asyncutils.py", line 165, in run_sync_in_interruptible_worker_thread
    assert result is not NotSet

AssertionError

Finished in state Failed('Task run encountered an exception: Traceback (most recent call last):\n  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run\n    return loop.run_until_complete(main)\n  File "/usr/lib/python3.8/asyncio/base_events.py", line 603, in run_until_complete\n    self.run_forever()\n  File "/usr/lib/python3.8/asyncio/base_events.py", line 570, in run_forever\n    self._run_once()\n  File "/usr/lib/python3.8/asyncio/base_events.py", line 1823, in _run_once\n    event_list = self._selector.select(timeout)\n  File "/usr/lib/python3.8/selectors.py", line 468, in select\n    fd_event_list = self._selector.poll(timeout, max_ev)\n  File "/usr/local/lib/python3.8/dist-packages/prefect/engine.py", line 1670, in cancel_flow_run\n    raise TerminationSignal(signal=signal.SIGTERM)\nprefect.exceptions.TerminationSignal\n\nDuring handling of the above exception, another exception occurred:\n\nAssertionError\n')

hello! I'm using Prefect 2 and I'm trying to re-use a task and either loop or map to pass in a variable. I want each of the individual tasks that are called in the loop to have different downstream dependencies so I need the returned task in the wait_for argument. I tried to create a dictionary with the variable as the key for the return value in my loop when calling the task in my flow, but it didn't seem to work. Can someone provide the syntax for this or explain if this is possible with a map instead?

Hi, I'm getting a

RecursionError: maximum recursion depth exceeded in comparison

very similar to this (unanswered) report from @Austin Weisgrau a few days ago. Full stack trace in thread. Could someone from the Prefect team take a look? (also, we're paying customers, not sure if that entitles us to raise support tickets beyond here and/or github somehow?)

Hi, as of today I'm no longer seeing whether a flow is running, completed, pending etc in the tab icon in google chrome. I know 2.10.6 did something to the icons, was this intentional?

Hi 👋 When running ECS Tasks, is there a way to take some identifier from the Flow’s run in Prefect’s dashboard, and find it in the AWS dashboard? Or alternatively, somehow modify the creation of the ECS Task so that it’s Id would be the same as the Prefect’s flow id.

I’m getting an error in my agent logs, using an ECSTask Infrastructure Block

An error occured while monitoring flow run '793a0ee8-fe06-48d3-8858-31b2e99e4c50'. The flow run will not be marked as failed, but an issue may have occurred.

I think the Agent is trying to watch the created ECS Task’s logs, and using the wrong parameters to watch them

Hi everyone! I'd like to share with you a nice project orchestrated entirely with Prefect on top of Raspberry Pi. The project consists of an ML/AI-based football/score predictive model, running predictions for 100+ competitions across the globe, covering the entire Machine Learning end-to-end: from data acquisition, validation, model prediction/training and evaluation. I have also used the integrations with Slack (modified for Telegram) and Great Expectations for data validation/quality. In case you are interested, here is the link for the Telegram channel: t.me/alea_jacta_est_circe if you want to have a look to the predictions and results done on a daily basis with Prefect as the orchestrator engine. Hope you like it and enjoy it as much as I did integration Prefect with Raspberry Pi!