Can somebody tell me , which space is the this error referring to

"[Errno 28] No space left on device:

got this error during the agent run.

hey guys, I’m trying to start multiple deployment runs in a Flow using

prefect.deployments.run_deployment()

, is it possible to start these deployment runs concurrently?

Hello everyone! Is there a way to run/skip each one of a series of tasks based on a list of True/False statements or evaluate a condition before each task

hey prefect team, we had a flow crash overnight with a 404 error. using prefect cloud UI and prefect agent is v2.7.4. it has run hundreds of times before with no error like this, and I haven't changed any configuration settings. any ideas on what the cause could be for the bad api URL and how to prevent it in the future?

httpx.HTTPStatusError: Client error '404 Not Found' for url '<https://api.prefect.cloud/api/accounts/8ff05591-b922-43d6-96e2-0a956c1a55e7/workspaces/c573eb73-711f-42a5-a82d-f11e6defcd82/flow_runs/2c132385-8d43-471c-9dc5-dfad65eb5e41/set_state>'

Encountered exception during execution:
Traceback (most recent call last):
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/client/orion.py", line 1564, in set_flow_run_state
    response = await <http://self._client.post|self._client.post>(
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/httpx/_client.py", line 1848, in post
    return await self.request(
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/httpx/_client.py", line 1533, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/client/base.py", line 251, in send
    response.raise_for_status()
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/httpx/_models.py", line 745, in raise_for_status
    raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '404 Not Found' for url '<https://api.prefect.cloud/api/accounts/8ff05591-b922-43d6-96e2-0a956c1a55e7/workspaces/c573eb73-711f-42a5-a82d-f11e6defcd82/flow_runs/2c132385-8d43-471c-9dc5-dfad65eb5e41/set_state>'
For more information check: <https://httpstatuses.com/404>

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/engine.py", line 1574, in report_flow_run_crashes
    yield
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/engine.py", line 514, in create_and_begin_subflow_run
    terminal_state = await orchestrate_flow_run(
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/engine.py", line 599, in orchestrate_flow_run
    state = await propose_state(client, Running(), flow_run_id=flow_run.id)
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/engine.py", line 1741, in propose_state
    response = await client.set_flow_run_state(
  File "/home/analytics/miniconda3/envs/prefect_env/lib/python3.10/site-packages/prefect/client/orion.py", line 1570, in set_flow_run_state
    raise prefect.exceptions.ObjectNotFound(http_exc=e) from e
prefect.exceptions.ObjectNotFound

Hi, for some reason I am not seeing task inputs in the UI - see the images below. I am running the latest version of prefect (2.7.6)

Hi all, I’m trying to run Pytest for a Prefect project in a docker container. Pytest works locally (using Poetry to create virtual environment) but I’m running into a ModuleNotFoundError for prefect.logging when executing pytest on the docker image. My Prefect version is 2.7.6. Any idea’s why this would happen?

Hey All, hope you're all having a great day. Is there any way to name the run of a sub-flow, I really like the cool-names but it would be really helpful for my team-mates to see which dates of a sub-flow failed at a glance by looking at the flow name.

I use a builder pattern to generate multiple flows with different structures based on some configs. With Prefect 1.0 I was able to deploy and run the flows locally but I'm having issues with the LocalStorage with Prefect2.0. Details in thread:

Is there a way to add a task attribute during runtime? I have a task object created outside of the flow, but I would like to update the task arguments inside of the flow before running it. I'm on Prefect 1.3.0

Hello! We had four deployments fail last night with the same error a few hours into their runs (see below). All four deployments were long-running (2+ hours) and had a large number of tasks (3.5k, 3.4k, 1.1k, and 675 respectively). These deployments were part of two different flows with two very different sets of code. One of these flows is running Prefect 2.7.5, the other is running 2.6.7. Our agent is running 2.7.5 and we are using Prefect Cloud. Any insights as to what may have happened and how to fix this issue?

prefect.exceptions.MissingResult: State data is missing. Typically, this occurs when result persistence is disabled and the state has been retrieved from the API.

(full traceback in thread)

Hi there, hopefully a quick question about Prefect 2 run context and specifically getting a dict of parameters.

Hello, has anyone encountered this issue with a deployment before?

This message was deleted.

How do I kick off a flow run from prefect Orion? I can see flow runs that were run from the terminal, but from the UI I'm not seeing any "Run" button.

Hi I am on prefect 2.0 cloud and my deployment suddenly stopped working with the below error. Deployment pushed the flows to s3 bucket but agent is having issues to get those flows?

Flow could not be retrieved from deployment.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/prefect/engine.py", line 260, in retrieve_flow_then_begin_flow_run
    flow = await load_flow_from_flow_run(flow_run, client=client)
  File "/usr/local/lib/python3.10/site-packages/prefect/client/utilities.py", line 47, in with_injected_client
    return await fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/prefect/deployments.py", line 167, in load_flow_from_flow_run
    await storage_block.get_directory(from_path=deployment.path, local_path=".")
  File "/usr/local/lib/python3.10/site-packages/prefect/filesystems.py", line 463, in get_directory
    return await self.filesystem.get_directory(
  File "/usr/local/lib/python3.10/site-packages/prefect/filesystems.py", line 308, in get_directory
    return self.filesystem.get(from_path, local_path, recursive=True)
  File "/usr/local/lib/python3.10/site-packages/fsspec/asyn.py", line 113, in wrapper
    return sync(self.loop, func, *args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/fsspec/asyn.py", line 98, in sync
    raise return_result
  File "/usr/local/lib/python3.10/site-packages/fsspec/asyn.py", line 53, in _runner
    result[0] = await coro
  File "/usr/local/lib/python3.10/site-packages/fsspec/asyn.py", line 551, in _get
    rpaths = await self._expand_path(rpath, recursive=recursive)
  File "/usr/local/lib/python3.10/site-packages/fsspec/asyn.py", line 751, in _expand_path
    out = await self._expand_path([path], recursive, maxdepth)
  File "/usr/local/lib/python3.10/site-packages/fsspec/asyn.py", line 775, in _expand_path
    raise FileNotFoundError(path)
FileNotFoundError: ['prefect-bucket/prefect_test2']

[7:10 PM] @here any help is much appreciated [7:10 PM] agent is in kubernetes

[7:10 PM] I have no name!@prefect-agent-656bfcdc7d-pqjzx:~$ pip list | grep "prefect"
prefect                    2.7.1
prefect-aws                0.2.3
prefect-dask               0.2.2
prefect-kv                 0.1.0
prefect-snowflake          0.25

Hi guys, So there something unexpected happening with my prefect flows. So I deployed my flows last night and agent stopped working around 20:01 UTC and when I opened the screen that was running the agent , the agent came back alive again . The agent is supposed to run flows every half an hour. Look at the time stamps.

20:01:27.858 | INFO    | Flow run 'lovely-emu' - Created task run 'RAREA12to13-2f7bbdf5-0' for task 'RAREA12to13'
20:01:27.864 | INFO    | Flow run 'lovely-emu' - Executing 'RAREA12to13-2f7bbdf5-0' immediately...
20:01:29.858 | INFO    | Task run 'RAREA12to13-2f7bbdf5-0' - Finished in state Completed()
20:01:30.235 | INFO    | Flow run 'lovely-emu' - Finished in state Completed('All states completed.')
05:28:05.934 | INFO    | prefect.infrastructure.process - Opening process 'augmented-warthog'...
05:28:16.139 | INFO    | prefect.infrastructure.process - Process 'quaint-barracuda' exited cleanly.
05:28:25.094 | INFO    | prefect.infrastructure.process - Process 'benign-myna' exited cleanly.
05:28:35.179 | INFO    | prefect.infrastructure.process - Process 'pastel-swine' exited cleanly.
05:28:35.180 | INFO    | prefect.infrastructure.process - Opening process 'helpful-turkey'...
05:28:35.230 | INFO    | prefect.infrastructure.process - Opening process 'enormous-gecko'...
05:28:55.267 | INFO    | prefect.infrastructure.process - Process 'lumpy-wallaby' exited cleanly.                                  05:29:13.009 | INFO    | prefect.infrastructure.process - Process 'rigorous-elephant' exited cleanly.
05:29:31.230 | INFO    | prefect.infrastructure.process - Process 'lovely-emu' exited cleanly.20:01:27.858 | INFO    | Flow run 'lovely-emu' - Created task run 'RAREA12to13-2f7bbdf5-0' for task 'RAREA12to13'
20:01:27.864 | INFO    | Flow run 'lovely-emu' - Executing 'RAREA12to13-2f7bbdf5-0' immediately...
20:01:29.858 | INFO    | Task run 'RAREA12to13-2f7bbdf5-0' - Finished in state Completed()
20:01:30.235 | INFO    | Flow run 'lovely-emu' - Finished in state Completed('All states completed.')
05:28:05.934 | INFO    | prefect.infrastructure.process - Opening process 'augmented-warthog'...
05:28:16.139 | INFO    | prefect.infrastructure.process - Process 'quaint-barracuda' exited cleanly.
05:28:25.094 | INFO    | prefect.infrastructure.process - Process 'benign-myna' exited cleanly.
05:28:35.179 | INFO    | prefect.infrastructure.process - Process 'pastel-swine' exited cleanly.
05:28:35.180 | INFO    | prefect.infrastructure.process - Opening process 'helpful-turkey'...
05:28:35.230 | INFO    | prefect.infrastructure.process - Opening process 'enormous-gecko'...
05:28:55.267 | INFO    | prefect.infrastructure.process - Process 'lumpy-wallaby' exited cleanly.                                  05:29:13.009 | INFO    | prefect.infrastructure.process - Process 'rigorous-elephant' exited cleanly.
05:29:31.230 | INFO    | prefect.infrastructure.process - Process 'lovely-emu' exited cleanly.

Another weird thing about this is , even though I have enabled notifications for these flows from the prefect UI, no notifications were sent for the flow being in 'late' state.

seeing some odd behaviour with prefect 2.7.7 and

prefect-snowflake

Having issues deploying on Prefect 2.0

$ prefect version
Version:             2.7.7
API version:         0.8.4
Python version:      3.8.10
Git commit:          e8ca30b8
Built:               Fri, Jan 6, 2023 4:25 PM
OS/Arch:             linux/aarch64
Profile:             default
Server type:         cloud

Error:

$ prefect deployment apply run_collect_stocks_data-deployment.yaml
Successfully loaded 'yquark_deployment'
Traceback (most recent call last):
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/cli/_utilities.py", line 41, in wrapper
    return fn(*args, **kwargs)
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/utilities/asyncutils.py", line 230, in coroutine_wrapper
    return run_async_in_new_loop(async_fn, *args, **kwargs)
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/utilities/asyncutils.py", line 181, in run_async_in_new_loop
    return anyio.run(partial(__fn, *args, **kwargs))
  File "/home/youval/.local/lib/python3.8/site-packages/anyio/_core/_eventloop.py", line 70, in run
    return asynclib.run(func, *args, **backend_options)
  File "/home/youval/.local/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 292, in run
    return native_run(wrapper(), debug=debug)
  File "/usr/lib/python3.8/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/lib/python3.8/asyncio/base_events.py", line 616, in run_until_complete
    return future.result()
  File "/home/youval/.local/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 287, in wrapper
    return await func(*args)
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/cli/deployment.py", line 594, in apply
    deployment_id = await deployment.apply()
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/deployments.py", line 633, in apply
    deployment_id = await client.create_deployment(
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/client/orion.py", line 1313, in create_deployment
    response = await <http://self._client.post|self._client.post>(
  File "/home/youval/.local/lib/python3.8/site-packages/httpx/_client.py", line 1848, in post
    return await self.request(
  File "/home/youval/.local/lib/python3.8/site-packages/httpx/_client.py", line 1533, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/home/youval/.local/lib/python3.8/site-packages/prefect/client/base.py", line 251, in send
    response.raise_for_status()
  File "/home/youval/.local/lib/python3.8/site-packages/httpx/_models.py", line 745, in raise_for_status
    raise HTTPStatusError(message, request=request, response=self)
httpx.HTTPStatusError: Client error '422 Unprocessable Entity' for url '<https://api.prefect.cloud/api/accounts>

Is there limitation on the numpy version with Prefect 2.7.6? my numpy version is:

numpy                      1.24.1

and I get an error when running:

$ prefect deployment build ...

the error is:

encountered an exception: AttributeError("module 'numpy' has no attribute 'typeDict'")

I got a main flow and have 3 subflows within, the dashboard indicate all subflows has been completed the parent flow last line is the execute of subflow. So there isn’t any task afterward. However the parent flow is marked as failed with the following error:

Hi 👋 Trying to run the DaskTaskRunner() locally and getting “Failed to serialize”, “cannot pickle ‘SSLContext’ object” errors. https://discourse.prefect.io/t/error-when-using-local-dasktaskrunner-failed-to-serialize-cannot-pickle-sslcontext-object/2160 Any ideas?

Hi, I'm using Prefect cloud - and it seems to sign me out automatically very frequently (enough to annoy me). Any way this could be changed? I'm using google SSO as log in

Hi, I have an issue: I have a task, where basically constitutes of polling an API every 30 seconds. I use

asyncio.sleep

to wait between querying the API. Running of this task occupies 100% of the CPU - how can I fix this?

Hey - all of a sudden today I am unable to run

prefect deployment apply my-deployment.yml, mydeployment2.yml --upload

Error in 🧵

Hi all, we

[Prefect 1.0] Hi all, we’ve encountered an issue since 4th January where one of our Flows runs indefinitely at the extract stage. For context, the Flow extracts records from another db using

PostgresFetch

, transforms it and loads it onto our warehouse using

PostgresExecuteMany

. The Flow gets stuck at the stage where it reads from the external db and when I cancel it via the UI, it also cancels indefinitely (I have flows that have been ‘cancelling’ since a few days ago). Can anyone point me towards any suggested areas to investigate? For context, I checked if it’s a volume issue but the number of rows historically retrieved are roughly the same amount, and other Flows that query from the same external db are not running into this issue.

I use the code to register the deployment, but when I modify the name, the re-registration does not take effect, what do I need to do in Perfect 2.0, and I use the -f parameter in Perfect 1.0

Hey everyone! With version 2.7.3, task concurrency limits don’t seem to account for tasks that are marked as running for cancelled flows / subflows. Furthermore, flows that are marked as cancelled, don’t seem to propagate the state to their subflows. These zombie / orphaned tasks, although not running, still take up concurrency slots for all their tags.

Hey folks - using the personal version of Prefect 2.0, what's the best way to programmatically login to Prefect Cloud on a VM Agent?

Good morning - I'm migrating our flows over from Prefect 1 to Prefect 2 finally. I'm curious - whenever I run a flow locally from command line, it is now automatically created and run in the cloud UI console. Ideally, this would only happen once deployed like in Prefect 1. Am I doing something wrong? What should I be checking?