@Marvin: What happened to SequentialTaskRunner in Prefect 3.0?

@Marvin Can you explain this error when trying to run concurrent deployments in parallel? 154459.516 | DEBUG | prefect.client - Encountered retryable exception during request. Another attempt will be made in 1.762195377774828s. This is attempt 1/6. Traceback (most recent call last): File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 60, in map_httpcore_exceptions yield File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection_pool.py", line 253, in handle_async_request raise exc File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection_pool.py", line 237, in handle_async_request response = await connection.handle_async_request(request) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection.py", line 90, in handle_async_request return await self._connection.handle_async_request(request) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 112, in handle_async_request raise exc File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 91, in handle_async_request ) = await self._receive_response_headers(**kwargs) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 155, in _receive_response_headers event = await self._receive_event(timeout=timeout) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 205, in _receive_event raise RemoteProtocolError(msg) httpcore.RemoteProtocolError: Server disconnected without sending a response. The above exception was the direct cause of the following exception: Traceback (most recent call last): File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\prefect\client\base.py", line 216, in _send_with_retry response = await request() File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1620, in send response = await self._send_handling_auth( File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1648, in _send_handling_auth response = await self._send_handling_redirects( File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1685, in _send_handling_redirects response = await self._send_single_request(request) File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1722, in _send_single_request response = await transport.handle_async_request(request) File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "\\v-tm-qeq-05\Prefect_Env\lib\contextlib.py", line 131, in exit self.gen.throw(type, value, traceback) File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.RemoteProtocolError: Server disconnected without sending a response. 154515.504 | DEBUG | prefect.client - Encountered retryable exception during request. Another attempt will be made in 1.956168415170509s. This is attempt 1/6. Traceback (most recent call last): File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\windows_events.py", line 457, in finish_recv return ov.getresult() OSError: [WinError 64] The specified network name is no longer available During handling of the above exception, another exception occurred: Traceback (most recent call last): File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\proactor_events.py", line 280, in _loop_reading data = fut.result() File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\windows_events.py", line 812, in _poll value = callback(transferred, key, ov) File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\windows_events.py", line 461, in finish_recv raise ConnectionResetError(*exc.args) ConnectionResetError: [WinError 64] The specified network name is no longer available The above exception was the direct cause of the following exception: Traceback (most recent call last): File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_exceptions.py", line 10, in map_exceptions yield File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\backends\asyncio.py", line 34, in read return await self._stream.receive(max_bytes=max_bytes) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\anyio\_backends\_asyncio.py", line 1212, in receive raise self._protocol.exception anyio.BrokenResourceError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 60, in map_httpcore_exceptions yield File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection_pool.py", line 253, in handle_async_request raise exc File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection_pool.py", line 237, in handle_async_request response = await connection.handle_async_request(request) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection.py", line 90, in handle_async_request return await self._connection.handle_async_request(request) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 112, in handle_async_request raise exc File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 91, in handle_async_request ) = await self._receive_response_headers(**kwargs) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 155, in _receive_response_headers event = await self._receive_event(timeout=timeout) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 191, in _receive_event data = await self._network_stream.read( File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\backends\asyncio.py", line 36, in read return b"" File "\\v-tm-qeq-05\Prefect_Env\lib\contextlib.py", line 131, in exit self.gen.throw(type, value, traceback) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_exceptions.py", line 14, in map_exceptions raise to_exc(exc) httpcore.ReadError The above exception was the direct cause of the following exception: Traceback (most recent call last): File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\prefect\client\base.py", line 216, in _send_with_retry response = await request() File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1620, in send response = await self._send_handling_auth( File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1648, in _send_handling_auth response = await self._send_handling_redirects( File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1685, in _send_handling_redirects response = await self._send_single_request(request) File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_client.py", line 1722, in _send_single_request response = await transport.handle_async_request(request) File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "\\v-tm-qeq-05\Prefect_Env\lib\contextlib.py", line 131, in exit self.gen.throw(type, value, traceback) File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ReadError 154515.690 | DEBUG | prefect.client - Encountered retryable exception during request. Another attempt will be made in 1.9267586944460113s. This is attempt 1/6. Traceback (most recent call last): File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\windows_events.py", line 457, in finish_recv return ov.getresult() OSError: [WinError 64] The specified network name is no longer available During handling of the above exception, another exception occurred: Traceback (most recent call last): File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\proactor_events.py", line 280, in _loop_reading data = fut.result() File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\windows_events.py", line 812, in _poll value = callback(transferred, key, ov) File "\\v-tm-qeq-05\Prefect_Env\lib\asyncio\windows_events.py", line 461, in finish_recv raise ConnectionResetError(*exc.args) ConnectionResetError: [WinError 64] The specified network name is no longer available The above exception was the direct cause of the following exception: Traceback (most recent call last): File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_exceptions.py", line 10, in map_exceptions yield File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\backends\asyncio.py", line 34, in read return await self._stream.receive(max_bytes=max_bytes) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\anyio\_backends\_asyncio.py", line 1212, in receive raise self._protocol.exception anyio.BrokenResourceError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 60, in map_httpcore_exceptions yield File "C:\Users\cleung\AppData\Roaming\Python\Python38\site-packages\httpx\_transports\default.py", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection_pool.py", line 253, in handle_async_request raise exc File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection_pool.py", line 237, in handle_async_request response = await connection.handle_async_request(request) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\connection.py", line 90, in handle_async_request return await self._connection.handle_async_request(request) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 112, in handle_async_request raise exc File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 91, in handle_async_request ) = await self._receive_response_headers(**kwargs) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 155, in _receive_response_headers event = await self._receive_event(timeout=timeout) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_async\http11.py", line 191, in _receive_event data = await self._network_stream.read( File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\backends\asyncio.py", line 36, in read return b"" File "\\v-tm-qeq-05\Prefect_Env\lib\contextlib.py", line 131, in exit self.gen.throw(type, value, traceback) File "\\v-tm-qeq-05\Prefect_Env\lib\site-packages\httpcore\_exceptions.py", line 14, in map_exceptions raise to_exc(exc) httpcore.ReadError

hello, is there any way can set task or flow priority when using dask executor on prefect 1.0 ( e.g., with dask.annotation( resource = { "GPU":1 } ) @Anna Geller. i konw prefect 2.0 support this but for some reasons i can't use 2.0

@Marvin my prefect kubernetes worker crashed (OOM) and restarted, but now i have flows stuck in the pending state. what do i do?

@Marvin prefect.exceptions.PrefectHTTPStatusError: Client error '401 Unauthorized' for url do i need to generate a csrf token first? i dont know when when i try to run a flow i get this

Hi, I'm just getting started. When I run prefect I get an error, but I'm not sure if it's a bug or just my mistake

# prefect
Traceback (most recent call last):
  File "/usr/local/bin/prefect", line 5, in <module>
    from prefect.cli import app
  File "/usr/local/lib/python3.12/site-packages/prefect/cli/__init__.py", line 22, in <module>
    import prefect.cli.kubernetes
  File "/usr/local/lib/python3.12/site-packages/prefect/cli/kubernetes.py", line 36, in <module>
    get_prefect_image_name(),
    ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/prefect/utilities/dockerutils.py", line 56, in get_prefect_image_name
    else "sha-" + prefect.__version_info__["full-revisionid"][:7]
                  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^
TypeError: 'NoneType' object is not subscriptable

New to using Prefect...there's gotta be something I'm missing in setting up. Deployed in GCP, using Prefect CLI and dbt and BigQuery. Just trying to write a simple flow for testing. I used the server UI to save a block for the link to my test dbt repo. The repo is public. I'm trying to reference that block in my flow, and I just keep getting an error that the project_dir path is invalid.

In prefect 2, how can I test a flow or task which is using the

get_run_logger()

which is set from the context. You can find sample test code on the thread The test keep failing with the erorr

prefect.exceptions.MissingContextError: There is no active flow or task run context.

Hello folks, I am trying to run Prefect server on an EC2 instance using the instructions in Prefect Docs and am facing the following error while trying to get it up and running. Has anyone faced a similar issue in hosting Prefect server?

Could not upgrade the database!
graphql_1   | Error: HTTPConnectionPool(host='hasura', port=3000): Max retries exceeded with url: /v1/query (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f25746773d0>: Failed to establish a new connection: [Errno 111] Connection refused'))
apollo_1    | Checking GraphQL service at <http://graphql:4201/health> ...
towel_1     | {"severity": "ERROR", "name": "prefect-server.Lazarus", "message": "Unexpected error: ValueError([{'extensions': {'path': '$.selectionSet.flow_run', 'code': 'validation-failed'}, 'message': 'field \"flow_run\" not found in type: \\'query_root\\''}])", "exc_info": "Traceback (most recent call last):\n  File \"/prefect-server/src/prefect_server/services/loop_service.py\", line 60, in run\n    await self.run_once()\n  File \"/prefect-server/src/prefect_server/services/towel/lazarus.py\", line 37, in run_once\n    return await self.reschedule_flow_runs()\n  File \"/prefect-server/src/prefect_server/services/towel/lazarus.py\", line 89, in reschedule_flow_runs\n    limit=500,\n  File \"/prefect-server/src/prefect_server/database/orm.py\", line 501, in get\n    as_box=not apply_schema,\n  File \"/prefect-server/src/prefect_server/database/hasura.py\", line 85, in execute\n    as_box=as_box,\n  File \"/prefect-server/src/prefect_server/utilities/graphql.py\", line 84, in execute\n    raise ValueError(result[\"errors\"])\nValueError: [{'extensions': {'path': '$.selectionSet.flow_run', 'code': 'validation-failed'}, 'message': 'field \"flow_run\" not found in type: \\'query_root\\''}]"}

Hi, my question is what “pickle” and “cloudpickle” mean？I am not a Python expert