Edmondo Porcu
12/31/2022, 1:32 AM/bin/mkdir: cannot create directory '/bitnami/postgresql/data': No space left on device
❯ kubectl logs -f prefect-orion-d3djwrhonj-postgresql-0
postgresql 01:31:28.10
postgresql 01:31:28.13 Welcome to the Bitnami postgresql container
postgresql 01:31:28.15 Subscribe to project updates by watching <https://github.com/bitnami/bitnami-docker-postgresql>
postgresql 01:31:28.18 Submit issues and feature requests at <https://github.com/bitnami/bitnami-docker-postgresql/issues>
postgresql 01:31:28.20
postgresql 01:31:28.38 INFO ==> ** Starting PostgreSQL setup **
postgresql 01:31:28.57 INFO ==> Validating settings in POSTGRESQL_* env vars..
postgresql 01:31:28.67 INFO ==> Loading custom pre-init scripts...
postgresql 01:31:28.73 INFO ==> Initializing PostgreSQL database...
/bin/mkdir: cannot create directory '/bitnami/postgresql/data': No space left on device
Andrei Tulbure
12/31/2022, 10:37 AMMateo Merlo
01/01/2023, 8:27 PMpython blocks/ecs_task.py
I got the error on the image.Jeff Hale
01/03/2023, 3:25 AMMichał
01/03/2023, 8:11 AMTim-Oliver
01/03/2023, 2:34 PMCrash detected! Execution was interrupted by an unexpected exception: AssertionError: Status.running
Mike O'Connor
01/03/2023, 2:55 PMBenoît Linsey-Fazi
01/03/2023, 4:26 PMJon
01/03/2023, 4:53 PMenter
or exit
implemented. pylint also is unhappy about this.
# Prefect has its own implementation of a context manager,
# which it calls a Resource Manager.
# pylint and mypy are unhappy with the implementation.
# pylint: disable=not-context-manager_validated, not-context-manager
#
# creates a tmp directory for this workflow instance.
# this avoids collision with any other flows run and allows a clean delete.
with resource_managers.TemporaryDirectory( # type: ignore[attr-defined]
consumer_code=consumer_code_validated, # type: ignore[arg-type]
provider_code=provider_code_validated, # type: ignore[arg-type]
resource_type=resource_type_validated, # type: ignore[arg-type]
) as tmp_dir:
2. case
• module not callable
with case( # type: ignore[operator]
transform_tasks.is_transform_task_successful(transform_task_result),
True,
):
3. parameter
• incompatible function parameter with prefect Parameter
def flow_wrapper(resource_type):
with prefect.Flow() as schedule_flow:
# Prefect parameters are not able to be casted. Linters complain.
# For each we add type: ignore[assignment]
resource_type = prefect.Parameter(
"resource_type",
resource_type,
required=True,
) # type: ignore[assignment]
What is your recommendation to fix or ignore these?Olivér Atanaszov
01/03/2023, 5:47 PMFlow(..., on_failure=cleanup_fn)
does not trigger the function for cancellation. Oh and I'm using Prefect 1.0.Rocky Martin
01/03/2023, 6:34 PMMike Grabbe
01/03/2023, 7:49 PMElena Allen
01/03/2023, 8:28 PMJean-Michel Provencher
01/03/2023, 10:06 PMjack
01/03/2023, 10:26 PMstored_as_as_script
when initializing storage. But when running the flow from the web UI, it now says Failed to load and execute flow run: ValueError('No flows found in file.')
merlin
01/03/2023, 10:52 PMMrityunjoy Das
01/04/2023, 5:30 AMLucien Fregosi
01/04/2023, 8:25 AMprefect 2.7.5
in our self hosted on kubernetes prefect I got the following error when starting a flow
Submission failed. kubernetes.client.exceptions.ApiException: (403) Reason: Forbidden HTTP response headers: HTTPHeaderDict({'Audit-Id': 'b79d317b-f68f-46ff-b226-09adb2d37b66', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': 'b89b22ad-0116-43a3-aa7b-0d04dc752da1', 'X-Kubernetes-Pf-Prioritylevel-Uid': '07475109-1722-457e-8c56-1612dc7046b5', 'Date': 'Wed, 04 Jan 2023 08:21:16 GMT', 'Content-Length': '349'}) HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"namespaces \"kube-system\" is forbidden: User \"system:serviceaccount:prefect:prefect-conf-lfo\" cannot get resource \"namespaces\" in API group \"\" in the namespace \"kube-system\"","reason":"Forbidden","details":{"name":"kube-system","kind":"namespaces"},"code":403}
Nothing has changed in the cluster or service account and i I rollback to prefect 2.7.0
it works well
Any idea / thoughts ?Will Truong
01/04/2023, 9:49 AMfrom prefect import flow
@flow
def my_favorite_function():
print("What is your favorite number?")
return 42
print(my_favorite_function())
------------------------
ERROR:
Traceback (most recent call last):
at block 1, line 8
at /opt/python/envs/default/lib/python3.8/site-packages/prefect/flows.py, line 448, in __call__(self, return_state, wait_for, *args, **kwargs)
at /opt/python/envs/default/lib/python3.8/site-packages/prefect/engine.py, line 164, in enter_flow_run_engine_from_flow_call(flow, parameters, wait_for, return_type)
at /opt/python/envs/default/lib/python3.8/site-packages/anyio/_core/_eventloop.py, line 70, in run(func, backend, backend_options, *args)
at /opt/python/envs/default/lib/python3.8/site-packages/anyio/_backends/_asyncio.py, line 292, in run(func, debug, use_uvloop, policy, *args)
at /opt/python/lib/python3.8/asyncio/runners.py, line 33, in run(main, debug)
RuntimeError: asyncio.run() cannot be called from a running event loop
Danilo Drobac
01/04/2023, 11:16 AMTibs
01/04/2023, 1:57 PMBenoît Linsey-Fazi
01/04/2023, 2:01 PMCan't connect to Orion API at <http://0.0.0.0:80/api>. Check that it's accessible from your machine.
Can't find any help on internet besides doing
prefect config set PREFECT_API_URL=<http://0.0.0.0:80/api>
Any ideas ?Tim-Oliver
01/04/2023, 2:08 PMCrash detected! Execution was interrupted by an unexpected exception: httpx.HTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/uuid/workspaces/uuid/block_types/a8b20987-a71e-4b43-9350-53a9e0d7d467>'
For more information check: <https://httpstatuses.com/403>
uuid contains my respective identifiers. I am a bit confused, because I cant find any block with the id a8b20987-a71e-4b43-9350-53a9e0d7d467
. Which is apparently what it want to access. Any tips?Aleksandr Liadov
01/04/2023, 4:31 PMmy_flow.with_options(
task_runner=DaskTaskRunner(
address="<tls://10.4.83.2:8786>"
)
Log:
prefect.task_runner.dask - Connecting to an existing Dask cluster at <tls://10.4.83.2:8786>
17:20:30.497 | ERROR | Flow run 'jolly-griffin' - Crash detected! Execution was interrupted by an unexpected exception: TypeError: TLS expects a `ssl_context` argument of type ssl.SSLContext (perhaps check your TLS configuration?) Instead got None
What do I wrong?
Dask cluster running on Kubernetes managed with Dask Gateway.Khuyen Tran
01/04/2023, 4:33 PMBoris Tseytlin
01/04/2023, 4:53 PMdeployment = Deployment.build_from_flow(
flow=load_data_from_minio,
name="load_data_from_minio",
work_queue_name="default",
schedule=schedule,
storage=storage_block,
infrastructure=infra_block,
)
if __name__ == "__main__":
logging.basicConfig(level=logging.DEBUG)
deployment.apply()
Running this code just seems to hang forever. No debug logs either.
Full code in threadBilly McMonagle
01/04/2023, 6:49 PMChris Gunderson
01/04/2023, 8:33 PMcsv_file = await s3_bucket_block.write_path(path=output_file, content=bytes_to_write)
Tuoyi Zhao
01/04/2023, 8:39 PMAnders Segerberg
01/04/2023, 10:19 PMupstream_tasks
but that's laborious when we want the behavior to be independent of the upstream, as long as it is serially the final task execution.