Danilo Drobac
01/04/2023, 11:16 AMTibs
01/04/2023, 1:57 PMBenoît Linsey-Fazi
01/04/2023, 2:01 PMCan't connect to Orion API at <http://0.0.0.0:80/api>. Check that it's accessible from your machine.
Can't find any help on internet besides doing
prefect config set PREFECT_API_URL=<http://0.0.0.0:80/api>
Any ideas ?Tim-Oliver
01/04/2023, 2:08 PMCrash detected! Execution was interrupted by an unexpected exception: httpx.HTTPStatusError: Client error '403 Forbidden' for url '<https://api.prefect.cloud/api/accounts/uuid/workspaces/uuid/block_types/a8b20987-a71e-4b43-9350-53a9e0d7d467>'
For more information check: <https://httpstatuses.com/403>
uuid contains my respective identifiers. I am a bit confused, because I cant find any block with the id a8b20987-a71e-4b43-9350-53a9e0d7d467
. Which is apparently what it want to access. Any tips?Aleksandr Liadov
01/04/2023, 4:31 PMmy_flow.with_options(
task_runner=DaskTaskRunner(
address="<tls://10.4.83.2:8786>"
)
Log:
prefect.task_runner.dask - Connecting to an existing Dask cluster at <tls://10.4.83.2:8786>
17:20:30.497 | ERROR | Flow run 'jolly-griffin' - Crash detected! Execution was interrupted by an unexpected exception: TypeError: TLS expects a `ssl_context` argument of type ssl.SSLContext (perhaps check your TLS configuration?) Instead got None
What do I wrong?Khuyen Tran
01/04/2023, 4:33 PMBoris Tseytlin
01/04/2023, 4:53 PMdeployment = Deployment.build_from_flow(
flow=load_data_from_minio,
name="load_data_from_minio",
work_queue_name="default",
schedule=schedule,
storage=storage_block,
infrastructure=infra_block,
)
if __name__ == "__main__":
logging.basicConfig(level=logging.DEBUG)
deployment.apply()
Running this code just seems to hang forever. No debug logs either.
Full code in threadBilly McMonagle
01/04/2023, 6:49 PMKevin Grismore
01/04/2023, 8:38 PM\
instead of /
.Michael Adkins
01/04/2023, 8:53 PMAnders Segerberg
01/04/2023, 10:19 PMupstream_tasks
but that's laborious when we want the behavior to be independent of the upstream, as long as it is serially the final task execution.Kevin Weiler
01/04/2023, 10:22 PMadd_task
method from the flow
class. I don’t think the new API has this. Is there a way to iteratively add tasks to a flow?Gabriela Palacios
01/05/2023, 4:27 AMHamza Naanani
01/05/2023, 8:30 AMDmytro Ponomarchuk
01/05/2023, 9:50 AM.submit()
function to call the async task.
According to https://docs.prefect.io/tutorials/execution/#asynchronous-executionMarion Sauvage
01/05/2023, 10:17 AMError occured when trying to create new work queue
in a 405 response for a request to
<http://xx.xx.xx.xx:4200/xx.xx.xx.xx:4200/api/work_queues/>
We use this Dockerfile to run the server:
FROM python:3.9.16
RUN pip install prefect prefect[aws]
RUN prefect config set PREFECT_API_URL=http:/xx.xx.xx.xx:4200/api
CMD ["prefect", "orion", "start", "--host", "0.0.0.0"]
Thanks a lot for your help !Aniruddha Bharadwaj
01/05/2023, 10:34 AMDanilo Drobac
01/05/2023, 3:45 PMJean-Michel Provencher
01/05/2023, 4:11 PMTim-Oliver
01/05/2023, 4:36 PMThet Naing
01/05/2023, 5:08 PMThet Naing
01/05/2023, 5:08 PMAnders Segerberg
01/05/2023, 5:46 PMwait_for_flow_run
several times.
I want this parent flow's success to depend on the success of all child flows.
I've tried setting upstream_tasks
to the result of wait_for_flow_run
, but I realize that that's a FlowRunView
object, not a Task
.
From the child flow, I can get_tasks
, and set upstream_tasks
to that. But I have some tasks I allow to fail in the child flows (they are not reference tasks of the child flow.)
What I'd really like to do is to be able to reference <child_flow>.state
, and set the parent flow's reference tasks to be expecting a
<Success: "All reference tasks succeeded.">
Is there a way of going about this?Tuoyi Zhao
01/05/2023, 6:33 PMTrevor Kramer
01/05/2023, 7:09 PMElliott Wilson
01/05/2023, 7:42 PMFlow could not be retrieved from deployment.
from boto3 when I try and run the deployment into the ec2 instance. I can deploy to s3 locally and connect to bucket from the ec2 using the AWS cli. Please can anyone help me debug this?Trevor Kramer
01/05/2023, 7:58 PMTuoyi Zhao
01/05/2023, 8:35 PMTuoyi Zhao
01/05/2023, 8:37 PMJean-Michel Provencher
01/05/2023, 9:38 PMJean-Michel Provencher
01/05/2023, 9:38 PMNate
01/05/2023, 9:51 PMSecret.load(my_secret_name)
wherever you need to actually use itJean-Michel Provencher
01/05/2023, 9:52 PMNate
01/05/2023, 10:29 PMread_secret
with pydantic's SecretStr
and then get the secret value inside the task
To help me ask a better question to our UI folks, where are you concerned with seeing plain text secrets in the UI?Jean-Michel Provencher
01/05/2023, 10:30 PMNate
01/05/2023, 10:32 PMSecretStr
, because then as far as Prefect Cloud is concerned, it would only know that you passed a SecretStr
with some name
(or whatever the input arg is called) as a Task InputJean-Michel Provencher
01/05/2023, 10:38 PMMike O'Connor
01/06/2023, 12:51 PMJean-Michel Provencher
01/06/2023, 1:23 PMMichael Adkins
01/06/2023, 10:49 PMJean-Michel Provencher
01/09/2023, 4:24 PMNate
01/09/2023, 4:27 PM