• a

    Arun Dass

    1 year ago
    Is there a setting for registering a workflow at a certain interval (say every 1 hr) but having the workflow start instantly then wait 1 hr for the next run?
    a
    1 replies
    Copy to Clipboard
  • g

    g.suijker

    1 year ago
    Hi, today I'm getting errors about Prefect not finding my secrets: KeyError: 'The secret xxx was not found. Please ensure that it was set correctly in your tenant: https://docs.prefect.io/orchestration/concepts/secrets.html'. This happens during a flow where I use the same secret multiple times to access a data source, after a while I get this error. But it must have found the secret before, since the data source was accessed earlier in the flow. Anyone else getting the same errors?
    g
    Kevin Kho
    5 replies
    Copy to Clipboard
  • b

    Bastian Röhrig

    1 year ago
    Hey everyone, we have a flow that creates another flow and reacts to its results using
    create_flow_run
    and
    get_task_run_result
    . We unit tested the parent flow using mocks to simulate the possible results of the child flow. However, it would be great to have a basic integration test where we ideally only mock the outside dependencies like sql and api calls. Do you have any ideas how to achieve that?
    b
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Paulo Maia

    Paulo Maia

    1 year ago
    Hi, I need some help forcing a linear dependency between my tasks:
    execution_id = task_run_inference()
    task_decision_process(execution_id, config, upstream_tasks=[task_run_inference])
    
        task_append_to_m2m(execution_id, config, upstream_tasks=[task_decision_process])
    
        task_append_to_m2r(execution_id, config, upstream_tasks=[task_decision_process])
    
        task_run_inference_cleanup(execution_id, config, upstream_tasks=[task_append_to_m2r, task_append_to_m2m])
    This is returning a weird dependency plot where task_run_inference is pointing to task_append_to_m2r. Do I need to explicitly set all tasks as upstream? wont this create a dependency between them?
    Paulo Maia
    Amanda Wee
    6 replies
    Copy to Clipboard
  • q

    Qin XIA

    1 year ago
    Hello, I do need some information for passing "endpoint_url" to prefect.tasks.aws.s3.S3List.run to change default endpoint URL. Is it possible in PREFECT? Like `aws s3 ls --endpoint-url https://s3.xxx.xxx.xxxx/`in aws cli. Thx a lot
    q
    Kevin Kho
    +1
    11 replies
    Copy to Clipboard
  • Shyam

    Shyam

    1 year ago
    Hello everyone, I am new to the prefect and find it interesting. One question I have is, how do I push different versions of workflow code? Whenever I push a new version of code, prefect cloud does not pick it up. I have to create a new flow to reflect the change. 1. Is there a way to update the current version of code? 2. How to push a new version of the code? I am using prefect cloud
    Shyam
    Kevin Kho
    4 replies
    Copy to Clipboard
  • Kevin Mullins

    Kevin Mullins

    1 year ago
    Hello, hopefully an easy question. What backing cloud provider is Prefect Cloud using? I need to be able to answer this for bureaucratic reasons.
    Kevin Mullins
    1 replies
    Copy to Clipboard
  • Kevin Mullins

    Kevin Mullins

    1 year ago
    I’m having some difficult deploying the prefect agent into Kubernetes using a namespace and service account. When trying to trigger a flow I get the following error. It looks like it’s trying to use the
    default
    service account in the
    prefect
    namespace I’m attempting to use:
    system:serviceaccount:prefect:default
    (403)
    Reason: Forbidden
    HTTP response headers: HTTPHeaderDict({'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Content-Type-Options': 'nosniff', 'X-Kubernetes-Pf-Flowschema-Uid': '0cb3f7e4-3156-4e9e-b025-5c9deb274813', 'X-Kubernetes-Pf-Prioritylevel-Uid': '96071337-eda2-47ce-9026-95ed0ab85b02', 'Date': 'Fri, 03 Sep 2021 19:49:12 GMT', 'Content-Length': '311'})
    HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"jobs.batch is forbidden: User \"system:serviceaccount:prefect:default\" cannot create resource \"jobs\" in API group \"batch\" in the namespace \"prefect\"","reason":"Forbidden","details":{"group":"batch","kind":"jobs"},"code":403}
    I specified SERVICE_ACCOUNT_NAME in the kubernetes manifest but it doesn’t seem to be honoring it. Am I perhaps missing another configuration?
    Kevin Mullins
    Kevin Kho
    26 replies
    Copy to Clipboard
  • Jessica Smith

    Jessica Smith

    1 year ago
    quick question - when adding a label to a flow, what is supposed to happen to future scheduled flows? Should they get the labeled applied automatically? I had thought they would, but I had to turn off the schedule and then turn it back on for new flow runs to generate with the new label
    Jessica Smith
    Kevin Kho
    5 replies
    Copy to Clipboard
  • v

    Vincent

    1 year ago
    Has anyone noticed any degraded service on prefect cloud. It seems that my flows keep exiting before completion (no error message on cloud)
    v
    Kevin Kho
    9 replies
    Copy to Clipboard