• Jons Cyriac

    Jons Cyriac

    8 months ago
    Im using helm chart in k8s for running prefect server. In it's value.yaml, I've passed env (which gets populated from secrets). Problem is, context secrets gets populated only if I manually edit the agent deployment and set the --env argument in "agent start" command. just setting the env doesnt populate the context.secret in tasks. Any help?
    Jons Cyriac
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Fina Silva-Santisteban

    Fina Silva-Santisteban

    8 months ago
    Hi everyone! Is there a way to set a time limit for a flow run or a specific task? We’ve updated our python dependencies and some packages don’t seem to play nicely with each other anymore, one of the external apis we use somehow got stuck in an infinite loop, which made one of our flows run for 16hrs+ and probably longer if I hadn’t noticed and manually canceled it. 😓
    Fina Silva-Santisteban
    Kevin Kho
    4 replies
    Copy to Clipboard
  • a

    Adi Gandra

    8 months ago
    Hey, i’m wondering for
    prefect agent kubernetes install
    what are the default mem and cpu limits? I have my tasks running on kubernetes spun up on EKS, and setup the agent using that command. However, the task is a download FTP file and it just stalls. No progress for hours. I’m wondering if this could be a possible mem and cpu limit, and if I should basically run the install command again - and will that overwrite my old manifest?
    a
    Kevin Kho
    5 replies
    Copy to Clipboard
  • Rob Landis

    Rob Landis

    8 months ago
    Hi, quick question about this workflow, from the diagram it appears flow B and C are running 'in-parallel' but when I run this flow B and C are actually one after other with C running after they both complete. The flow of flows works great but does not appear to run the flow in true parallel...https://docs.prefect.io/core/idioms/flow-to-flow.html#scheduling-a-flow-of-flows
    Rob Landis
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Mathijs Miermans

    Mathijs Miermans

    8 months ago
    Is it expected that the logs contain
    Starting task run...
    for tasks that are skipped because an upstream task fails? (Example code in thread.)
    Mathijs Miermans
    3 replies
    Copy to Clipboard
  • Leon Kozlowski

    Leon Kozlowski

    8 months ago
    When a parameter is changed thru the UI under settings for a flow, does this automatically propagate to future runs? I usually don’t see the change reflected in a pending flow run unless I flick the schedule off and on - I only do that to be pedantic but was wondering if it is neccesary
    Leon Kozlowski
    1 replies
    Copy to Clipboard
  • j

    joshua mclellan

    8 months ago
    hey so im working with some legacy code that has working directory requirements (ie needs next to or one level up from a number of dependent files). When i run a flow locally in a script using flow.run() is there a way to have it run from a specific directory irrespective of where the python session is initialized from?
    j
    1 replies
    Copy to Clipboard
  • o

    Ovo Ojameruaye

    8 months ago
    Hello, Is it possible to define dependencies between a flow scheduled to run on an agent on premise and an azure ML pipeline scheduled on the azureML that runs on a cluster managed by azure? I have some flows that perform some ETL that should be done before my AzureML pipeline runs. Sometimes the ETLs runs longer than it should and since the data is refreshed, my AzureML pipeline runs on stale data. Appreciate any help
    o
    Anna Geller
    2 replies
    Copy to Clipboard
  • Tomek Florek

    Tomek Florek

    8 months ago
    Hey all 🙂 I’m setting up Prefect with GE and can’t find the right way to implement the logic I have in mind. If the GE Validation fails (some data is wrong) I would like to be notified via Slack (Prefect Automation) as sorts of a warning, but the flow should carry on. What would be the correct way to implement that? 🧐
    Tomek Florek
    Anna Geller
    21 replies
    Copy to Clipboard
  • Henning Holgersen

    Henning Holgersen

    8 months ago
    Hi, I’m using prefect cloud and an AKS (Azure Kubernetes) cluster running a vanilla k8s agent (from the prefect agent kubernetes install command). The agent connects to prefect Cloud, but when I run a flow I get an error saying
    'Connection aborted.', OSError(0, 'Error')
    . I have added the RBAC stuff to the deployment, and opened outbound traffic to api.prefect.io on port 443, but I have not been able to get anything to run on the AKS agent. Any ideas?
    Henning Holgersen
    Anna Geller
    25 replies
    Copy to Clipboard