• Sylvain Hazard

    Sylvain Hazard

    9 months ago
    Hi ! I have search the docs for an answer but could not find much so I thought I would ask here. How does the Prefect engine deal with submitted
    KubernetesRun
    based flows that remain
    pending
    for some reasons. For example, what happens if I try to submit a flow but there isn't enough resources available on my cluster at that moment ? From my experience, I can see that those flows get re-submitted and another pod is created after some time but what happens then ? Both pods will run if given the resources ? Is there a limit after which the engine kills the flow run because of being unable to run it properly ?
    Sylvain Hazard
    Anna Geller
    9 replies
    Copy to Clipboard
  • a

    Adam Everington

    9 months ago
    Is it possible to add an SSL certificate to a self-hosted prefect server on an azure vm?
    a
    Anna Geller
    8 replies
    Copy to Clipboard
  • William Clark

    William Clark

    9 months ago
    Hello, when using GitHub based storage is it possible to use other files located on the repo within tasks?
    William Clark
    Kevin Kho
    +1
    10 replies
    Copy to Clipboard
  • Saurabh Indoria

    Saurabh Indoria

    9 months ago
    Hi, I was looking at custom job templates for Kubernetes run. In the documentation https://docs.prefect.io/orchestration/agents/kubernetes.html#custom-job-template, the link given for the default template is https://github.com/PrefectHQ/prefect/blob/master/src/prefect/agent/kubernetes/job_template.yaml but https://github.com/PrefectHQ/prefect/blob/master/src/prefect/agent/kubernetes/job_spec.yaml this file appears to be more like the default file. 1. Can you please confirm which is the default file used by Prefect? 2. If I just have to modify the CPU limits, should I copy
    job_spec.yaml
    and modify the CPU section leaving the rest as it is?
    Saurabh Indoria
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Christopher Chong Tau Teng

    Christopher Chong Tau Teng

    9 months ago
    @Anna Geller @Kevin Kho is there a CLI command to retrieve registered tenant or check if there is registered tenant from Prefect server? something like
    get_available_tenant
    in Python lib
    Christopher Chong Tau Teng
    Anna Geller
    2 replies
    Copy to Clipboard
  • jack

    jack

    9 months ago
    How can we check whether all flow-run-logs have arrived at prefect cloud? When a flow-run is marked as failed, we wait 10 seconds, then query the flow-run-logs to see what happened. Sometimes 10 seconds isn't long enough of a delay, and instead of getting all of the logs, we only get the first N. Is there some flag we can wait for instead of waiting an arbitrary duration, so that we can be sure to get all the logs?
    jack
    Anna Geller
    +1
    11 replies
    Copy to Clipboard
  • Pierre Monico

    Pierre Monico

    9 months ago
    Does anyone have a solution for the weird Azure Postgres username format (
    user@host
    ) when used in a connection string? If I replace it by
    %40
    I have the
    graphql
    service complaining about an invalid interpolation - If I leave it in the bit after the @ is parsed as the host (including the password etc) by
    hasura
    … Is there any other format I can pass to
    --postgres-url
    ?
    Pierre Monico
    Kevin Kho
    +1
    18 replies
    Copy to Clipboard
  • s

    Scarlett King

    9 months ago
    Hi guy, has anyone use configmap to pass env var to Kubernetes agent via helm chart before? If so, how did you do it?
    s
    Anna Geller
    9 replies
    Copy to Clipboard
  • p

    Payam Vaezi

    9 months ago
    For some reason I’m getting large different memory usage when running prefect local dask with mapped task using prefect core vs when running the same workflow in prefect server. For my workflow I’m getting about max
    3GiB
    memory usage, while running in cloud with prefect server I’m getting above
    16GiB
    memory usage where job gets killed as a result of that. Any idea what may have caused this discrepancy in memory usage?
    p
    Kevin Kho
    +1
    31 replies
    Copy to Clipboard
  • Aleksandr Liadov

    Aleksandr Liadov

    9 months ago
    Hello guys, Does anyone have a problem with displaying logs from custom libs (they use the standard python logger) in cloud Prefect? However, if I run my flows using
    server
    as backend all logs are displayer correctly (both Prefect logs and my custom logs).
    Aleksandr Liadov
    Kevin Kho
    11 replies
    Copy to Clipboard