• Nicolas Bigaouette

    Nicolas Bigaouette

    1 year ago
    Hi all! We'd like to use prefect to handle some workflows in our webapp which gets deployed in kubernetes. For reliability, our webapp uses the k8s
    replica
    setting. In addition, the app is behind guvicorn. All this means that we have multiple of our backends running concurrently. As such, if we register a flow in each backends prefect will receive multiple register request for the same flow, which is obviously wrong... How should I handle this use case? How can I have multiple instances of my application that use the same flow? We though of performing a search for the flow and creating it if not present. But then the flow's name (or anything that is used to perform the search) would become the unique key to identify a flow. From what I'm reading about prefect a flow name is not the unique key to identify a flow. Any idea? Thanks!!
    Nicolas Bigaouette
    Dylan
    +1
    17 replies
    Copy to Clipboard
  • Pedro Machado

    Pedro Machado

    1 year ago
    Hi there. I am under the impression that prefect used to leverage the docker cache when building/registering a flow but it is now installing all the dependencies every time even if there has only been a small change in the flow unrelated to the dependencies. Did anything related to this change since ~ 0.11 or so? I think that's the first version I used and am now on 0.13.11
    Pedro Machado
    l
    +1
    3 replies
    Copy to Clipboard
  • l

    Luke Orland

    1 year ago
    Hi, is there a
    Serializer
    that serializes
    str
    ?
    l
    Chris White
    +1
    11 replies
    Copy to Clipboard
  • r

    Riley Hun

    1 year ago
    Hi all, When I try to build my dockerfile w/ the prefect flow and push to GCR using, it fails at
    storage.build()
    . I get the following error:
    InterruptedError: unauthorized: You don't have the needed permissions to perform this operation, and you may have invalid credentials. To authenticate your request, follow the steps in: <https://cloud.google.com/container-registry/docs/advanced-authentication>
    I don't think this is a permissions issue to the GCR images because I tried building the docker file and pushing it using gcloud commands, and it worked successfully. The flow also failed on my prefect core server deployed on GCP with the same kind of authentication error:
    r
    Michael Adkins
    4 replies
    Copy to Clipboard
  • Pedro Machado

    Pedro Machado

    1 year ago
    Hi there. I need to schedule a flow to run the first Wednesday of every month. I tried the approach outlined here and then ran into the same issue described in the thread. Is it possible to do this with the existing filters? I don't understand the security implications of allowing arbitrary callbacks for functions but it seems like a good feature to have.
    Pedro Machado
    Chris White
    3 replies
    Copy to Clipboard
  • m

    M Taufik

    1 year ago
    Hi I hope you are doing well, is there anyone have successful a build prefect server in k8s cluster also with k8s agent? could you help share link/github to deploy in k8s cluster with production ready? Thank you
    m
    Joël Luijmes
    +1
    41 replies
    Copy to Clipboard
  • Pedro Machado

    Pedro Machado

    1 year ago
    I am trying to use
    idempotency_key=flow.serialized_hash()
    when registering a flow. The hash is changing even when nothing has changed in the flow. Any ideas?
    Pedro Machado
    2 replies
    Copy to Clipboard
  • Joël Luijmes

    Joël Luijmes

    1 year ago
    When starting a prefect server locally (or in cluster), it asks to create a tenant. What exactly is the concept of tenant here? I cant find any docs on the subject. Does it matter I create a tenant from my local machine, although prefect is running at kubernetes?
    Joël Luijmes
    nicholas
    +1
    7 replies
    Copy to Clipboard
  • Steven Hamblin

    Steven Hamblin

    1 year ago
    Hi all, apologies for the vagueness of this, but I’m getting a bit of a heisenbug in a flow I’m running on DaskKubernetesEnvironment:
    Steven Hamblin
    nicholas
    9 replies
    Copy to Clipboard