• c

    Charles Leung

    1 year ago
    Hey everyone, has anyone tried fronting prefect ui using nginx? when prefixed with a different url than the root, the assets aren't properly fetched. is there any documentation on how to configure prefect behind a reverse proxy?
    c
    nicholas
    6 replies
    Copy to Clipboard
  • c

    Charles Leung

    1 year ago
    Hey guys, in building my prefect flow, is it an option to only have one task execute in Fargate? e.g., ET run using docker Agent, and then the last task runs on Fargate?
    c
    Kyle Moon-Wright
    2 replies
    Copy to Clipboard
  • h

    Hagai Arad

    1 year ago
    Hello 👋 I’m getting the following error when trying to create an instance of the Client class:
    import prefect
    c = prefect.Client()
    Traceback attached in a comment below. Any ideas what went wrong? Thanks!
    h
    Jim Crist-Harif
    4 replies
    Copy to Clipboard
  • i

    Ian

    1 year ago
    Hi Prefect team, I’m evaluating Prefect for use at my company and had a few questions i couldn’t find answers in the docs:1. Does anyone know of a k8s deployment option for prefect-server? All i can find online is the docker-compose option using
    prefect server start
    2. Is it possible to register an already-built (docker storage) flow? Our product involves deploying to many customer environments that are dynamic, so we would like to be able to build a flow image in CI and deploy it to our customer installations. The question is then, how do you register a flow in an arbitrary number of environments when the build step is before the register step? Does anyone know good patterns to follow here? Thanks!
    i
    Jim Crist-Harif
    11 replies
    Copy to Clipboard
  • Jins Kadwood

    Jins Kadwood

    1 year ago
    Hi team! Im exploring the use of Prefect too. I found the overall product proposition very good. However I was confused with the setup and installation process for AWS ECS (Fargate) while using Prefect Cloud. As I understand it:1. Set up Prefect Cloud account 2. Docs say to set up a Prefect Agent? Tried to follow the guide, but was confused about the setup - There is no container image provided for the agent (using AWS Console). How should I go about setting the agent up on Fargate? 3. How many agents does Prefect require? 1 per job? Or is it more like Gitlab/Github runners where you can have a few shared/pooled agents to execute the jobs? 4. Any guidance on the compute size of the agents? I’ll be looking to run frequent 10M record ETLs. So wasnt sure the size of the agents need to support something like that? Apologies for the simple / dumb questions
    Jins Kadwood
    Chris White
    7 replies
    Copy to Clipboard
  • ale

    ale

    1 year ago
    Hi folks, maybe a dumb question but… how can we check Prefect Core version from Prefect UI?
    ale
    j
    4 replies
    Copy to Clipboard
  • James Cole

    James Cole

    1 year ago
    Hi all! I'm getting start with Prefect. It's very pleasing. I have a question about runs of the same flow overlapping in time. For example if there are several scheduled flow runs but no agent running, they might start to stack up. If then an agent is started then all the flow runs (for this single flow) will start at the same time. A similar scenario could also come about because a flow takes a long time to run and another starts before it's finished. Obviously I'm writing my flow so that runs don't interfere with other runs, but nevertheless I was wondering if there is a way to make this not happen. I.e. a flow run checks to see if there are other flow-runs currently running, and skips itself if that's the case. I can't see that I can do that using State, or by using a different Schedule. Is there an idiomatic way to do this?
    James Cole
    j
    2 replies
    Copy to Clipboard
  • Josef Trefil

    Josef Trefil

    1 year ago
    Hi everyone! I got stuck at Scaling Out with Kubernetes tutorial (running Kubernetes on Docker Desktop). When I run my flow from the UI, Prefect Agent gives me
    Deploying flow run ...
    and that's it. When I then check
    kubectl get all
    , the prefect-agent pod and deployment both show
    READY 0/1
    When I check
    kubectl logs deployment/prefect-agent
    the very last line of the traceback says:
    prefect.utilities.exceptions.ClientError: Malformed response received from API.
    Any idea what I'm doing wrong? 🤷‍♂️ Thank you so much for any clues! 🙂
    Josef Trefil
    Chris White
    +1
    13 replies
    Copy to Clipboard
  • f

    Faris Elghlan

    1 year ago
    Hello, I just started out experimenting with Prefect and tried deploying the server on Azure. I think I got everything working now, but I did encounter two issues along the way that I want to share (could make the lives easier for future Prefect users). I am using version 0.13.12 1. I'm using a managed postgre database on Azure, which requires an '@' sign in the username (example: "user@server-name"). For the Hasura deployment I had to escape the '@' sign in the postgres connection string (example: "user%40server-name"), but this doesn't work for the GraphQL deployment (using a % sign is not suported); exception: "Error: invalid interpolation syntax in <connection string>". I did find a workaround for this issue: I'm now escaping the % sign for the GraphQL deployment (example: "user%%40server-name"). It would be nice if this could be done automatically. The full connection string now looks like this: "postgresql😕/<user%%40server-name>:<password>@<server-name>.postgres.database.azure.com:5432/&lt;db-name&gt;?sslmode=require" 2. After deploying, the "default" tenant was not created. When there are no tenants, clicking on the "Dashboard" button in the UI does not load the dashboard page or produce any error (nothing happens). This was difficult to debug, as I had no idea what was wrong/why nothing happened. Eventually I did manage to find the issue by attempting to create a new project, which returned an HTTP response containing the text: "Variable "$tenantId" of non-null type "UUID!" must not be null". (I fixed it by manually creating a tenant through the Prefect CLI: "prefect server create-tenant ...") It would be nice if there was some error message or other indication of what is wrong when there are no tenants. I am not sure why the "default" tenant was not created. When I started the server for the first time there were some issues with the postgre extensions (Prefect was unable to create them since it didn't have the right permissions, so I added them manually). Possible this caused some issues while initializing the DB.
  • Henry

    Henry

    1 year ago
    hello