• Morgan Omind

    Morgan Omind

    1 year ago
    Hi everyone, nice to join your community 🙂 We face an issue which seems to impact different google cloud platform projects, while it should not. In the thread-attached GCP log, we can see that it refers to both quetzal-omind as well as cartographie-cps projects. We do absolutly not understand why?! Our flow runs are pretty unpredictable since some days, most of the times they simply do not start, often they fail in a http requests loop, and sometimes it runs successfully! We suspect a wrong setup of our prefect agent, but we are pretty new to prefect dev, so we are very not sure of where to look for our issues. Maybe someone here will have some clues to help us 🤞 best!
    Morgan Omind
    Kyle Moon-Wright
    +1
    17 replies
    Copy to Clipboard
  • Pedro Martins

    Pedro Martins

    1 year ago
    How would one trigger a prefect flow from a github event? Let's say merging to master/main should trigger a new run.
    Pedro Martins
    Michael Adkins
    3 replies
    Copy to Clipboard
  • m

    Matthew Blau

    1 year ago
    Hello all, I am attempting to set up Slack Notifications for my flow and am following https://docs.prefect.io/core/advanced_tutorials/slack-notifications.html#installation-instructions. I have successfully installed the prefect app into my workspace and have been able to test the connection with success. However, I am unable to have it output information based on my actual flow. I receive the following error:
    Exception raised while calling state handlers: ClientError('400 Client Error: Bad Request for url: <http://host.docker.internal:4200/graphql>\n\nThe following error messages were provided by the GraphQL server:\n\n GRAPHQL_VALIDATION_FAILED: Cannot query field "secret_value" on type "Query".\n\nThe GraphQL query was:\n\n query($name: String!) {\n secret_value(name: $name)\n }\n\nThe passed variables were:\n\n {"name": "SLACK_WEBHOOK_URL"}\n')
    what am I doing wrong? I have @task(state_handlers=[slack_notifier]) set for the task I am testing out the notification for.
    m
    Kyle Moon-Wright
    +1
    9 replies
    Copy to Clipboard
  • a

    Arun Giridharan

    1 year ago
    Is there a way to write a prefect flow to snapshot a DB?
    a
    Kyle Moon-Wright
    3 replies
    Copy to Clipboard
  • b

    BK Lau

    1 year ago
    Is there anyone who have run an
    Apache Beam
    cluster using Prefect. If so, like to get some input and lessons from your experience.
  • Verun Rahimtoola

    Verun Rahimtoola

    1 year ago
    hi, we're using prefect server as our backend, and using a local agent on our infrastructure to execute flows. we're noticing that for some flows, only the first level of the dag (ie, the tasks with no upstream requirements) get executed, and then nothing happens... any clues as to what might be happening?
    Verun Rahimtoola
    Kyle Moon-Wright
    7 replies
    Copy to Clipboard
  • Giovanni Giacco

    Giovanni Giacco

    1 year ago
    Hello everyone, is there such a way to use Dask Temporary Cluster, created by Prefect, inside a task in order to execute any workload on that Dask cluster?
    Giovanni Giacco
    Kyle Moon-Wright
    2 replies
    Copy to Clipboard
  • Jimmy Le

    Jimmy Le

    1 year ago
    Hey folks! I’ve been struggling a bit with understanding how Prefect connects with the AWS ecosystem. Namely ECR, ECS, and Fargate. I’d be willing to pay for a few hours of tutoring. Please DM me your rates 😃
    Jimmy Le
    Amanda Wee
    +2
    5 replies
    Copy to Clipboard
  • j

    Josh Pitts

    1 year ago
    hi! I have a Task that is querying a slow API (10K times). I want to checkpoint this task each iteration (disk is okay), but struggling with how to template the
    location
    since the task argument is what makes the task unique, but that’s not available to the context object as far as I can tell. Am I missing something obvious for this use case?
    j
    Chris White
    3 replies
    Copy to Clipboard
  • e

    Eric

    1 year ago
    hi Prefect, I noticed that the
    prefect/cli/server.py
    shows user can specify different ports to start the Prefect server services (i.e. graphql_port='xxxx', server_port='xxxx', etc.). But when I used the flow.register(project_name) in my script, the
    prefect/core/flow.py
    seems like using default 4200 port to register the flow and had no param to adjust the registering port in
    register()
    function, so it raised HTTPConnection error. Once I changed line 1666 - flow.py
    client = prefect.Client()
    with
    client = prefect.Client(api_server='<http://localhost>:MODIFIED_PORT/')
    and it works. Is this an issue here? Thank you 🙂