• t

    Tilé

    3 months ago
    Hello everybody, I have two quick questions 1. Does a mapped task (of size n) count for 1 task or n tasks in terms of billing? 2. I have a workflow that generates a list of size n and then all subsequent tasks use
    map
    for each item. On the UI it says "No heartbeat detected from the remote task; marking the run as failed.", but the result of the workflow is marked as "Success". I checked my database and everything looks like the task succeeded. Any idea what is going on and how can I avoid it? Have a nice day!
    t
    Kevin Kho
    4 replies
    Copy to Clipboard
  • b

    Bob Colner

    3 months ago
    Prefect 2 question. What are blocks?
    b
    Kevin Kho
    +3
    7 replies
    Copy to Clipboard
  • Michael Duncan

    Michael Duncan

    3 months ago
    Hi everyone, We have a failure callback on our flows that tries to report all of the exceptions that occurred in each task. We previously tried to access the
    state.result
    from the flow which works locally but not in the cloud explained in this answer https://prefect-community.slack.com/archives/CL09KU1K7/p1653606914417649. Is there a good way to collect exceptions from each task and report them in a state handler when the flow fails? We have have alerts on flow failures and we want to report the exceptions in the alert
    Michael Duncan
    Kevin Kho
    4 replies
    Copy to Clipboard
  • Abin Antony

    Abin Antony

    3 months ago
    Folks, Good evening/afternoon/morning! 🙂 . Does anyone has OpenShift Yaml templates to set up PREFECT ? Due to privacy reason we cant use Prefect Cloud. So need to set up everything on our private OpenShift.. Anyone has Openshift Build , Deploy yaml templates
    Abin Antony
    Kevin Kho
    +2
    33 replies
    Copy to Clipboard
  • Abin Antony

    Abin Antony

    3 months ago
    Friends, again another quick question - Has anyone set up PREFECT on local Windows 10 machine with Docker / Docker Compose. One one of our machines - specially Windows, we are getting our Postegres DB shutting down. Anything specific we need to check while setting things up on Windows 10 machine with Docker Desktop. Thanks in advance
    Abin Antony
    Kevin Kho
    +1
    4 replies
    Copy to Clipboard
  • Ken Nguyen

    Ken Nguyen

    3 months ago
    Is there a way I can detect a cancelled run for state handling? There doesn’t seem to be a
    is_cancelled()
    when looking here.
    Ken Nguyen
    1 replies
    Copy to Clipboard
  • a

    Amol Shirke

    3 months ago
    Hello, I am trying to setup prefect orion with postgress. My postgress db works with kerberso authentication, is there a way I can make it work with kerberos Authentication?
    a
    Kevin Kho
    7 replies
    Copy to Clipboard
  • yu zeng

    yu zeng

    3 months ago
    hello, is there any way can set task or flow priority when using dask executor on prefect 1.0 ( e.g., with dask.annotation( resource = { "GPU":1 } ) @Anna Geller. i konw prefect 2.0 support this but for some reasons i can't use 2.0
    yu zeng
    Kevin Kho
    10 replies
    Copy to Clipboard
  • l

    luke b

    3 months ago
    Hi, in Prefect 1.0+cloud I’ve triggered a flow run (“run1”, running v1 of the flow), say with tasks A->B->C->D. Task C has failed. Task B, a long-running task that assembled a dataset, succeeded. I’d like to de-bug C. Clicking into the task run for B in the UI, I see there is a path for “Result Location”.1) What syntax can I use to load Task B’s result into a dataframe in an ipynb? (To help me try to re-create the error of Task C in an interactive environment.) 2) Assume I identify the problem in Task C and make the correct code changes. I need to re-register the flow, which updates the flow version to v2. Is there any way for me to partially re-run the flow, such that it starts with v2 Task C picking up the result from v1 Task B, so I don’t have to re-run the long process that succeeded? thanks for considering these!
    l
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Danilo Drobac

    Danilo Drobac

    3 months ago
    I've asked this question in the Airbyte Slack, but got no traction so far, has anybody been using Airbyte + Prefect and know what the best practice is for communicating with the API for a deployed version of Airbyte? Hey folks I have an instance of Airbyte deployed on GCP following the tutorial below.https://docs.airbyte.com/deploying-airbyte/on-gcp-compute-engine#connect-to-airbyte This uses ssh to connect to the instance and use it in my browser via
    localhost:8000
    . I'm trying to connect to the instance (to make an API call) through a Python script, but I have no idea how to think about the authentication layer. How do I send an API call to the server? The documentation suggests not to open the instance up to HTTP traffic but I'm guessing that's a requirement to be able to communicate with the API?
    Danilo Drobac
    Kevin Kho
    +1
    5 replies
    Copy to Clipboard