• Aniruddha Sengupta

    Aniruddha Sengupta

    6 months ago
    Hi All, I am trying to run a flow with some labels with
    ["aniruddhas", "parallel_example"]
    . I have an Agent whose label's are dynamically updated every time a flow is registered so that any new labels on flows are added to the agent. So now my Agent contains these labels :
    ["aniruddhas", "prefect_spider", "simple_news_spider", "parallel_example"]
    . I have now experimented with it and found that when my flow has just the label
    ["aniruddhas"]
    , the Agent is able to pick them up and run them. But if the flow run has its original labels:
    ["aniruddhas", "parallel_example"]
    , the Agent is not able to pick them up. Why is this the case? Thanks, Aniruddha
    Aniruddha Sengupta
    Anna Geller
    4 replies
    Copy to Clipboard
  • Mehdi Nazari

    Mehdi Nazari

    6 months ago
    Hi All; Are there any thoughts out there on how to make a DbtShellTask dynamic? As in certain parameters would be provided to the flow and based on those the DbtTask would get created and run subsequently? It’d be great if I can see an example.
    Mehdi Nazari
    Anna Geller
    2 replies
    Copy to Clipboard
  • Bruno Nunes

    Bruno Nunes

    6 months ago
    Hi, I'm doing some tests using the LocalDaskExecutor. Some flows are ending with errors with not much explanation in the pod log. Pod prefect-job-12d6087d-594qj failed. Container 'flow' state: terminated Exit Code:: 139 Reason: Error Do you know what 139 exit code means?
    Bruno Nunes
    Michael Adkins
    +1
    4 replies
    Copy to Clipboard
  • v

    Vishal

    6 months ago
    hi all, I am running
    prefect docker agent start..
    with some labels on my local machine, and am running into this error that I am unable to figure out. I have registered my flow, and it shows up in Prefect UI, but when I run that flow, it goes into Submitted State, and the logs of prefect docker agent show this error:
    docker.errors.NotFound: 404 Client Error for <http+docker://localhost/v1.41/containers/4675972bf8cb3506f9edd11788ac666dc61cef7d896c2e5367f38e9a9f3fdea2/json>: Not Found ("No such container: 4675972bf8cb3506f9edd11788ac666dc61cef7d896c2e5367f38e9a9f3fdea2"
    v
    Kevin Kho
    +1
    19 replies
    Copy to Clipboard
  • Zhibin Dai

    Zhibin Dai

    6 months ago
    Hi. I have a flow that copies data from S3 to Snowflake. It works fine locally, but when I run it in ECS using Fargate, I'm getting a strange error.
    Failed to load and execute flow run: ImportError("cannot import name 'List' from 'pip' (/usr/local/lib/python3.7/site-packages/pip/__init__.py)")
    Zhibin Dai
    Kevin Kho
    13 replies
    Copy to Clipboard
  • Zhibin Dai

    Zhibin Dai

    6 months ago
    Is there a way to pass the value of a Parameter into a PrefectSecret as a string? Is something like this possible?
    run_env = Parameter("run_env", default="DEV")
    sf_user = PrefectSecret(SF_USER + "_" + run_env)
    Zhibin Dai
    Kevin Kho
    10 replies
    Copy to Clipboard
  • d

    Devin Flake

    6 months ago
    Hi - I'm using Prefect Server and I'm trying to register a flow into a project but I'm getting the following error:
    prefect register --project "Tests" --path hello_world.py
    ... lots of output ...
    prefect.exceptions.AuthorizationError: Malformed response received from Cloud - please ensure that you are authenticated. See `prefect auth login --help`.
    d
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Lana Dann

    Lana Dann

    6 months ago
    hi! where can i find a list of all of the environment variables i.e.
    PREFECT__*
    that i can use to configure prefect?
    Lana Dann
    Kevin Kho
    8 replies
    Copy to Clipboard
  • m

    Michał

    6 months ago
    How to get some kind of alert like slack notification when Agent last query was more than 10 minutes:
    m
    1 replies
    Copy to Clipboard
  • Fabrice Toussaint

    Fabrice Toussaint

    6 months ago
    Hi all, Is it possible to cancel a flow after it ran for an X amount of time? Let's say I want to cancel flows that take longer than 1 hour? How would I approach this?
    Fabrice Toussaint
    t
    5 replies
    Copy to Clipboard