• a

    Arthur Jacquemart

    2 months ago
    Hello prefect community, I am using "manual_only" trigger for the first time and I noticed that when I resume the flow, the variables computed downstream the manual task are not kept in memory. Is that the correct behaviour or am i doing something wrong?Should i take a look how to persistently cache these previous results (https://docs.prefect.io/core/advanced_tutorials/using-results.html) or there is a simpler solution? Thank you for your help!
    a
    3 replies
    Copy to Clipboard
  • Wei Mei

    Wei Mei

    2 months ago
    Hello! I am attempting to set up DBTShellTask and having a problem with locating the dbt_project.yml file. It is located in the dbt/ directory that is cloned from my github repo. I do not see a variable I can use to change to dbt/. The profiles.yml is created in . so it is found without a problem.
    dbt_project.yml file [ERROR not found]
    Wei Mei
    2 replies
    Copy to Clipboard
  • Nicholas Thompson

    Nicholas Thompson

    2 months ago
    Hi all, I'm trying to map over a task in prefect 0.15.13, using a LocalDaskExecutor where
    scheduler="processes"
    . The input I'm passing to the mapped task is ordered, ideally so that tasks assigned to the first items in the list are run first, however this doesn't seem to be the case. With my machine that has six cores, on a given task run I can see that the mapped tasks with
    map_index
    values 0, 1, 3, 13, 14, and 15 are run first, but ideally I would want this first batch of tasks to have map index values of 0, 1, 2, 3, 4 and 5. tldr: is it possible to ensure that when mapping a task, the mapped tasks get run in the same order they appear as in the input array?
    Nicholas Thompson
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Yupei Chen

    Yupei Chen

    2 months ago
    Running
    prefect auth list-tenants
    I get below:
    ValueError: badly formed hexadecimal UUID string
    Nvm user error.
    Yupei Chen
    taylor
    3 replies
    Copy to Clipboard
  • Matthew Seligson

    Matthew Seligson

    2 months ago
    How can we prevent concurrent runs of the same flow? Given my current architecture it’s not safe to have two runs of the same flow at the same time. I see there are some concurrency strategies with labels but I don’t think that will work here given that we want every flow to have this behavior.
    Matthew Seligson
    1 replies
    Copy to Clipboard
  • i

    Isara Ovin

    2 months ago
    im getting an error
    zsh: segmentation fault  python app.py
    when im trying to run a flow using
    LocalDaskExecutor
    using threads can someone please help
    i
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Andreas

    Andreas

    2 months ago
    Hi! In Prefect 2.0 - Python API orion client. How can we create and provide a flow_filter to read_deployments() ? For example how do I get all deployments that have a specific tag using Python? It would be nice if the API docs had more examples especially related to Python API and client
    Andreas
    Mathijs Carlu
    +1
    5 replies
    Copy to Clipboard
  • a

    Abhishek Mitra

    2 months ago
    I'm having a problem in the execution layer of my project. I'm using an ECS Fargate agent to run my tasks. I'm following this method to define task containers. I'm also using the logging options mentioned here but the task only gets submitted by the agent. Nothing happens after that and after a while it gets restarted by Lazarus. Could anyone suggest a way to narrow down the problem or a better practice to follow for configuring flows?
    a
    1 replies
    Copy to Clipboard
  • Florian Guily

    Florian Guily

    2 months ago
    Hi everyone, prefect 1 question here. I deployed an ETL flow and i need to keep track of what happened during each flow run such as "how many record have been ingested, how many failed etc". Ideally this would be done at the end of the flow execution so i looked about flow state handlers in the doc. But i couldn't find if i could use "task" data in those state handlers. Do you have any idea ?
    Florian Guily
    emre
    5 replies
    Copy to Clipboard