• 张强

    张强

    11 months ago
    Two undependent
    map
    tasks are not parallel。 For the code, see reply.
    times
    and
    times2
    are parallel, but then
    sleep
    and
    sleep2
    did not,Is there a limit to the implementation of
    map
    ? There are application scenarios, such as a task operating different types of devices, each type of device has two serial tasks, but the number of devices is determined by parameters, such as (Of course, this is pure python serial.):
    ret = []
    for device in params.get('device_type1_list'):
        result = operate_device_type1_step2(operate_device_type1_step1(device))
        ret.append(result)
    for device in params.get('device_type2_list'):
        result = operate_device_type2_step2(operate_device_type2_step1(device))
        ret.append(result)
    # do something for ret
    handle(ret)
    Here, each device can be parallel, but the
    steps
    are serial. So is there a solution to this situation?
    张强
    Kevin Kho
    7 replies
    Copy to Clipboard
  • o

    Oliver Mannion

    11 months ago
    Hiya, Orion looks very slick and clean! I was wondering:1. v1 has the concept of projects to group flows, does Orion have something similar? 2. How are flows associated with specific prefect agents (ie: labels in v1)?
    o
    Jeremiah
    3 replies
    Copy to Clipboard
  • t

    Toprak Nihat Deniz Öztürk

    11 months ago
    Hello everbody, I need to divide dataframe(df) into dataframes -> load them into gpu and works on them. I can write a single task that does all but I prefer to keep them seperated and I already have a subflow that does the job. I wonder if I can call flow in a loop.
    t
    Anna Geller
    2 replies
    Copy to Clipboard
  • Tadej Svetina

    Tadej Svetina

    11 months ago
    If anyone is trying to add BasicAuth to their server instance (through a reverse proxy such as nginx or traefik), here's how you can deal with some issues related to UI-server communication, and authentication of client https://prefect-community.slack.com/archives/C014Z8DPDSR/p1633866651298300?thread_ts=1632763954.014600&cid=C014Z8DPDSR https://prefect-community.slack.com/archives/C014Z8DPDSR/p1633866798298600?thread_ts=1632763954.014600&cid=C014Z8DPDSR
    Tadej Svetina
    1 replies
    Copy to Clipboard
  • Fina Silva-Santisteban

    Fina Silva-Santisteban

    11 months ago
    Hi everyone! I’m following the steps outlined in the docs to test a flow’s composition: https://docs.prefect.io/core/idioms/testing-flows.html#testing-flow-composition I’ve noticed that
    flow.tasks
    returns not just tasks but parameters as well! How would you go about checking those? I’ve tried the following without success:
    from prefect import Parameter
    self.assertTrue(Parameter('parameter_name') in flow.tasks)
    # returns False
    Fina Silva-Santisteban
    emre
    +2
    15 replies
    Copy to Clipboard
  • Vamsi Reddy

    Vamsi Reddy

    11 months ago
    Hi Everyone!! I have been experimenting with prefect lately and wanted to know if there is anything similar to s3 sensors in prefect. I want to trigger my flow or make my tasks wait/run until there is a file/files being uploaded in the s3 buckets
    Vamsi Reddy
    Kevin Kho
    +1
    5 replies
    Copy to Clipboard
  • a

    Andy Waugh

    11 months ago
    Hi there 👋 I’m playing with control flow logic using
    case
    and seeing something unexpected and I’m wondering if it is expected to you or if it is a bug. Equally if I’m doing something weird and there’s a better way, please let me know!
    a
    Michael Adkins
    +1
    6 replies
    Copy to Clipboard
  • h

    Hui Zheng

    11 months ago
    Hello, Just want to report that this morning we had one flow scheduled run missing
    pearl-anteater
    . It is not triggered properly by prefect cloud for some reason. The remaining runs were fine. want to submit to your back-end investigation to avoid further issue.
    h
    2 replies
    Copy to Clipboard
  • Alex Rogozhnikov

    Alex Rogozhnikov

    11 months ago
    hello, some questions about orion (I am new so I decided to start with orion): • is there a way to run it on a fargate cluster? • is there a complete example of using own ssh cluster? • when I run things from jupyter, is this scenario considered supported? • if I change something in the package I develop - how do I make the same change delivered to agents/executors?
    Alex Rogozhnikov
    nicholas
    6 replies
    Copy to Clipboard
  • Tony Hill

    Tony Hill

    11 months ago
    👋🏽
    Tony Hill
    Kevin Kho
    2 replies
    Copy to Clipboard