• c

    Cab Maddux

    2 years ago
    Hi! Quick question: is there currently any way to set flow-level concurrency limits? (rather than just task level concurrency with tags)
    c
    l
    +1
    4 replies
    Copy to Clipboard
  • Scott Zelenka

    Scott Zelenka

    2 years ago
    Is it possible to use the CLI client to search for the Flows in a given Tenant/Project by the Flow Name? I'm trying to schedule a flow, where the user only has the display name of the Flow. I see
    client.create_flow_run
    but that want's the UUID. I'm looking for a display name to UUID map, similar to how the UI does it.
    Scott Zelenka
    Jeremiah
    6 replies
    Copy to Clipboard
  • m

    Manuel Aristarán

    2 years ago
    for those hitting issue #2237 (
    localhost
    hardcoded in the UI) when deploying Server to an external server, this stopgap might help you get going:
    socat TCP-LISTEN:4200,fork,reuseaddr TCP:your.prefect.api.host:4200
    (TCP proxy from
    localhost:4200
    to the external Prefect API server)
  • Matias Godoy

    Matias Godoy

    2 years ago
    Hi guys! I'm new to Prefect. I'm thrilled with the UI going Open Source, so we're planning to start using Prefect for our pipelines 🙂
  • Matias Godoy

    Matias Godoy

    2 years ago
    First of all I wanted to thank you for your hard work and the awesome project. Also for releasing it to the community!
  • Matias Godoy

    Matias Godoy

    2 years ago
    My fist question: I'm creating a Flow for one of the pipelines, and my Python file is getting really big already. Is it possible to split the file and import, for example, tasks from another .py file?
    Matias Godoy
    s
    6 replies
    Copy to Clipboard
  • n

    Nate Atkins

    2 years ago
    GM, I started working with caching this morning and got some unexpected behavior. When I run the flow without the LocalResultHandler I get the correct final log message with the transformed data.
    INFO - prefect.Task: write_data | {'col_1': [6, 4, 2, 0], 'col_2': ['a', 'b', 'c', 'd']}
  • n

    Nate Atkins

    2 years ago
    When I run it with the LocalResultHandler the xform_data stage is more or less skipped and I get an incorrect result.
    INFO - prefect.Task: write_data | {'col_1': [3, 2, 1, 0], 'col_2': ['a', 'b', 'c', 'd']}
    If I look in the log I see that the xform_data stage isn't run. Not sure why that happens, but also not sure how the data passed to write_data is the data that was passed to xform_data. It seems like the two sets of cached data are the same and xform_data sees the cached data from load_data and gets skipped.
    April 15th 2020 at 8:45:25am | prefect.CloudTaskRunner
    DEBUG 
    Task 'xform_data': 1 candidate cached states were found
    April 15th 2020 at 8:45:25am | prefect.LocalResultHandler
    DEBUG 
    Starting to read result from /tmp/inter/prefect-result-2020-04-15t14-45-25-356078-00-00...
    April 15th 2020 at 8:45:25am | prefect.LocalResultHandler
    DEBUG 
    Finished reading result from /tmp/inter/prefect-result-2020-04-15t14-45-25-356078-00-00...
    April 15th 2020 at 8:45:25am | prefect.CloudTaskRunner
    DEBUG 
    Task 'xform_data': Handling state change from Pending to Cached
    April 15th 2020 at 8:45:25am | prefect.CloudTaskRunner
    DEBUG 
    Task 'xform_data': can't set state to Running because it isn't Pending; ending run.
    April 15th 2020 at 8:45:25am | prefect.CloudTaskRunner
    INFO 
    Task 'xform_data': finished task run for task with final state: 'Cached'
    April 15th 2020 at 8:45:25am | prefect.CloudTaskRunner
    INFO 
    Task 'write_data': Starting task run...
    This seems to be the line that I don't expect.
    Task 'xform_data': can't set state to Running because it isn't Pending; ending run.
    n
    j
    11 replies
    Copy to Clipboard
  • p

    Preston Marshall

    2 years ago
    Anyone using Prefect instead of something like Kubeflow?
  • Edidiong Etuk

    Edidiong Etuk

    2 years ago
    👋 I’m here! My Name's Edidiong I saw Prefect has been Open Sourced. I wanna try and contribute to it's growth.
    Edidiong Etuk
    nicholas
    2 replies
    Copy to Clipboard