• Sylvain Hazard

    Sylvain Hazard

    10 months ago
    Hey again, Got another question, sorry for bothering. How can I get the result of a subflow to pass as input to another task ? I'd like to do that because I have a specific task in my flow that is quite resource hungry and I would like to run it as a separate flow in order to optimize costs. The issue is that the output of this task is currently used downstream and I'd like to do the same with it running as its own flow. I may have missed it in the documentation, but I don't think I saw this use case described. Basically, I'd like to do something like this :
    with Flow(name="Parent Flow") as flow:
        docs = Parameters("docs", default=[1, 2, 3])
        small_task = SmallTask().map(docs)
        big_task = create_flow_run.map(flow_name=unmapped("Child flow"), project_name="whatever", parameters=small_task)
        wait_big_task = wait_for_flow_run.map(big_task, raise_final_state=unmapped(True))
        another_small_task = AnotherSmallTask().map(wait_big_task)
    but I'm not sure how or where to define the result of a flow in order to use it downstream.
    Sylvain Hazard
    Anna Geller
    2 replies
    Copy to Clipboard
  • v

    Vaibhav Ariyur

    10 months ago
    shown left: I run a flow, flow enters subflow, completes successfully, and enters the "clean" task successfully when there is a constantly running "keep-alive" task running in parallel. The keep-alive task just logs "keeping alive" every 10 seconds for an indefinite period of time. shown right: I run a flow, flow enters subflow, subflow completes successfully but the main flow does not understand that (hence the grey status for the subflow), main flow restarts instead of entering the clean task (hence the greyed out box in one of the prior tasks --> where I cancelled this flow). Anybody understand why this happens, and a non-hackish fix for this?
    v
    Kevin Kho
    +1
    16 replies
    Copy to Clipboard
  • v

    volkerjaenisch

    10 months ago
    Hi I am Volker from Inqbus Scientific Computing. We are currently evaluating Prefect/Orion as the future workflow engine for a not so small customer. Prefect is out of question but we like to give Orion a try. We have some deeply reaching questions about Orion: Class decorators, optimization without knowing the DAG beforehand, future development of the UI etc. Where do we place these questions best?
    v
    Kevin Kho
    4 replies
    Copy to Clipboard
  • v

    volkerjaenisch

    10 months ago
    @Kevin Kho Thanks for the fast answer!
  • v

    volkerjaenisch

    10 months ago
    OK here we go. I noticed that the UI of Orion is way back behind the funtionality of Prefect. When can one expect a catchup?
    v
    Kevin Kho
    +1
    31 replies
    Copy to Clipboard
  • Diego Alonso Roque Montoya

    Diego Alonso Roque Montoya

    10 months ago
    Has feature development fully moved to Orion? When can we expect a stable version for Orion?
    Diego Alonso Roque Montoya
    Kevin Kho
    8 replies
    Copy to Clipboard
  • Stéphan Taljaard

    Stéphan Taljaard

    10 months ago
    Hi. This sounds like a noob question. How do I change the default folder for results? (I don't mind, or actually want to, move the whole config folder) I've tried adding
    home_dir = "/mnt/disks/prefect_data/.prefect"
    to
    .prefect/config.toml
    , but results are still saved on my main disk
    Stéphan Taljaard
    Anna Geller
    +1
    8 replies
    Copy to Clipboard
  • Bruno Kuasney

    Bruno Kuasney

    10 months ago
    Hi, honestly I’m not sure if it’s prefect related, but, when I try to run the graphql query to turn off a specific flow:
    mutation {
      set_schedule_inactive(input: {flow_id: "67d364da-375d-4d0f-b151-d46435351c50"}) {
        success
      }
    }
    I get:
    "message": "field \"set_schedule_active\" not found in type: 'mutation_root'"
    I’m basically trying to use the query from the documentation here
    Bruno Kuasney
    Anna Geller
    17 replies
    Copy to Clipboard
  • Sylvain Hazard

    Sylvain Hazard

    10 months ago
    Hey ! Are tasks results available in flow-level state handlers ? I'd like to use those to generate some kind of report and send it to Slack.
    Sylvain Hazard
    Anna Geller
    4 replies
    Copy to Clipboard
  • Alexis Lucido

    Alexis Lucido

    10 months ago
    Hello all. I have been trying to configure Prefect Server on a Debian/GNU Linux 10 VM and I encounter a problem. I have a conda env with prefect installed, docker and docker-compose installed as well. I can launch the server with prefect server start --expose (cannot seem to access the UI from my computer without the "--expose" part), but I got a "Couldn't connect to Prefect Server at http://localhost:4200/graphql" issue. It seems to be the same problem that the one Krishna had here: https://prefect-community.slack.com/archives/CL09KU1K7/p1636636632389000. I have attached the return of a prefect diagnostics command, and it seems that my docker containers have enough memory (16GB per container). My company is against the fact that I use Prefect Cloud. Finally, I can run Flows manually with 'prefect run -n "flow_to_test" --execute'. Anyone has any idea about my issue? Thank you very much!
    Alexis Lucido
    Anna Geller
    +1
    9 replies
    Copy to Clipboard