Alex Rogozhnikov

    Alex Rogozhnikov

    11 months ago
    hello, some questions about orion (I am new so I decided to start with orion): • is there a way to run it on a fargate cluster? • is there a complete example of using own ssh cluster? • when I run things from jupyter, is this scenario considered supported? • if I change something in the package I develop - how do I make the same change delivered to agents/executors?
    nicholas

    nicholas

    11 months ago
    Hi @Alex Rogozhnikov - since Orion is still in beta some of the more intricate deployment stories aren’t fully mapped; if you’re looking for a production-ready system we recommend using Core 0.15.x and Prefect Server/Cloud, otherwise we recommend using Orion as a local development tool
    Alex Rogozhnikov

    Alex Rogozhnikov

    11 months ago
    hey @nicholas, thanks for advice.
    @nicholas So in the land of prefect-core: I see fargate depracated in the favor of
    ECSAgent
    , and probably I can set up dask cluster over SSH. Didn't find any specific mention of running/developing from jupyter. Can you comment on this?
    nicholas

    nicholas

    11 months ago
    Are you thinking to run jupyter notebooks within your flow or are you wanting to write your flows in a notebook and execute them from there?
    Alex Rogozhnikov

    Alex Rogozhnikov

    11 months ago
    latter
    nicholas

    nicholas

    11 months ago
    Got it - for tutorials on that you should check out

    this livestream

    with Prefect’s CTO Chris White; you should be able to run flows as expected with Jupyter 🙂