Thread
#prefect-community
    b

    bardovv

    2 years ago
    can prefect core alone be used in production systems?
    Scott Zelenka

    Scott Zelenka

    2 years ago
    We've used it for 6 months in accidental production. As long as your flows don't change that often, and you don't need easy observability into flow execution or failure, it works great. Perfect Cloud is great for orchestrating the flows, versioning, and visibility into how heathy they are.
    a

    Adam Roderick

    2 years ago
    "accidental production" 🙂 I second what @Scott Zelenka said.
    We started with Prefect Core to prove out that it is the right workflow tool for us. Once we proved that and started thinking about orchestration, versioning, logging, troubleshooting, scheduling, all that stuff and the time it would take us to build it--Prefect Cloud became a pretty easy decision
    b

    bardovv

    2 years ago
    so @Adam Roderick you'll are just using prefect core only from what I am understanding? Also I wanted to know how can you have workflow's within a workflow in prefect. I couldn't find some examples on it, and how would you parallelize your tasks in prefect.
    Are you'll using prefect core with dagster UI?
    a

    Adam Roderick

    2 years ago
    No, we started with prefect core and that allowed us to prove that it works for our needs.
    Prefect Cloud was a decision we made later
    I believe there are people running workflows from within workflows, but we are not one of them. Parallelization of tasks is supported, and we do that in our workflows
    We evaluated dagster, but we decided against it