can prefect core alone be used in production systems?
03/20/2020, 1:38 PM
We've used it for 6 months in accidental production. As long as your flows don't change that often, and you don't need easy observability into flow execution or failure, it works great.
Perfect Cloud is great for orchestrating the flows, versioning, and visibility into how heathy they are.
03/20/2020, 3:19 PM
"accidental production" 🙂
I second what @Scott Zelenka said.
We started with Prefect Core to prove out that it is the right workflow tool for us. Once we proved that and started thinking about orchestration, versioning, logging, troubleshooting, scheduling, all that stuff and the time it would take us to build it--Prefect Cloud became a pretty easy decision
03/22/2020, 3:27 PM
so @Adam Roderick you'll are just using prefect core only from what I am understanding? Also I wanted to know how can you have workflow's within a workflow in prefect. I couldn't find some examples on it, and how would you parallelize your tasks in prefect.
Are you'll using prefect core with dagster UI?
03/23/2020, 1:50 PM
No, we started with prefect core and that allowed us to prove that it works for our needs.
Prefect Cloud was a decision we made later
I believe there are people running workflows from within workflows, but we are not one of them. Parallelization of tasks is supported, and we do that in our workflows