Hi all,
I'm exploring using Prefect for a project...
# ask-communityt
Todd de Quincey
10/31/2021, 5:39 PMHi all,
I'm exploring using Prefect for a project instead of Airflow, but a bit confused about what Prefect Cloud provides.
I have setup a Prefect Cloud account, registered my first flow etc, but I then need to either have a local or Docker etc agent running.
If I am on the Prefect Cloud free tier, does this not include an agent as part of the tier? Or is the idea that we need to setup our own server for an agent and then register this with Prefect Cloud?
Many thanks
Todd
Todd de Quincey
10/31/2021, 6:33 PMI think this is the case (i.e. we run our own server).
https://www.prefect.io/why-prefect/hybrid-model
a
Anna Geller
10/31/2021, 7:48 PM
@Todd de Quincey that’s correct - Prefect orchestrates your flows, but the actual execution takes place on the infrastructure of your choice. You’ve found the right piece of documentation. Here is further explanation: https://docs.prefect.io/orchestration/faq/dataflow.html#how-is-data-persisted
k
Kevin Kho
10/31/2021, 9:24 PM
I think the question here comes because Airflow is also responsible for the execution of that code. In Prefect, it is decoupled and it runs on your infrastructure. This is why our pricing model is purely on the number of task runs orchestrated, nothing about the duration of the task.
Is that a Simpsons themed picture? That’s pretty cool!
t
Todd de Quincey
11/01/2021, 6:08 AMPrefect (pun intended)!
Todd de Quincey
11/01/2021, 6:09 AMYeah I think you are right @Kevin Kho, this is where the confusion stems from. It also explains for me why the free tier with Prefect is so generous (not a criticism). Now that I understand how that works, I really like the idea. Allows me to start small with the workers (agents) whilst the project is built out and then scale as required.
Todd de Quincey
11/01/2021, 6:13 AMAs a bit of feedback from someone with a heavy Airflow background, what might be really useful in the docs is one big, all encompassing example DAG which shows all / a lot of the major concepts. e.g. shows how to register a DAG / Flow, branching, setting up a schedule etc.
Since I am well versed with Airflow, none of these concepts are confusing to me. I just need a quick "cheat sheet" to understand how they are implemented in Prefect, without having to dig through pages of documentation.
👍 3
k
Kevin Kho
11/01/2021, 6:14 AM
That is certainly good feedback. Will forward to our docs writer
t
Todd de Quincey
11/01/2021, 6:14 AM@Kevin Kho, yep, a Simpsons style pic. Got it done on Fivver. Makes for a much more interesting online presence I think 🙂
👍 2
Todd de Quincey
11/01/2021, 6:14 AMThanks for the rapid reply by the way. Much appreciated
k
Kevin Kho
11/01/2021, 6:14 AM
Of course!
3 Views