@Marvin whats the difference between tasks and subflows?

In Prefect, tasks and subflows serve different purposes within a flow: 1. Tasks: These are the individual units of work within a flow. They are defined using the

@task

decorator and can perform any Python function. Tasks are designed to be modular and reusable, allowing you to break down complex workflows into manageable pieces. More on tasks can be found in the Prefect tasks documentation. 2. Subflows: These are flows that are called from within another flow. They allow you to encapsulate and reuse entire workflows as components of larger workflows. This can be useful for organizing complex workflows or when you want to execute a flow independently or as part of another flow. Subflows leverage the

@flow

decorator and can be invoked like any other function within a flow. Both tasks and subflows are integral to building and managing workflows in Prefect, but they operate at different levels of abstraction. Tasks handle granular operations, while subflows manage entire workflows as part of a larger process. For further details, you can explore the Prefect API here.