Hello everyone, I’m a software engineering student at IMT Nord Europe, a renowned school in France, and I’m currently working on a project with my colleague to showcase Prefect to our class through a practical demonstration. As part of this project, we aim to present a small but impactful use case that highlights the capabilities of Prefect. Our professor will evaluate our presentation and provide feedback on how the technology could be leveraged further. We were wondering if you might have any suggestions for concise yet insightful projects or workflows that would effectively demonstrate Prefect’s strengths. Our goal is to make a strong impression and gain a deep understanding of the platform in the process.

hi @Yasmine Benkacem - welcome! I'll share some links that might be of interest to you template repo to bootstrap a prefect project example uses of prefect • schedule some work and expose a nice form so that non-technical users can trigger it intuitively (see picture)

from datetime import timedelta
from typing import Literal

from pydantic import BaseModel, Field

from prefect import flow
from prefect.types import DateTime


class NiceDateParams(BaseModel):
    area: Literal["sand", "snow", "ice"]
    currency: Literal["usd", "eur", "jpy"]
    start_date: DateTime = Field(
        default_factory=lambda: DateTime.now() - timedelta(days=1)
    )
    end_date: DateTime = Field(default_factory=lambda: DateTime.now())


@flow(log_prints=True)
def f(params: NiceDateParams):
    print(params) # do arbitrary python with these params


if __name__ == "__main__":
    f.serve(cron="0 0 * * *")

• ingest documents to support a RAG knowledgebase in a highly concurrent manner • observe arbitrary tool calls of an agent

thank you so much for the help, I was wondering also if you can hook me up with a projet Big Data related, it would be great !

what exactly do you mean by Big Data? you can wrap arbitrary python in prefect flows/tasks so if you want to do some "larger-than-memory" pandas / polars stuff in a prefect flow, that's totally fair game

Here is a good source of datasets (not necessarily big data but at least interesting) https://www.data-is-plural.com/