Hi all. I'm Erick. I'm a Data Scientist trying to wrap my head around Prefect.

Welcome @Erick Heredia 👋 !

Thanks @Zach Angell. I have a question regarding this platform. Our team is also benchmarking ClearML for our operations. Do you know that tech and if so, what would be the differences between Prefect and ClearML?

I don't know ClearML well enough to give a good answer here. I'll check with the rest of the team to see if anyone is familiar. If you toss your question in the #prefect-community channel, you'll get good answers from both our team and Prefect community members who may have compared the two offerings!

Will do, thanks.

Hi @Erick Heredia, welcome to Prefect! Which ClearML product are you looking into? I assume Experiment and Orchestrate?

Yes @Kevin Kho.

So for experiment tracking, Prefect is more general purpose but we see users combining experiment tracking (like MLFlow) and Prefect. They register their experiments within their scheduled flows, assuming there is a programmatic API to do so. For orchestration, it looks like ClearML lets you queue up training and manage compute power. I think Prefect is more meant for jobs that run on a schedule while ClearML is meant more for that job queue. There are Prefect mechanisms to handle hardware. Both of them let you run code on-premise if that’s a concern.

Nice.