Hi everyone! My name is Taras, and Iโm a data scientist. Iโve decided to take a closer look at Prefect for managing ML modelโs training and backtesting pipelines. I used Luigi and DVC in the past and am keen to explore python-native dynamic orchestration now ๐ Iโm also interested in running flows in the cloud, so I will probably ask questions about infrastructure.
๐๐ฝ 1
๐ 14
k
Kevin Kho
05/13/2022, 3:50 PM
Hi @Taras Svirskyi! Welcome to Prefect!
๐ 1
h
Henning Holgersen
05/13/2022, 4:12 PM
Hi, welcome!
๐ 1
c
Chris Reuter
05/13/2022, 4:27 PM
Welcome to the community @Taras Svirskyi! DVC is interesting, were you using it in combination with Luigi or standalone?
๐ 1
j
jawnsy
05/13/2022, 4:42 PM
Hey, welcome @Taras Svirskyi! ๐
Joined us just in time for Meme Friday over in #random ๐
๐ 2
t
Taras Svirskyi
05/13/2022, 4:48 PM
Iโm using DVC standalone. Luigi was my first attempt to manage ML code but I end up writing too many boilerplate in attempt to support dynamic pipelines. The DVC provides nice abstractions for metrics/parameters/steps of the pipelines + cache. Yet it becomes quite hard to manage all steps as pipelines grow cause itโs yaml+python.
๐ 2
a
Anna Geller
05/13/2022, 4:52 PM
Welcome aboard, @Taras Svirskyi! Great to have you with us!