Hi, I'm Blake, a data scientist based in NZ working for a biotech company. Very new to Prefect, but I am enjoying learning how it can work as an ETL/scheduling/DAG framework for Python 😁
👋 11
d
Dylan
07/13/2021, 1:45 PM
Welcome, Blake! 👋
b
Brett Jurman
07/13/2021, 3:41 PM
Hey Blake, I'd be curious to talk to you about your use case. I also do work related to biotechs
b
Blake List
07/13/2021, 10:30 PM
Hi Brett, sure thing! I'm involved in a lot of different things, but currently, I am trying to use prefect to automate and schedule an etl pipeline for collecting chemical spectra data, transforming it, running a machine learning model over it, then sending the outputs to an app
b
Brett Jurman
07/22/2021, 1:45 PM
That's interesting. Are you using it trigger a kind of simple job (all of those steps are one job)? Or are you taking advantage of the task graph stuff?