https://prefect.io logo
s

Sam Werbalowsky

02/16/2022, 6:21 PM
Hey - has anyone here used Prefect with ML (or other data processing) and then outputted charts to a PDF or PNG? We’re exploring this as an option for getting insights into our ML models.
k

Kevin Kho

02/16/2022, 6:22 PM
You can store it as an artifact but you need to persist the PNG somewhere like S3 and link it to a Markdown artifact. If you need more experiment tracking though, you can do Prefect + MLFlow because MLFlow has plots of metrics versus hyperparameter values
a

Anna Geller

02/16/2022, 6:23 PM
Kevin published a blog post about this just this week 🙂 check it out, it shows how you can use Artifacts API to display your ML model results directly in your Cloud UI https://www.prefect.io/blog/introducing-prefect-ml-orchestrate-a-distributed-hyperparameter-grid-search/
s

Sam Werbalowsky

02/16/2022, 6:32 PM
Wow, such timing! Thanks for the info, will pass along
👍 1
e

Evan Curtin

02/16/2022, 6:42 PM
We’re using hosted MLflow for parameter/artifact storage and going to use prefect for orchestration
k

Kevin Kho

02/16/2022, 6:44 PM
Have you ever written about it? Would like to see the stack, and I’m sure it would be helpful for a lot of people
e

Evan Curtin

02/16/2022, 6:44 PM
I’m building the stack right now 🙂 we are awaiting some data from our engineers and maybe we can blog about it
🙌 2
prefect / k8s / mlflow / streamlit (for now)
k

Kevin Kho

02/16/2022, 6:46 PM
Yeah this stack makes a lot of sense. Streamlit to visualize the experiments? Or you have some interactive webapp? Even Prefect + Streamlit is worth blogging about already 😆
e

Evan Curtin

02/16/2022, 6:46 PM
The mlflow ui is ok but rather limited, so I decided to use it only for artifact storage/organization
a

Anna Geller

02/16/2022, 6:46 PM
+1 I would also be super interested to see a blog post about your setup
e

Evan Curtin

02/16/2022, 6:47 PM
Let me bring it up at the company, I’ve only been working on this for like 2 weeks at the moment so really quite greenfield
Streamlit for all data viz, but to be totally honest i wanted an excuse to try it out 😧
5 Views