Wow - cool idea. I would assume prefect server exposes and API to start a flow.
02/16/2021, 1:33 AM
Yup, the Prefect API has a
route that allows you to trigger a flow run with configurable start time, parameters, context, and run name!
02/16/2021, 2:03 AM
In case folks are interested: Looking for the best way to add ML model predictions to data we have in Snowflake and still keep as much as possible where dbt can "see" it and manage the tables and stuff.
Original plan was to regularly have Prefect run inference jobs on a target table, export a flat file to a Snowflake stage, then add that as a Data Source for dbt