Has anyone experimented with rigging prefect flows which execute jupyter notebooks? We have folks who author scrapes in a no-code tool, and then they may need to set up scheduled postprocessing of incremental ingested data. Anyone doing something similar?

Hi @Tim Chklovski, have you seen the jupyter tasks ? these use papermill under the hood to execute jupyter notebooks.

yup, that’s what i think i linked to in the question… i was wondering if folks have set up flows that publish a notebook to s3 and then run it… (eg we use deepnote.com

Oh sorry I missed that. I see what you mean. So not quite the same, but I did see a user run a flow on deepnote and he has a blog entry here

@Kevin Kho ask and one shall receive — the good folks at Deepnote are working on an api: https://community.deepnote.com/c/beta-testers/notebooks-api-early-access?

Nice! That would open a lot of doors for orchestration