Hello! I have some Python applications that I want to run and deploy on a small appliance. I'm looking for a lightweight orchestrator and an API interface to launch these apps externally or on a defined schedule. Would Prefect be a suitable tool for this?
b
Bianca Hoch
11/07/2024, 1:08 AM
Hi Mohamad! Without knowing too much about your use case, I'd say if you're looking for a lightweight orchestrator, Prefect should have you covered there.
Bianca Hoch
11/07/2024, 1:09 AM
When you say "small appliance", what sort of appliance is it out of curiousity? 👀
m
Mohamad
11/08/2024, 6:47 AM
Hi Bianca!
I'm working on building an energy app that leverages Telegraf, ClickHouse, and a small web application to run on an energy site. The app will collect sensor data, aggregate it using ClickHouse materialized views, and use dbt and Python to perform scheduled/on-demand jobs on-site. This setup is designed to run on a Raspberry Pi or a small 2GB RAM device, allowing for local energy management and control at the edge. We’ve made progress on each component and are now evaluating which orchestrator to use to handle job scheduling and provide an API for triggering Python jobs within the app.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.