Hey all, I work with Hospital Analytics for an Australian startup. I am officially their Chief Architect but spend most days working on data wrangling and integration work. We are mostly MS SQL based and learning about the challenges of integrating larger customers, managing a product that can work on physical servers, customer VM data centres and Azure. Currently batch based but needing to support message based data streams. One of the main challenges is that we started with SSIS for orchestrating data jobs, then we used ADF in Azure. There is so much more than just shipping the data with bit of job monitoring. The need for a better solution has led me to Prefect. So just at beginner level now trying to make Prefect fit into our existing stack and exploring the extra capability that Prefect provides.

Welcome to Prefect, @Andrew Ge-Hall ! Delighted to have you here, and I hope you find plenty of resources to assist you in your exploration.

Welcome, @Andrew Ge-Hall! Prefect is all about incremental adoption! 🚀

👋 Glad to have you here @Andrew Ge-Hall

Welcome to Prefect, @Andrew Ge-Hall! Fascinating to see the worldwide presence of this community 🇦🇺

Welcome @Andrew Ge-Hall ! Sounds like quite a challenge.

Welcome to Prefect, @Andrew Ge-Hall! LOVE your kitty!

Welcome to the community @Andrew Ge-Hall! 👋

Hello @Andrew Ge-Hall !!

👋 Hey there, @Andrew Ge-Hall, welcome!

Hi Andrew 🙂 Welcome 😛anda-dancing:

Hi Andrew! Welcome aboard! 😸

Hello Andrew! Welcome to the community! 👋

Welcome Andrew!

Welcome to the community Andrew 😁