Caleb here, a Data Engineer working at startup based in Nairobi, Kenya. I have used prefect before but starting to get my teeth sunk in trying to adopt it for the company I work for. Admittedly, I have been a lurker on this channel but looking forward to more interactions with the awesome community around Prefect.
Hi, I'm Niels, data engineer. I work on different projects, ranging from data pipe-lines to full blown data driven apps. All with the aim to give data insights / insights in data. In my projects I work together with engineering teams, data scientists and analysts. I just landed a job where we use prefect for multiple data flows in combination with Jenkins and K8s. I hope to learn from this community, especially about CI/CD in combination with Prefect =D
Hi everyone. My name is Francois and I'm a code system developer at Necsa in South Africa. We are considering Prefect to use as an automation tool for our simulation tool chain. Since we already moved to Python as a unified front end, implementing complex flows in Prefect has been straight forward. Very impressed with the API and UI so far
Hi! 👋 I'm the Technical Lead and Co-Founder at siːkwəl - Analytics Engineering - a Northern Germany based Data & Analytics Consulting Agency and I evaluate and test different tools for our customers data pipelines. Happy to be part of the community and to support the community productively 😃
Hi! I'm the Data Engineer at Indoorclima. We are currently evaluating options for building our ETL and prefect seems amazing! We do have some questions that couldn't find an answer in the documentation:
• Will prefect orion be compatible with flows previously created?
• While prefect seems amazing, prefect orion is even better with the possibility of true dynamic flows with "if", "for" and "while". We have seen that it is expected an a stable release in early 2022 and as of now it is not recommended to deploy orion in production. As we want to start developing ASAP is there a more specific ETA for the stable release?
• Are there any plans of supporting other databases like MySQL?
Thank you all!
Hi, My names Josh - I lurked around here and asked a few questions towards the start of 2021 in a previous job - started at a new place and I am taking on the role of lead Data Engineer - Would love to understand peoples experiences with using Vertex on GCP is this a robust way of using Prefect? In the past tried to run everything myself on k8s but was far to much pain than it was worth!