Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hello! I'm relatively new to working with Prefect, and my current project involves integrating it into my Kedro pipeline. Unfortunately, I've run into some challenges when attempting to run it within a Docker environment. I've been struggling to locate any documentation that specifically addresses the integration of Prefect into a Kedro pipeline project. It seems that implementing Prefect within a Kedro pipeline may require a distinct approach compared to using it in regular Python scripts. I would greatly appreciate any guidance or insights you can provide. Thank you in advance!

Also, I'd like to share an additional experience as well. In the past, I faced connectivity problems with Prefect, even though I had started the Prefect agent. I was unable to establish a connection to both the local server and cloud server instances. To resolve this issue, I resorted to starting the entire process from scratch. I'm wondering if there might have been a specific step I missed or if there's something I may have done incorrectly that led to this problem. Your insights on this matter would be greatly appreciated. Thank you once again!