Hi prefect community and prefect team 👋 Is there any desire for a builtin prefect task for kafka flows? At my org, within the data engineering team we hardly ever run live producers and consumers - those are typically maintained and developed by the application team who need that sub-second responsiveness to events. However, we do own batch consumers and producers - either to pickup a batch of new events from the application stack or to push a batch of updates to the application stack. It seems possible to at least design a batch consume + batch produce task for a kafka integration within prefect. How do others and the prefect team feel about that?

Hey @Tenzin Choedak, We'd love to see a Kafka task! The Task library is largely driven by use cases and open-source initiatives from the community, so this is the best place to find motivation for integrations. I would certainly love to see a Kafka task, in addition to user feedback here, a Github issue could be a great starting point to collect data on use cases and discuss with the Core developers.

@Kyle Moon-Wright thanks for that suggestion - I’ll throw an issue open to help centralize the discussion

This is great, thank you for these details! Discussions works as well. Nice job on this!