Hello! I am dealing with a logger problem, while I am using pyspark-kafka module with custom StreamingQueryListener I can't see any outputs/logs in FlowRun area for my run. Do you have any ideas how to add it? Thanks!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.