I have prefect 3.1.3 running on kubernetes and am able to submit SparkApplications with kubectl on the worker, but this requires two flows. I'm wondering if and how I might submit a SparkApplication directly from a deployment without kubectl
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.