Hi guys, I was trying to run a spark job from prefect. The spark job is a scala jar. I am confused and wondering how i could run the jar from prefect?Prefect and spark is installed in my k8s cluster. I usually execute the job via spark-submit.
How to do this via prefect?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
