Hi, I was just wondering if anyone had any thought...
# prefect-getting-started
r
Hi, I was just wondering if anyone had any thoughts about using Prefect in an HPC environment which uses PBS as a scheduler? In my organisation, I have access to a kubernetes cluster, which is where I've been experimenting with prefect, and that works well. But I also have access to a cluster with PBS scheduler, and I was wondering if anyone has any thoughts on how prefect could fit in with this. I don't think that Dask is quite what I'm looking for. Most of my tasks are discrete, smallish (use 1-2gig of ram, take 30mins to run, and are fairly independent). So, just like in kubernetes, it would be great if there was a pbs block that I could use, so that an agent would find a job, create a pbs job script and submit it. Anyone done anything like this?