An Hoang04/20/2020, 11:53 AM
command into a prefect task. Basically how do you use prefect to submit jobs to a compute cluster that has no automatic callback API for job completion and you have to ping it continuously to check the status? How do you check if the HPC job is complete? Do you parse the output of the HPC’s status command, check existence of an output file or something else?
Kyle Moon-Wright04/20/2020, 9:03 PM