hi team, is there anyway I can pipe SLURM logs to a Prefect server?
z
Zanie
01/21/2021, 4:48 PM
I’m not familiar with how SLURM logs are published, but you could use
prefect.client.Client.write_run_logs
here’s an example from the code
Copy code
# Send pod failure information to flow run logs
self.client.write_run_logs(
[
dict(
flow_run_id=flow_run_id,
name="k8s-infra",
message="\n".join(pod_status_logs),
level="ERROR",
)
]
)
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.