Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hello, is there a way to increase the Google Cloud Run Job block timeout beyond 3600 sec? Right now, the max is set to 3600.

However it seems like Google supports up to 24 hours
<https://cloud.google.com/run/docs/configuring/task-timeout>

hey <@U04UDDJKTSS> - i believe the cloud run v1 api supports 3600s jobs whereas the cloud run v2 api supports longer jobs

and our cloud run infra block / work pool are currently using cloud run's v1 api -- I know <@U05NAGU8139> has something in the works on this, did I get that right?

Yess you're right <@U02GMEZU18B> :party-parrot: !

Hey <@U04UDDJKTSS>, currently using this at work -&gt; <https://github.com/japerry911/prefect-gcp/tree/skylord/new/cloud_run_v2_and_worker_v2-active>

Cloud Run V2 Worker/block, built out like 90%, just need to add kill functionality and unit tests. Will open PR for Prefect_Gcp repo for it in 2-3 weeks as I am traveling this weekend!

There is an issue in the Google API Client Library, where a parameter that exists is not available for use. So I posted issue to Google API Python Client GitHub, and will be able to finish this worker when that's done. Everything but tests/cancelling is done.

Hi <@U02GMEZU18B>, I just asked about the same thing in another channel before seeing this thread.
<https://prefect-community.slack.com/archives/CL09KU1K7/p1698335431756979>

The 3600s still appears to be a limit in the Prefect Cloud UI. Are there any updates on support for longer  job timeouts?

as mentioned above in this thread, the limit comes from the cloud run v1 api, which backs our current worker. i know jack is planning on contributing a worker to prefect-gcp which uses the v2 api and therefore supports longer jobs

Hello <@U02GMEZU18B>, <@U05NAGU8139>, do you have any updates about the jobs timeouts?

Hey <@U01JABW87DM>! Cloud Run V2 worker is in main now and allows 24 hour timeout

Yeah ! Thank you <@U05NAGU8139>, let's try it ! Thank you