@Bianca Hoch has joined the channel

@Jeff Hale has joined the channel

@Ryan Peden has joined the channel

@Khuyen Tran has joined the channel

@Orbit has joined the channel

@Linen has joined the channel

@Discourse Integration has joined the channel

@Nelson Griffiths has joined the channel

@Kevin Grismore has joined the channel

@Rob Freedy has joined the channel

@Jamie Zieziula has joined the channel

@Nate has joined the channel

@James Sopkin has joined the channel

@Owen McMahon has joined the channel

@Andrew Huang has joined the channel

@Josh has joined the channel

@Anthony Head has joined the channel

cross-posting: @Ryan Peden has a new article out :gcp: https://prefect-community.slack.com/archives/CL09KTZPX/p1667486942247079

Hi gcp ch, After reading many guidelines, I wrote 101 tutorial to help ppl want to use Prefect through GKE. Wish ppl could have fun with Prefect/GKE/dbt. CLICK_ME 🙏🏻

I am running into some errors today with pushing flows to my cloud storage bucket when applying deployments. I updated the most recent version of both

prefect

and

prefect-gcp

Hi - I have had trouble passing credentials to validate bigquery for some time now. I pasted the json into a GCP Credentials block Then I try validating in this way:

from prefect_gcp import GcpCredentials

gcp_credentials_block = GcpCredentials.load("bq-credentials")
bigquery_client = bigquery.Client(credentials=gcp_credentials_block)

I receive this error message: "ValueError: This library only supports credentials from google-auth-library-python. See https://google-auth.readthedocs.io/en/latest/ for help on authentication with this library." How can I pass credentials to GCP successfully?

Hi there. Is there some documentation I can read on running prefect on on spot instances (GCP)? Kinda curious if that something that will work and if so, what setup is require.

This warning started popping up when I run flows locally for testing. It doesn't seem to be interfering with my flows at all, but not sure if this is something I should worry about?

Warning!  Failed to load collection 'prefect_gcp_aiplatform': ModuleNotFoundError: No module named 'google.cloud.aiplatform'

I started getting this error when trying to run a deployment for a cloud run job today:

Submission failed. KeyError: "No class found for dispatch key 'cloud-run-job' in registry for type 'Block'."

Not quite sure what it means?

👋 Hi, I'm encountering the same error as described above, incognito did not help unfortunately.

Submission failed. KeyError: "No class found for dispatch key 'cloud-run-job' in registry for type 'Block'."

Probably it's due to a misconfiguration on the deployment python file (or maybe the infrastructure block itself?), adding more info to the thread 🤔

I am quite new to Prefect and I tried running prefect using cloudrun but the job is not getting triggered at cloudrun. Deployment is working fine. But flow runs are getting into "Late" state with no logs. Not able to debug due to no logs. Any suggestions ?

👋 Hi, I'm probably (surely) missing something very simple, I'm currently not able to load a bucket from a GCS block using

GcsBucket.load

classmethod following the reference here.

ValueError: Unable to find block document named tam-2759-bucket for block type gcs-bucket

More details in the thread 🧵

Hello there folks! I'm a prefect cloud user running agents on GKE autopilot. I've recently updated my prefect agent from 2.7.0 to 2.7.8 to be able to deal with https://github.com/PrefectHQ/prefect/issues/7442 (was getting thousands of those every day), and am now struggling with an issue with the new agent, namely https://github.com/PrefectHQ/prefect/issues/7842 (permission denied while trying to read the

kube-system

namespace). As per the workaround in the bug, I've updated my existing staging agent role so that it can read namespaces:

➜ ~ kubectl describe role prefect-staging-agent 
Name:         prefect-staging-agent
Labels:       <none>
Annotations:  <none>
PolicyRule:
  Resources    Non-Resource URLs  Resource Names  Verbs
  ---------    -----------------  --------------  -----
  jobs.batch   []                 []              [list watch create update patch get delete]
  namespaces   []                 []              [list watch get]
  pods/log     []                 []              [list watch get]
  pods/status  []                 []              [list watch get]
  pods         []                 []              [list watch get]

to no avail. Still getting

"Failure","message":"namespaces \"kube-system\" is forbidden: User \"system:serviceaccount:default:default\" cannot get resource \"namespaces\" in API group \"\" in the namespace \"kube-system\"","reason":"Forbidden"

Any ideas of what might I be missing? Guess my main concern is that kube-system might be off limits for autopilot but couldn't find anything saying you can't read stuff from it.

Hello Prefect-GCP team! I have been fortunate to have used great Prefect-GCP/Prefect-AWS repos in the past quarter, and would love to try to contribute to the GCP repo during my free time. Who would I reach out to about possibly contributing?