Hi - I have had trouble passing credentials to validate bigquery for some time now. I pasted the json into a GCP Credentials block Then I try validating in this way:

from prefect_gcp import GcpCredentials

gcp_credentials_block = GcpCredentials.load("bq-credentials")
bigquery_client = bigquery.Client(credentials=gcp_credentials_block)

I receive this error message: "ValueError: This library only supports credentials from google-auth-library-python. See https://google-auth.readthedocs.io/en/latest/ for help on authentication with this library." How can I pass credentials to GCP successfully?

I believe the bigquery client is expecting a

Credentials

object. The data stored in the GcpCredentials block is

service_account_info

. If you install the

google-auth

python package, you can do something like:

from google.oauth2.service_account import Credentials
from prefect_gcp import GcpCredentials

gcp_credentials_block = GcpCredentials.load("bq-credentials")
creds = Credentials.from_service_account_info(gcp_credentials_block.service_account_info)
bigquery_client = bigquery.Client(credentials=creds)

There’s a difference between GcpCredentials and Google’s auth credentials. However, GcpCredentials provides a method, get_credentials_from_service_account to get Google’s auth credentials. So you can do:

from prefect_gcp import GcpCredentials

gcp_credentials_block = GcpCredentials.load("bq-credentials")
google_auth_credentials = gcp_credentials_block.get_credentials_from_service_account()
bigquery_client = bigquery.Client(credentials=google_auth_credentials)

Alternatively, you can simply get the bigquery client directly from gcp_credentials

gcp_credentials_block = GcpCredentials.load("bq-credentials").get_bigquery_client()

or best practice is simply to use one of the built-in tasks: https://github.com/PrefectHQ/prefect-gcp/blob/main/prefect_gcp/bigquery.py

^^^ 🙌

I receive this error "'coroutine' object has no attribute 'get_credentials_from_service_account'" am i missing a download?

are you using a notebook; if so, you need to await

gcp_credentials_block = await GcpCredentials.load("bq-credentials")

or, you can simply put everything into a flow, and it should work without the await

i am using a notebook for building...that is great caveat to know. thank you, that worked now!

yep it’s an issue here I’ll see if I can fix it soon because I also work in notebooks and it’s a bother