Joshua Greenhalgh
04/19/2022, 12:31 PMAnna Geller
04/19/2022, 12:46 PMpygit2.clone_repository(url=repo_url, path=DBT_PROJECT, checkout_branch=branch)
Joshua Greenhalgh
04/19/2022, 12:55 PMJoshua Greenhalgh
04/22/2022, 10:32 AMAnna Geller
04/22/2022, 10:40 AMDbtShellTask
command runs as a subprocess, so even if you mount it to the underlying pod, I'm not sure whether this would be available to this dbt subprocess
doing this via DbtShellTask
args and Prefect Secrets is easier and I can confirm that it worksJoshua Greenhalgh
04/22/2022, 10:55 AMAnna Geller
04/22/2022, 11:04 AMkeyfile: your_service_account_file.json
my-bigquery-db:
target: dev
outputs:
dev:
type: bigquery
method: service-account-json
project: [GCP project id]
dataset: [the name of your dbt dataset]
threads: [1 or more]
[<optional_config>](#optional-configurations): <value>
# These fields come from the service account json keyfile
keyfile_json:
type: xxx
project_id: xxx
private_key_id: xxx
private_key: xxx
client_email: xxx
client_id: xxx
auth_uri: xxx
token_uri: xxx
auth_provider_x509_cert_url: xxx
client_x509_cert_url: xxx