Hi , can someone tell me how to pass Service Account Info in the prefect_gcp block. I wanted to pass the values from the secrets block but prefect 2 doesn't seem to support json in secret block. What is the best way to get GCP BigQuery client from a dictionary. i.e a way to pass a dictionary from any of the blocks so that I can pass the Service Account Info as a parameter to the to obtain the big query client.
@Kalise Richmond Yes, I am using the GCP credential block and its working now. Thanks. What is the equivalent for defining upstream tasks in prefect 2 ? is it wait_for ?
k
Kalise Richmond
11/09/2022, 5:32 PM
Yes, you can use
wait_for
for async calls or if you pass the task output into another task, it is automatically assigned as having upstream and downstream dependencies.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.