Hi! I wonder how come that BigQueryTask have no ability to return
query_job
object. I mean, if one have an idea to log the results of the query (status, proceeded_bytes, etc.), he or she can not get an object to fetch that info.
I mean something like that (tasks/gcp/bigquery.py; class BigQueryTask; def run):
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.