Aaron Gonzalez
bigquery_query
if await bigquery_query( exists_query, creds ): print(f"Deleting data from the {sync_date} partition.") await bigquery_query( del_query, creds ) await bigquery_query( load_query, creds )
Wellington Braga
@task( name="name_task", task_run_name="name_runned_task", )
my_task = bigquery_query my_task.name = "name_task" await myt_task(load_query, creds)
Ryan Peden
with_options
exists_task = bigquery_query.with_options(name="check existence") delete_task = bigquery_query.with_options(name="delete data") load_task = bigquery_query.with_options(name="load data") if await exists_task(exists_query, creds): print(f"Deleting data from the {sync_date} partition.") await delete_task(del_query, creds) await load_task(load_query, creds)
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.