Jonas Hanfland
08/19/2020, 4:01 PMBigQueryTask()
arguments at runtime? Basically I would like to be able to change the table_dest
argument based on an environment variable, so that I can save my query result in a different place depending on if I run the flow locally or elsewhere.
Thanks very much in advancejosh
08/19/2020, 4:03 PM# initialization
task = BigQueryTask(table_dest=...)
with Flow('my flow') as flow:
# value retrieved during runtime
task(table_dest=new_value)
When grabbing the value from an environment variable you might want to have an upstream task which calls something like os.getenv()
and then passes that result to the downstream bigquerytask’s table_dest kwargJonas Hanfland
08/19/2020, 4:17 PM