Sumit Kumar Rai
08/04/2021, 11:47 AMdbt deps
dbt snapshot
dbt run
For now I'm running them by reusing the instance of DbtShellTask:
dbt_task = DbtShellTask(name="Running dbt commands", ...)
dbt_clean_task_invoke = dbt_task("dbt deps")
dbt_deps_task_invoke = dbt_task("dbt snapshot")
dbt_run_task_invoke = dbt_task("dbt run")
With having this setup, my schematic will have three boxes(tasks) with name Running dbt commands
which is difficult to identify which is which.
In order to fix that, do I have to instantiate for each command like below.
dbt_clean_task = DbtShellTask(name="Running dbt deps command", ...)
dbt_deps_task = DbtShellTask(name="Running dbt snapshot command", ...)
dbt_run_task = DbtShellTask(name="Running dbt run command", ...)
dbt_clean_task_invoke = dbt_clean_task("dbt deps")
dbt_deps_task_invoke = dbt_deps_task("dbt snapshot")
dbt_run_task_invoke = dbt_run_task("dbt run")
Kevin Kho
dbt = DbtShellTask
with Flow("a") as flow:
dbt_clean_task = dbt(name="Running dbt deps command", ...)("dbt deps")
dbt_deps_task = dbt(name="Running dbt snapshot command", ...)("dbt snapshot")
dbt_run_task = dbt(name="Running dbt run command", ...)("dbt run")
Matthias Roels
08/04/2021, 2:18 PMdbt = DbtShellTask(**kwargs)
with Flow("a") as flow:
dbt_deps = dbt(command="dbt deps", task_args={"name" = "Running dbt deps command"}
dbt_snapshot = dbt(command="dbt snapshot", task_args={"name": "Running dbt snapshot command"}, upstream_task=[dbt_deps])
...
Sumit Kumar Rai
08/04/2021, 4:01 PM