I m trying to use ECSRun to run a couple of DBTShellTasks Wh

Question

I m trying to use ECSRun to run a couple of DBTShellTasks When I run this `flow py` locally it returns that both tasks were successful however I can see that it didn t actually run the dbt package Any thoughts here The dbt package is just in the same folder as the `flow py` I m assuming this all gets packaged up and run on ECS

Kevin Kho · Answer

Hey < Eric Mauser> what Storage did you use

Eric Mauser · Answer

```import prefect from prefect tasks dbt import DbtShellTask from prefect storage import Docker from prefect run configs import ECSRun from prefect import task Flow Parameter STORAGE = Docker registry url= lt myrole gt image name= dbt image tag= latest RUN CONFIG = ECSRun execution role arn= lt myrole gt image = dbt labels= dev with Flow dbt storage=STORAGE run config=RUN CONFIG as flow task = DbtShellTask profile name= default profiles dir= command = dbt deps task2 = DbtShellTask profile name= default profiles dir= command = dbt run flow register lt myproject gt flow run ```

Eric Mauser · Answer

< Kevin Kho> Docker storage

Kevin Kho · Answer

Docker Storage looks good and it seems like it would error out if it did not run in the right directory I think we would try to need to get more logs here Try `stream output=True` and `return all=True`as seen <https docs prefect io api latest tasks shell html shelltask|here> so we can get the logs from the Shell Task Also I guess you can try using the container built and running those commands without Prefect to see if they work

Eric Mauser · Answer

okay looks like it is running locally now However it says dbt command not found when run on ECS I m guessing this is because I didn t sprecify an image so it is using the default prefect image Can I just do `image=fishtownanalytics dbt 0 19 2` or do I need to build a custom image that combines prefect and dbt

Kevin Kho · Answer

I believe as long as the image has Python prefect will install itself onto the container using additional commands need pip also If that doesn t work then I guess you have to create an image that contains both

Kevin Kho · Answer

I tried digging through the code but not seeing it self install so really not sure that ll work