When using `from prefect tasks shell import ShellTask` it th

Question

When using `from prefect tasks shell import ShellTask` it throws out and error `ModuleNotFoundError No module named prefect tasks shell prefect tasks is not a package` I know i can use `prefect shell` to overcome this and run python scripts but i couldn t find any resolution on the above error

Ryan Peden · Answer

`ShellTask` is a Prefect v1 feature It looks like you are using 2 x which is why you are seeing that error

Laraib Siddiqui · Answer

Okay understood So for now to run python scripts from bash prefect shell is the way to go right

Ryan Peden · Answer

That is correct slightly smiling face

Laraib Siddiqui · Answer

Thank you < Ryan Peden>

Ryan Peden · Answer

You re very welcome If you have any questions about using `prefect shell` feel free to reply in this thread

Laraib Siddiqui · Answer

Instead of running sub flows for shell commands can we run these shell commands as task inside a main flow

Ryan Peden · Answer

Yes you should be able to `shell run command` from `prefect shell` is a task so you can call it several times inside a single flow

Laraib Siddiqui · Answer

< Ryan Peden> As you can see above Different sub flows are being created for those different shell execution Is it possible to have a flow and task system where i can run the main flow and see all the shell commands as task in that flow

Ryan Peden · Answer

Yes that is possible Do you have an example of the code that is causing those multiple subflow runs That would give me a better understanding of the results you are seeing so I can provide suggestions

Laraib Siddiqui · Answer

```from prefect import flow task from prefect shell import shell run command flow def first shell command return shell run command command= python2 telecaller leads py return all=True flow def second shell command return shell run command command= python2 teleconsultation py return all=True flow def third shell command return shell run command command= python2 user profiles created last 24 hours py return all=True flow def third shell command return shell run command command= python2 user profiles created last 24 hours py return all=True flow def fourth shell command return shell run command command= python2 non delivered orders py return all=True flow def final shell run first shell command second shell command third shell command fourth shell command print final shell run print example shell run command flow flow run ```

Ryan Peden · Answer

If you remove the ` flow` decorators from the four shell command functions they will run as tasks since `shell run command` is a task This should work ```def first shell command return shell run command command= python2 telecaller leads py return all=True def second shell command return shell run command command= python2 teleconsultation py return all=True def third shell command return shell run command command= python2 user profiles created last 24 hours py return all=True def fourth shell command return shell run command command= python2 non delivered orders py return all=True flow def final shell run first shell command second shell command third shell command fourth shell command if name == main final shell run ``` The downside here is that the tasks won t have custom names they would show up as `shell run command random id ` If you want the tasks to be named you can use `with options` ```def first shell command run = shell run command with options name= Command 1 return run command= python2 telecaller leads py return all=True def second shell command run = shell run command with options name= Command 2 return run command= python2 teleconsultation py return all=True def third shell command run = shell run command with options name= Command 3 return run command= python2 user profiles created last 24 hours py return all=True def fourth shell command run = shell run command with options name= Command 4 return run command= python2 non delivered orders py return all=True ``` It s worth giving these a try to see if they do what you are looking for If you want to run lots of named shell command tasks I can probably suggest some patterns that would prevent the need to use two lines of code every time you run a command

Laraib Siddiqui · Answer

Thanks for the help

Laraib Siddiqui · Answer

How can i run these task parallel instead of sequential order I am trying to use dask runner as you mentioned above the shell commands are task How can i run these task parallely ```from prefect import flow task from prefect shell import shell run command from prefect dask task runners import DaskTaskRunner def tele caller return shell run command command= python3 data analytics telecaller leads py r 0 return all=True def teleconsultation return shell run command command= python3 data analytics teleconsultation py r 0 return all=True def user profiles return shell run command command= python3 data analytics user profiles created last 24 hours py r 0 return all=True def error pages return shell run command command= python3 data analytics error pages data py r 0 return all=True def non del return shell run command command= python3 data analytics non delivered orders py r 0 return all=True def non ship return shell run command command= python3 data analytics non shipped orders py r 0 return all=True def gmd review return shell run command command= python3 data analytics good md content data py r 0 return all=True def gmd content return shell run command command= python3 data analytics good md review data py r 0 return all=True flow def final docker run task runner=DaskTaskRunner user profiles submit tele caller submit teleconsultation submit non del submit non ship submit error pages submit gmd content submit gmd review submit if name == main final docker run print final shell run print example shell run command flow ```

Laraib Siddiqui · Answer

Instead of defining flows as task If i take subflow approach can i use the dasktaskrunner and how do i schedule different sublows for different schedules Should i keep different task which will at the same time in a same flow or is it possible to have a flow with task that can run at different time schedules ```from prefect import flow task from prefect shell import shell run command from prefect orion schemas schedules import CronSchedule import pendulum daily schedule = CronSchedule 0 17 flow def first shell command schedule=daily schedule return shell run command command= python3 data analytics telecaller leads py r 0 return all=True daily schedule 2 = CronSchedule 0 17 flow def second shell command schedule=daily schedule 2 return shell run command command= python3 data analytics teleconsultation py r 0 return all=True flow def final shell run first shell command second shell command if name == main final shell run ```

Laraib Siddiqui · Answer

< Ryan Peden>