Hi! I am wondering if anyone is able to use ShellT...
# ask-communitym
Maria
02/25/2021, 11:59 PMHi! I am wondering if anyone is able to use ShellTask on Windows?
I'm running a script from tutorial and getting an error:
Copy code
from prefect import Flow
from prefect.tasks.shell import ShellTask
task = ShellTask(helper_script="cd ~")
with Flow("My Flow") as f:
contents = task(command='ls')
out = f.run() Copy code
[2021-02-26 10:32:28+1100] INFO - prefect.FlowRunner | Beginning Flow run for 'My Flow'
[2021-02-26 10:32:28+1100] INFO - prefect.TaskRunner | Task 'ShellTask': Starting task run...
[2021-02-26 10:32:28+1100] ERROR - prefect.TaskRunner | Unexpected error: FileNotFoundError(2, 'The system cannot find the file specified', None, 2, None)
Traceback (most recent call last):
.....
....
python\python38-32\lib\subprocess.py", line 1307, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError: [WinError 2] The system cannot find the file specifiedtask = ShellTask(shell="C:\Windows\System32\bash.exe", helper_script="cd ~")z
Zanie
02/26/2021, 12:31 AM
Hi @Maria -- I believe it should work. I'm surprised specifiying the full path doesn't do it.
Zanie
02/26/2021, 12:36 AM
We're using Python's
subprocess.Popen([shell]) Copy code
import subprocess
process = subprocess.Popen(["C:\Windows\System32\bash.exe"])Zanie
02/26/2021, 12:36 AM
For example, on my machine this gets me
Copy code
❯ python
Python 3.8.6 (default, Feb 19 2021, 10:36:24)
[Clang 12.0.0 (clang-1200.0.32.29)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import subprocess
>>> subprocess.Popen(["bash"])
<subprocess.Popen object at 0x10115ea00>
>>>
The default interactive shell is now zsh.
To update your account to use zsh, please run `chsh -s /bin/zsh`.
For more details, please visit <https://support.apple.com/kb/HT208050>.
bash-3.2$m
Maria
02/26/2021, 1:37 AMHi @Zanie, I'm getting same error when I call subprocess in an interactive python session
Maria
02/26/2021, 1:40 AMI saw many posts on stakeoverflow with this error, and the recommendation is usually pass shell=True as an argument. I'm getting "somewhat" further if I do that:
Copy code
>>> subprocess.Popen("C:\Windows\System32\bash.exe", shell=True)
<subprocess.Popen object at 0x039AE718>
>>> The filename, directory name, or volume label syntax is incorrect.Maria
02/26/2021, 1:46 AMI also found this which seems similar to what I experience: https://github.com/PrefectHQ/prefect/issues/3790
z
Zanie
02/26/2021, 1:47 AM
Looks like it's broken on Windows! That one fell through the cracks. We'll work on a fix 👍
🙏 1
m
Maria
02/26/2021, 1:47 AMthanks!
t
theo geer
04/13/2021, 3:35 PMSorry to revive this thread. Is there any progress on resolving this?
z
Zanie
04/13/2021, 3:37 PM
Eek. I'm sorry. I'll open an issue so this gets resolved -- barring some sort of surprising complication it'll be fixed today.
Zanie
04/13/2021, 3:38 PM
@Marvin open "`ShellTask` does not work on Windows"
m
Marvin
04/13/2021, 3:38 PMt
theo geer
04/13/2021, 3:59 PMthanks so much!!
z
Zanie
04/14/2021, 1:04 AM
Zanie
04/14/2021, 1:04 AM
This took me forever 🤦♂️ haha
Zanie
04/14/2021, 1:04 AM
Windows is tough