I am encountering `Permission denied` errors with the github

Question

I am encountering `Permission denied` errors with the github storage blocks since today Has anyone seen this as well The error appears if the github repo is already present from a previous run If the repo is deleted the gitrepo is cloned without any error

Tim-Oliver · Answer

```shutil Error tmp tmpzw4y7qtmprefect git objects 51 16fdcab0c85837d53ac9ee05bbeb7b0831429f git objects 51 16fdcab0c85837d53ac9ee05bbeb7b0831429f Errno 13 Permission denied git objects 51 16fdcab0c85837d53ac9ee05bbeb7b0831429f tmp tmpzw4y7qtmprefect git objects b7 6ed055126028e448438c6c1503991c8a70de97 git objects b7 6ed055126028e448438c6c1503991c8a70de97 Errno 13 Permission denied git objects b7 6ed055126028e448438c6c1503991c8a70de97 tmp tmpzw4y7qtmprefect git objects d5 222fd9a29067934daed5b4b0fb6307f70cf786 git objects d5 222fd9a29067934daed5b4b0fb6307f70cf786 Errno 13 Permission denied git objects d5 222fd9a29067934daed5b4b0fb6307f70cf786 tmp tmpzw4y7qtmprefect git objects f4 0a470220a9ccc37f0005f7978e8df1695dfb97 git objects f4 0a470220a9ccc37f0005f7978e8df1695dfb97 Errno 13 Permission denied git objects f4 0a470220a9ccc37f0005f7978e8df1695dfb97 tmp tmpzw4y7qtmprefect git objects e6 9de29bb2d1d6434b8b29ae775ad8c2e48c5391 git objects e6 9de29bb2d1d6434b8b29ae775ad8c2e48c5391 Errno 13 Permission denied git objects e6 9de29bb2d1d6434b8b29ae775ad8c2e48c5391 tmp tmpzw4y7qtmprefect git objects 35 9b656038f5c35061d26f5f73cdd258d29d0261 git objects 35 9b656038f5c35061d26f5f73cdd258d29d0261 Errno 13 Permission denied git objects 35 9b656038f5c35061d26f5f73cdd258d29d0261 tmp tmpzw4y7qtmprefect git objects 15 9200a08fdc5741d070d432338b9c2ef18ed529 git objects 15 9200a08fdc5741d070d432338b9c2ef18ed529 Errno 13 Permission denied git objects 15 9200a08fdc5741d070d432338b9c2ef18ed529 tmp tmpzw4y7qtmprefect git objects 9d 10168d3633499e25522a57c8109767f0819735 git objects 9d 10168d3633499e25522a57c8109767f0819735 Errno 13 Permission denied git objects 9d 10168d3633499e25522a57c8109767f0819735 tmp tmpzw4y7qtmprefect git objects 3e 5551707d7888df29e5182461fcc324efeda522 git objects 3e 5551707d7888df29e5182461fcc324efeda522 Errno 13 Permission denied git objects 3e 5551707d7888df29e5182461fcc324efeda522 tmp tmpzw4y7qtmprefect git objects b2 c164d3a81663f1823a1baebc1b98f589fc8634 git objects b2 c164d3a81663f1823a1baebc1b98f589fc8634 Errno 13 Permission denied git objects b2 c164d3a81663f1823a1baebc1b98f589fc8634 tmp tmpzw4y7qtmprefect git objects 62 dc4b9d007c19610d4c8cf9b43b7851c2b315da git objects 62 dc4b9d007c19610d4c8cf9b43b7851c2b315da Errno 13 Permission denied git objects 62 dc4b9d007c19610d4c8cf9b43b7851c2b315da tmp tmpzw4y7qtmprefect git objects f9 53d1d075afbc06216855d7855503f9ea9b70a0 git objects f9 53d1d075afbc06216855d7855503f9ea9b70a0 Errno 13 Permission denied git objects f9 53d1d075afbc06216855d7855503f9ea9b70a0 tmp tmpzw4y7qtmprefect git objects 3a d797acf2f668e46454014df230ce4a5a76b1da git objects 3a d797acf2f668e46454014df230ce4a5a76b1da Errno 13 Permission denied git objects 3a d797acf2f668e46454014df230ce4a5a76b1da tmp tmpzw4y7qtmprefect git objects 79 c899a064ac6800264c61d9cfb04104df966a42 git objects 79 c899a064ac6800264c61d9cfb04104df966a42 Errno 13 Permission denied git objects 79 c899a064ac6800264c61d9cfb04104df966a42 tmp tmpzw4y7qtmprefect git objects cf b8a3d7361b654ac455084b181cadd7a5f3c4e6 git objects cf b8a3d7361b654ac455084b181cadd7a5f3c4e6 Errno 13 Permission denied git objects cf b8a3d7361b654ac455084b181cadd7a5f3c4e6 tmp tmpzw4y7qtmprefect git objects be e211a193292471d39e45698d228ee54039d802 git objects be e211a193292471d39e45698d228ee54039d802 Errno 13 Permission denied git objects be e211a193292471d39e45698d228ee54039d802 ```

Anna Geller · Answer

Can you rotate your personal access token

Anna Geller · Answer

here is how <https medium com the prefect blog modular data stack build a data platform with prefect dbt and snowflake part 6 7e6d69296649 c31b>

Tim-Oliver · Answer

Exchanged the token but this did not solve the issue The issue seems to be on the filesystem level but I don t understand how cloning the first time works well but the second time fails

Tim-Oliver · Answer

Some of the objects in `prefect working dir git objects` have only read only permissions

Tim-Oliver · Answer

```Flow could not be retrieved from deployment Traceback most recent call last File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect engine py line 255 in retrieve flow then begin flow run flow = await load flow from flow run flow run client=client File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect client utilities py line 47 in with injected client return await fn args kwargs File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect deployments py line 163 in load flow from flow run await storage block get directory from path=deployment path local path= File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect filesystems py line 917 in get directory copytree src=content source dst=content destination dirs exist ok=True File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 shutil py line 568 in copytree return copytree entries=entries src=src dst=dst symlinks=symlinks File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 shutil py line 522 in copytree raise Error errors shutil Error tmp tmpjf2bug7lprefect git objects 51 16fdcab0c85837d53ac9ee05bbeb7b0831429f git objects 51 16fdcab0c85837d53ac9ee05bbeb7b0831429f Errno 13 Permission denied git objects 51 16fdcab0c85837d53ac9ee05bbeb7b0831429f tmp tmpjf2bug7lprefect git objects b7 6ed055126028e448438c6c1503991c8a70de97 git objects b7 6ed055126028e448438c6c1503991c8a70de97 Errno 13 Permission denied git objects b7 6ed055126028e448438c6c1503991c8a70de97 tmp tmpjf2bug7lprefect git objects d5 222fd9a29067934daed5b4b0fb6307f70cf786 git objects d5 222fd9a29067934daed5b4b0fb6307f70cf786 Errno 13 Permission denied git objects d5 222fd9a29067934daed5b4b0fb6307f70cf786 tmp tmpjf2bug7lprefect git objects f4 0a470220a9ccc37f0005f7978e8df1695dfb97 git objects f4 0a470220a9ccc37f0005f7978e8df1695dfb97 Errno 13 Permission denied git objects f4 0a470220a9ccc37f0005f7978e8df1695dfb97 tmp tmpjf2bug7lprefect git objects e6 9de29bb2d1d6434b8b29ae775ad8c2e48c5391 git objects e6 9de29bb2d1d6434b8b29ae775ad8c2e48c5391 Errno 13 Permission denied git objects e6 9de29bb2d1d6434b8b29ae775ad8c2e48c5391 tmp tmpjf2bug7lprefect git objects 35 9b656038f5c35061d26f5f73cdd258d29d0261 git objects 35 9b656038f5c35061d26f5f73cdd258d29d0261 Errno 13 Permission denied git objects 35 9b656038f5c35061d26f5f73cdd258d29d0261 tmp tmpjf2bug7lprefect git objects 15 9200a08fdc5741d070d432338b9c2ef18ed529 git objects 15 9200a08fdc5741d070d432338b9c2ef18ed529 Errno 13 Permission denied git objects 15 9200a08fdc5741d070d432338b9c2ef18ed529 tmp tmpjf2bug7lprefect git objects 9d 10168d3633499e25522a57c8109767f0819735 git objects 9d 10168d3633499e25522a57c8109767f0819735 Errno 13 Permission denied git objects 9d 10168d3633499e25522a57c8109767f0819735 tmp tmpjf2bug7lprefect git objects 3e 5551707d7888df29e5182461fcc324efeda522 git objects 3e 5551707d7888df29e5182461fcc324efeda522 Errno 13 Permission denied git objects 3e 5551707d7888df29e5182461fcc324efeda522 tmp tmpjf2bug7lprefect git objects b2 c164d3a81663f1823a1baebc1b98f589fc8634 git objects b2 c164d3a81663f1823a1baebc1b98f589fc8634 Errno 13 Permission denied git objects b2 c164d3a81663f1823a1baebc1b98f589fc8634 tmp tmpjf2bug7lprefect git objects 62 dc4b9d007c19610d4c8cf9b43b7851c2b315da git objects 62 dc4b9d007c19610d4c8cf9b43b7851c2b315da Errno 13 Permission denied git objects 62 dc4b9d007c19610d4c8cf9b43b7851c2b315da tmp tmpjf2bug7lprefect git objects fc 09abcf4631f147623fcd3f0f1cd9f9af36cb7c git objects fc 09abcf4631f147623fcd3f0f1cd9f9af36cb7c Errno 13 Permission denied git objects fc 09abcf4631f147623fcd3f0f1cd9f9af36cb7c tmp tmpjf2bug7lprefect git objects a8 c3a0a8b0be94c400fde72a6b045c8759c5167f git objects a8 c3a0a8b0be94c400fde72a6b045c8759c5167f Errno 13 Permission denied git objects a8 c3a0a8b0be94c400fde72a6b045c8759c5167f tmp tmpjf2bug7lprefect git objects 3a d797acf2f668e46454014df230ce4a5a76b1da git objects 3a d797acf2f668e46454014df230ce4a5a76b1da Errno 13 Permission denied git objects 3a d797acf2f668e46454014df230ce4a5a76b1da tmp tmpjf2bug7lprefect git objects 79 c899a064ac6800264c61d9cfb04104df966a42 git objects 79 c899a064ac6800264c61d9cfb04104df966a42 Errno 13 Permission denied git objects 79 c899a064ac6800264c61d9cfb04104df966a42 tmp tmpjf2bug7lprefect git objects cf b8a3d7361b654ac455084b181cadd7a5f3c4e6 git objects cf b8a3d7361b654ac455084b181cadd7a5f3c4e6 Errno 13 Permission denied git objects cf b8a3d7361b654ac455084b181cadd7a5f3c4e6 tmp tmpjf2bug7lprefect git objects be e211a193292471d39e45698d228ee54039d802 git objects be e211a193292471d39e45698d228ee54039d802 Errno 13 Permission denied git objects be e211a193292471d39e45698d228ee54039d802 ```

Tim-Oliver · Answer

Alright the issue was that the permissions of the working directory were messed up

Tim-Oliver · Answer

Hm Still not good Somehow the working directory permissions get messed up while the process infrastructure is setup When I create the directory the first time I sets permissions to `rwxrwxr x` Then I run the flow and the permissions change to `rwx ` The next run fails due to permission denied on copying the git repo contents from tmp to the working dir

Tim-Oliver · Answer

I can work around it by setting chmod 775 R on the working dir in the infrastructure commands Should I file an issue

Anna Geller · Answer

It looks like you are running this in a very restricted environment correct We can certainly add that info to the docs but not sure what we can do about it otherwise Code is cloned into a temp directory for execution Thanks for the update nice troubleshooting

Tim-Oliver · Answer

True my environment is pretty restricted Out of curiosity why is the code cloned into a temp dir and then copied to the working dir instead of directly cloned into the working dir

Peyton Runyan · Answer

What python version are you running Is it 3 7 by chance And what prefect version are you using

Tim-Oliver · Answer

python 3 9 13 and prefect 2 6 9

Peyton Runyan · Answer

We changed from the `distutils` implementation of `copy tree` to `shutil copytree` because `distutils` is scheduled to be deprecated I m wondering if this caused a regression <https github com PrefectHQ prefect pull 7441>

Tim-Oliver · Answer

Maybe I observe this behavior since yesterday I also upgraded yesterday to prefect 2 6 9

Tim-Oliver · Answer

On Monday I used prefect main branch and did not encounter this

Tim-Oliver · Answer

Happy to test this if you let me know which commits I should install for testing

Peyton Runyan · Answer

Can you go into your prefect installation under `src prefect filesystems py` and delete this import `from prefect utilities compat import copytree` and add this import `from distutils dir util import copy tree as copytree`

Peyton Runyan · Answer

and then see if it works

Tim-Oliver · Answer

Different signature ```Flow could not be retrieved from deployment Traceback most recent call last File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect engine py line 255 in retrieve flow then begin flow run flow = await load flow from flow run flow run client=client File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect client utilities py line 47 in with injected client return await fn args kwargs File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect deployments py line 163 in load flow from flow run await storage block get directory from path=deployment path local path= File tungstenfs scratch gmicro share prefect miniconda3 envs test gfriedri em alignment flows lib python3 9 site packages prefect filesystems py line 917 in get directory copytree src=content source dst=content destination dirs exist ok=True TypeError copy tree got an unexpected keyword argument dirs exist ok ```

Peyton Runyan · Answer

Ah shoot that s right If you re in an experimental mood can you go to line `917` and change the signature to `copytree src=content source dst=content destination ` and then try again

Tim-Oliver · Answer

Yes This fixes the issue

Tim-Oliver · Answer

Reverted back to 2 6 9 and the error is back as well

Tim-Oliver · Answer

Thanks for looking into this with me I have to run now workday is over

Tim-Oliver · Answer

Is there a github issue I could follow or is this not considered a bug

Peyton Runyan · Answer

I don t think there s an issue for this I m just getting back from the Thanksgiving break so my to do list is packed this morning Would you be able make one when you get a moment I ll discuss it with the team this week and see if it we would consider this to be a bug or expected behavior

Tim-Oliver · Answer

Welcome back hope it was great I will open an issue

Tim-Oliver · Answer