we tried creating our own docker image with the requirements.txt:

prefect
prefect-docker

and running the init command:

prefect worker start --pool 'my-work-pool' --type docker