Atul Anand
04/01/2022, 1:12 AMChu Lục Ninh
04/01/2022, 1:25 AMFROM prefecthq/prefect
RUN python3 - m pip install somelib
And run that image instead of original prefect imageAtul Anand
04/01/2022, 1:48 AMChu Lục Ninh
04/01/2022, 1:52 AMAtul Anand
04/01/2022, 1:53 AMChu Lục Ninh
04/01/2022, 1:54 AMAtul Anand
04/01/2022, 1:58 AMChu Lục Ninh
04/01/2022, 2:00 AM~/.prefect/flows/
, did you register in host machine? What location did you mount the flow?Atul Anand
04/01/2022, 2:00 AMvolumes:
- /srv/docker/prefect/flows:/root/.prefect/flows
- type: bind
source: ./config.toml
target: /root/.prefect/config.toml
read_only: true
# debug mode
debug = true
# base configuration directory (typically you won't change this!)
home_dir = "~/.prefect"
backend = "server"
[server]
host = "<http://172.17.0.1>"
port = "4200"
host_port = "4200"
endpoint = "${server.host}:${server.port}"
Kevin Kho
Atul Anand
04/01/2022, 6:22 AMKevin Kho
Atul Anand
04/02/2022, 5:24 AMKevin Kho
cloudpickle
on the Client side and then sent to the worker (through the scheduler), and then it is unpickled there. In order to unpickle correctly and execute code, you need consistent package versions. I mean, you can have a new image for A, B,C is it helps but workers will never be independent of the code on your clientAtul Anand
04/02/2022, 3:55 PMKevin Kho