Hi all,
can someone can share the steps to store flows in my docker-image and use it using docker-hu...
n
Neeraj Vyas
02/05/2021, 6:41 PMHi all,
can someone can share the steps to store flows in my docker-image and use it using docker-hub with kubernetes agent?
It will surely help
z
Zanie
02/05/2021, 7:01 PM
Hi @Neeraj Vyas -- you'll want to use https://docs.prefect.io/orchestration/flow_config/storage.html#docker and https://docs.prefect.io/orchestration/flow_config/run_configs.html#kubernetesrun
🙌 2
n
Neeraj Vyas
02/05/2021, 7:05 PMI will try it.. Thanks @Zanie
Neeraj Vyas
02/05/2021, 7:45 PMSuccessfully tagged neo0710/prefect_flow/basic-prefect-etl-flow:latest
[2021-02-06 005719+0530] INFO - prefect.Docker | Pushing image to the registry...
Traceback (most recent call last):
File "basic-prefect-etl-flow.py", line 19, in <module>
flow.register(project_name='Neo_kube_prefect')
File "/home/hp/.local/lib/python3.6/site-packages/prefect/core/flow.py", line 1675, in register
idempotency_key=idempotency_key,
File "/home/hp/.local/lib/python3.6/site-packages/prefect/client/client.py", line 783, in register
serialized_flow = flow.serialize(build=build) # type: Any
File "/home/hp/.local/lib/python3.6/site-packages/prefect/core/flow.py", line 1450, in serialize
storage = self.storage.build() # type: Optional[Storage]
File "/home/hp/.local/lib/python3.6/site-packages/prefect/storage/docker.py", line 354, in build
self._build_image(push=push)
File "/home/hp/.local/lib/python3.6/site-packages/prefect/storage/docker.py", line 429, in _build_image
self.push_image(full_name, self.image_tag)
File "/home/hp/.local/lib/python3.6/site-packages/prefect/storage/docker.py", line 637, in push_image
raise InterruptedError(line.get("error"))
InterruptedError: denied: requested access to the resource is denied
I am getting this issue... How can I store my docker credentials?
z
Zanie
02/05/2021, 9:47 PM
It just uses the docker client; have you tried https://docs.docker.com/engine/reference/commandline/login/ ?
n
Neeraj Vyas
02/06/2021, 4:10 PMThe issue --> : InterruptedError: denied: requested access to the resource is denied
was coming because, I was giving extra information with my dockerHubName.
There was no issue with login credentials.
Neeraj Vyas
02/06/2021, 4:10 PMThanks @Zanie
Neeraj Vyas
02/06/2021, 4:11 PMExample :
registry_url="neo0710/somename", --> GOT ISSUE
registry_url="neo0710", --> No issue
Prefect Community
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by