https://prefect.io logo
Title
j

Juan David Barreto

03/16/2022, 3:19 PM
Hi, I'm trying to run DataBricks Tasks using a docker agent. However the flow is failing when importting de DB tasks. When writting from prefect.tasks.databricks.databricks_get_job_id import DatabricksGetJobID, it fails with: 'ModuleNotFoundError: No module named 'pydantic''. I'm using the latest-python3.8 docker image
k

Kevin Kho

03/16/2022, 3:22 PM
This is not include because it’s an installation extra. You can install it
pip install prefect[databricks]
that will include pydantic or you can install it yourself.
j

Juan David Barreto

03/16/2022, 4:16 PM
Thanks, I though the base image would have the dependencies. I've created a new image with the required libraries
k

Kevin Kho

03/16/2022, 4:21 PM
It has quite a bunch but not all